Skip to content

dotcomrow/dataflow-apps

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

dataflow-apps

Argo CD app-of-apps repo for dataflow workloads (Flink jobs, NiFi flow apps, and related pipeline manifests).

This repo should only contain Argo CD child Application/ApplicationSet resources that point to workload repos.

Layout

  • manifests/*.yaml: child Application resources, one per workload repo/app.

Current child apps

  • dataflow-example-app -> https://github.com/dotcomrow/dataflow-example-app.git (prod, manifests/)

Deploy model

  1. Argo CD deploys this repo (path: manifests).
  2. This repo creates/updates child Application resources.
  3. Child apps deploy pipeline workloads into dataflow namespace.

This keeps platform runtime (k8s-kafka) separate from pipeline workloads.

About

App of apps repo for data pipeline apps

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors