feat: make flowInput lazy-loaded to prevent data duplication in map steps

[jumski]

Asymmetric Handler Signatures for Flow Composition

This PR implements asymmetric handler signatures to simplify flow composition and improve performance:

• Root steps now receive flow input directly: (flowInput, ctx) => ...
• Dependent steps receive only dependency outputs: (deps, ctx) => ...
• Flow input in dependent steps is now accessed via await ctx.flowInput (async/lazy-loaded)
• Lazy loading prevents data duplication for map steps processing large arrays
• Only root non-map steps receive flow_input from SQL to reduce data transfer
• Added FlowInputProvider class to handle caching and lazy loading of flow input
• Updated examples, tests, and documentation to reflect the new pattern

This change enables functional composition and simplifies types for future subflows by making handler signatures more intuitive and reducing unnecessary data duplication.

[changeset-bot]

⚠️ No Changeset found

Latest commit: b1954f6

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes changesets to release 5 packages

Name	Type
@pgflow/core	Minor
@pgflow/dsl	Minor
@pgflow/client	Minor
@pgflow/edge-worker	Minor
pgflow	Minor

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[jumski]

• docs: add note about CONNECT_TIMEOUT fix using jsr:@oscar6echo/postgres fork #562
• fix: reject empty dependsOn arrays and improve flowInput access patterns #561
• feat: make flowInput lazy-loaded to prevent data duplication in map steps #560 👈 (View in Graphite)
• feat: asymmetric handler signatures for simpler flow composition #559
• refactor: simplify step input structure by removing run key and using context.flowInput #558
• refactor: rename input parameters to flowInput and deps for clarity #557
• refactor: change step handler input to use asymmetric pattern for better type safety #556
• feat: add flow_input to StepTaskRecord and context objects #555
• feat: add flow_input field to step_task_record for direct access to original input #554
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[nx-cloud]

View your CI Pipeline Execution ↗ for commit b1954f6

Command	Status	Duration	Result
nx test:types:health dsl	✅ Succeeded	11s	View ↗

---

☁️ Nx Cloud last updated this comment at 2025-12-30 12:01:53 UTC

[github-actions]

🔍 Preview Deployment: Website

✅ Deployment successful!

🔗 Preview URL: https://pr-560.pgflow.pages.dev

📝 Details:

• Branch: 12-25-feat_lazy_load_ctx.flowinput_to_prevent_data_duplication_for_map_steps
• Commit: 060fb474edc8fc43bf3db3bb57fd250c8cc21e87
• View Logs

_Last updated: _

[jumski]

Merge activity

• Dec 30, 11:24 AM UTC: A user started a stack merge that includes this pull request via Graphite.
• Dec 30, 12:01 PM UTC: Graphite rebased this pull request as part of a merge.
• Dec 30, 12:01 PM UTC: @jumski merged this pull request with Graphite.

[github-actions]

🚀 Production Deployment: Website

✅ Successfully deployed to production!

🔗 Production URL: https://pgflow.dev

📝 Details:

• Commit: 8c77a83d8a45d549976b37f78740cfce8bc2a38e
• View Logs

Deployed at: 2025-12-30T13:01:24+01:00