Skip to content

Add blog post: Introducing the Common AI Provider#1483

Open
kaxil wants to merge 5 commits intomainfrom
blog/common-ai-provider-0.1.0
Open

Add blog post: Introducing the Common AI Provider#1483
kaxil wants to merge 5 commits intomainfrom
blog/common-ai-provider-0.1.0

Conversation

@kaxil
Copy link
Copy Markdown
Member

@kaxil kaxil commented Mar 30, 2026

Summary

Blog post announcing the apache-airflow-providers-common-ai 0.1.0 release (AIP-99).

Covers:

  • The 6 operators and TaskFlow decorators (@task.llm, @task.agent, @task.llm_branch, @task.llm_sql, @task.llm_file_analysis, @task.llm_schema_compare)
  • Toolsets (SQLToolset, HookToolset, MCPToolset, DataFusionToolset)
  • Human-in-the-loop approval and iterative review
  • Durable execution with step-level caching
  • Multi-provider connection support (OpenAI, Anthropic, Google, Azure, Bedrock, etc.)
  • Raw Pydantic AI usage path

Screenshots sourced from PRs: apache/airflow#62785, apache/airflow#62898, apache/airflow#62901, apache/airflow#64077, apache/airflow#64199.

Co-authored by @kaxil and @gopidesupavan.

Announces the 0.1.0 release of apache-airflow-providers-common-ai (AIP-99),
covering operators, decorators, toolsets, HITL review, durable execution,
and multi-provider connection support.

Update index.md

Add registry link, social banner, and review fixes

- Add Airflow Registry link to Get Involved section
- Add OpenGraph social banner image (1200x630) for social sharing
- Add images: frontmatter for social cards
- Replace em dashes with colons/periods throughout
- Break up triads and AI writing patterns
- Fix raw Pydantic AI code example (toolsets= instead of get_tools())
- Add Airflow 3.0+ requirement
- Add HITL and file analysis screenshots from PRs
- Remove duplicate 0.x release paragraph
- Simplify By the Numbers table
@kaxil kaxil force-pushed the blog/common-ai-provider-0.1.0 branch from 140a117 to 4ee1328 Compare March 30, 2026 23:46
kaxil and others added 2 commits March 31, 2026 00:50
"Introducing Native AI Agent Support" with real Airflow pinwheel logos.
| **`SQLToolset`** | `list_tables`, `get_schema`, `query`, `check_query` for any `DbApiHook` database |
| **`HookToolset`** | Wraps any Airflow hook's methods as agent tools |
| **`MCPToolset`** | Connects to external [MCP](https://modelcontextprotocol.io/) servers via Airflow Connections |
| **`DataFusionToolset`** | SQL over files in object storage (S3, GCS, Azure Blob) via Apache DataFusion |
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GCS, Azure Blob we have not yet added suport may be we should add like coming soon?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

S3 is available though, yeah?

@gopidesupavan
Copy link
Copy Markdown
Member

have updated file-analysis-image.png as it has wrong task name it may confuse :)

@gopidesupavan
Copy link
Copy Markdown
Member

This is very solid blog everything covers what we are shipping part of first release :)

@gopidesupavan
Copy link
Copy Markdown
Member

@vikramkoka appreciate if you could also add your inputs here.. :)

@kaxil kaxil marked this pull request as ready for review April 7, 2026 23:52
@kaxil
Copy link
Copy Markdown
Member Author

kaxil commented Apr 8, 2026

(fyi @potiuk )

@potiuk
Copy link
Copy Markdown
Member

potiuk commented Apr 8, 2026

Release in progress https://lists.apache.org/thread/9r60zyhk90hgyyy2pprxj0t2v65vopjj - please test :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants