Skip to content

Add submitChatRequestsAndFetch method#222

Merged
andreadimaio merged 1 commit intomainfrom
feature/batch-chat-requests
Mar 5, 2026
Merged

Add submitChatRequestsAndFetch method#222
andreadimaio merged 1 commit intomainfrom
feature/batch-chat-requests

Conversation

@andreadimaio
Copy link
Copy Markdown
Member

@andreadimaio andreadimaio commented Mar 5, 2026

Add a new method to BatchService that simplifies batch
processing of chat requests (submitChatRequestsAndFetch).

The method automatically:

  • Formats chat requests as JSONL with sequential custom ids
  • Uploads the file and submits the batch job
  • Waits for completion and retrieves results
  • Sorts results by custom_id to maintain input order
  • Delete the temp files

@andreadimaio andreadimaio self-assigned this Mar 5, 2026
@andreadimaio andreadimaio force-pushed the feature/batch-chat-requests branch from d682f78 to e33444d Compare March 5, 2026 22:59
@andreadimaio andreadimaio merged commit cd9090a into main Mar 5, 2026
8 checks passed
@andreadimaio andreadimaio deleted the feature/batch-chat-requests branch March 5, 2026 23:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant