Philosophy

1. Batch API first.

The Batch API has been historically neglected. We're designed around the Batch API.

2. Synchronous and Batch interchangeable.

Parallelize agentic workflows (with function calls, structured output, images) to millions of requests and save 50% -- in one line of code.

3. Control flow described by Python code, not data structures.

Python can already express complex conditionals, arbitrary expressions, branching; why use anything else?

4. An "agent" is more than an LLM.

See the Your first agent.

Developer Experience

We care about developer experience -- from code readability, expressivity, conciseness, to command line pretty-printing and import times.

We are low-level and lightweight, with friendly abstractions.