Fireworks AI
High-speed inference for open-source LLMs with function calling and structured outputs.
From $0.20/MTok Free tier available
Start Free - Category
- LLM Platforms & APIs
- Pricing
- From $0.20/MTok
- Website
- fireworks.ai
About Fireworks AI
Fireworks AI delivers production-grade inference for open-source models like LLaMA and Mixtral with sub-200ms latency. Supports function calling, structured JSON output, vision models, and serverless or dedicated GPU deployments.
What you get
- Sub-200ms inference latency
- LLaMA 3, Mixtral, Gemma, Qwen models
- Function calling & structured output
- OpenAI-compatible API
- Serverless & dedicated GPU options
- Vision & multimodal models
Specifications
| Context Window | 128K tokens |
|---|---|
| Tool Use | Yes |
| Vision | Yes |
| Streaming | Yes |
| Open Source | Yes |
| Self-Host | No |
| Starting Price | $0.20/MTok input |