Groq vs Together AI: LLM API pricing compared
Updated 2026-11-09 · listed A to Z, not ranked
Groq runs its own LPU inference hardware and sells model access through GroqCloud, an OpenAI-compatible API billed per token (language models), per hour of audio (Whisper) or per character (text to speech).
Together AI hosts open-source and partner models behind a serverless API, rents GPU clusters, and runs fine-tuning jobs. Serverless inference bills per 1M tokens (with cheaper cached input on many models); GPUs bill per GPU hour.
Listed A to Z, from console.groq.com and together.ai. Every figure below is quoted from those pages.
- Main price table
- GPT OSS 120B (openai/gpt-oss-120b), GPT OSS 20B (openai/gpt-oss-20b), Llama 3.1 8B Instant, Llama 3.3 70B Versatile, Whisper Large V3, Whisper Large V3 Turbo
- Free option
- None in the published plan table
- Published prices
- GPT OSS 120B $0.15 in / $0.60 out per 1M tokens, GPT OSS 20B $0.075 / $0.30, Whisper Large V3 Turbo $0.04 per hour.
- Main price table
- gpt-oss-120B, GLM-5.3, GLM-5.3-Flash, Kimi K3, DeepSeek V4.1 Flash, Llama 3 8B Instruct Lite
- Free option
- None in the published plan table
- Published prices
- Serverless tokens (e.g. gpt-oss-120B $0.15 / $0.60 per 1M), GPU clusters (H100 $3.99/hr on demand), dedicated inference and fine-tuning from $0.34 per 1M tokens.
How we checked: Prices quoted from each official pricing page: Groq checked Nov 9, 2026, Together AI checked Nov 9, 2026. Taxes, usage overages and promotions can change what you pay; confirm with each provider before you buy.
How they compare
- Main price table. Groq lists 6 entries (GPT OSS 120B (openai/gpt-oss-120b), GPT OSS 20B (openai/gpt-oss-20b), Llama 3.1 8B Instant, Llama 3.3 70B Versatile, Whisper Large V3, Whisper Large V3 Turbo); Together AI lists 6 (gpt-oss-120B, GLM-5.3, GLM-5.3-Flash, Kimi K3, DeepSeek V4.1 Flash, Llama 3 8B Instruct Lite).
- Free option. Groq: none in the published plan table. Together AI: none in the published plan table.
- How prices are quoted. Groq: “Production models”. Together AI: “Serverless inference: sample chat models (per 1M tokens)”.
Groq plans and prices
| Model | Speed (tokens/sec) | Price | Context window |
|---|---|---|---|
| GPT OSS 120B (openai/gpt-oss-120b) | ~500 | $0.15 input / $0.60 output per 1M tokens | 131,072 |
| GPT OSS 20B (openai/gpt-oss-20b) | ~1,000 | $0.075 input / $0.30 output per 1M tokens | 131,072 |
| Llama 3.1 8B Instant | ~560 | Enterprise: contact sales | 131,072 |
| Llama 3.3 70B Versatile | ~280 | Enterprise: contact sales | 131,072 |
| Whisper Large V3 | — | $0.111 per hour of audio | — |
| Whisper Large V3 Turbo | — | $0.04 per hour of audio | — |
Developer plan rate limits on the same page: GPT OSS 120B 250K tokens/min and 1K requests/min; Whisper Large V3 Turbo 400K audio seconds/hour.
| Model | Price |
|---|---|
| Qwen3.8 27B | $0.80 input / $4.00 output per 1M tokens |
| Safety GPT OSS 20B | $0.075 input / $0.30 output per 1M tokens |
| Canopy Labs Orpheus V1 English (TTS) | $22.00 per 1M characters |
| Canopy Labs Orpheus Arabic Saudi (TTS) | $40.00 per 1M characters |
| Llama Prompt Guard 2 22M / 86M | $0.03 / $0.04 per 1M tokens (input and output) |
Groq says preview models may be discontinued at short notice and should not be used in production.
From console.groq.com, checked Nov 9, 2026. Full breakdown: Groq pricing.
Together AI plans and prices
| Model | Input | Cached input | Output |
|---|---|---|---|
| gpt-oss-120B | $0.15 | — | $0.60 |
| GLM-5.3 | $1.40 | $0.26 | $4.40 |
| GLM-5.3-Flash | $0.15 | $0.03 | $0.50 |
| Kimi K3 | $3.00 | $0.30 | $15.00 |
| DeepSeek V4.1 Flash | $0.30 | $0.006 | $1.20 |
| Llama 3 8B Instruct Lite | $0.14 | — | $0.14 |
Audio: Whisper Large v3 $0.0015 per audio minute; Cartesia Sonic-3 TTS $65.00 per 1M characters. Images from $0.0017 per megapixel (Juggernaut Lightning Flux).
| Hardware | Preemptible | On demand | Reserved 3–30 days | Reserved 91–180 days |
|---|---|---|---|---|
| NVIDIA HGX H100 | $1.99 | $3.99 | $3.69 | $3.19 |
| NVIDIA HGX H200 | $2.99 | $5.99 | $4.99 | $3.99 |
| NVIDIA HGX B200 | $4.09 | $8.19 | $7.99 | $6.79 |
| NVIDIA HGX B300 | $4.99 | $9.99 | Contact us | Contact us |
Dedicated model inference is listed separately: HGX H100 $5.49 and HGX B200 $8.99 per GPU hour on demand.
From together.ai, checked Nov 9, 2026. Full breakdown: Together AI pricing.
FAQ
How much does Groq cost?
GPT OSS 120B $0.15 in / $0.60 out per 1M tokens, GPT OSS 20B $0.075 / $0.30, Whisper Large V3 Turbo $0.04 per hour. (checked Nov 9, 2026).
How much does Together AI cost?
Serverless tokens (e.g. gpt-oss-120B $0.15 / $0.60 per 1M), GPU clusters (H100 $3.99/hr on demand), dedicated inference and fine-tuning from $0.34 per 1M tokens. (checked Nov 9, 2026).
Do Groq and Together AI have a free option?
Groq: none in the published plan table. Together AI: none in the published plan table.
Where do these prices come from?
Each vendor's own pricing page: console.groq.com (checked Nov 9, 2026) and together.ai (checked Nov 9, 2026). Prices change; confirm on the vendor's page before you buy.
Sources (official pages, read 2026-11-09)
Spot something out of date? Email hello@youraitools.co and we’ll fix it.