InferenceIndex

Live scoreboard for inference economics

Provider index

Snapshot each provider before routing production traffic.

This route gives product and infrastructure teams a quick way to scan where each provider wins today, without jumping straight into raw exports or the underlying provider table. Speed metrics stay pending unless sourced from authenticated inference runs.

Rank #1

OpenRouter

OpenRouter is currently represented by a public public models API freshness check. Speed metrics are pending until an API key enables real inference.

Score

Pending

Performance

  • N/A — real benchmark pending p95 latency
  • N/A — real benchmark pending throughput
  • Source: provider docs/catalog only; latency and throughput pending
  • Updated at 9/28/2026, 3:00:52 AM UTC

Economics

  • $0.00021 blended / 1K tokens
  • Tracked model: meta-llama/llama-3.3-70b-instruct
  • Pricing is documented list price; speed requires real inference

Rank #2

Groq

Groq is currently represented by a public public model docs freshness check. Speed metrics are pending until an API key enables real inference.

Score

Pending

Performance

  • N/A — real benchmark pending p95 latency
  • N/A — real benchmark pending throughput
  • Source: provider docs/catalog only; latency and throughput pending
  • Updated at 9/28/2026, 3:00:53 AM UTC

Economics

  • $0.00069 blended / 1K tokens
  • Tracked model: llama-3.3-70b-versatile
  • Pricing is documented list price; speed requires real inference

Rank #3

Together AI

Together AI is currently represented by a public public serverless model docs freshness check. Speed metrics are pending until an API key enables real inference.

Score

Pending

Performance

  • N/A — real benchmark pending p95 latency
  • N/A — real benchmark pending throughput
  • Source: provider docs/catalog only; latency and throughput pending
  • Updated at 9/28/2026, 3:00:53 AM UTC

Economics

  • $0.00088 blended / 1K tokens
  • Tracked model: meta-llama/Llama-3.3-70B-Instruct-Turbo
  • Pricing is documented list price; speed requires real inference