# Devtool Arena - API Leaderboard

97 APIs evaluated across 21 categories.

**Grades:** A (90-100) Agent-Ready | B (75-89) Friendly | C (60-74) Difficult | D (<60) Hostile

## Inference
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [SambaNova](/leaderboard/claudecode/api/sambanova) | 75 | B | $0.15 | 0 |
| [Groq](/leaderboard/claudecode/api/groq) | 56 | C | $1.05 | 14 |
| [Cerebras](/leaderboard/claudecode/api/cerebras) | 33 | D | $0.40 | 9 |
| [DeepInfra](/leaderboard/claudecode/api/deepinfra) | 21 | D | $— | 0 |
| [OpenRouter](/leaderboard/claudecode/api/openrouter) | 15 | D | $0.63 | 10 |
| [Perplexity](/leaderboard/claudecode/api/perplexity) | 12 | D | $— | 0 |
| [TogetherAI](/leaderboard/claudecode/api/togetherai) | 7 | D | $— | 0 |
| [Fireworks AI](/leaderboard/claudecode/api/fireworks-ai) | 4 | D | $— | 0 |

## Auth
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [WorkOS](/leaderboard/claudecode/api/workos) | 79 | B | $0.35 | 2 |
| [Descope](/leaderboard/claudecode/api/descope) | 77 | B | $0.22 | 2 |
| [Clerk](/leaderboard/claudecode/api/clerk) | 53 | D | $0.00 | 0 |
| [Auth0](/leaderboard/claudecode/api/auth0) | 32 | D | $0.83 | 14 |
| [Scalekit](/leaderboard/claudecode/api/scalekit) | 31 | D | $0.62 | 9 |
| [Stytch](/leaderboard/claudecode/api/stytch) | 8 | D | $— | 0 |

## Payment
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Stripe](/leaderboard/claudecode/api/stripe) | 83 | B | $0.23 | 0 |
| [Mollie](/leaderboard/claudecode/api/mollie) | 79 | B | $0.18 | 0 |
| [Chargebee](/leaderboard/claudecode/api/chargebee) | 64 | C | $0.77 | 5 |
| [PayPal](/leaderboard/claudecode/api/paypal) | 63 | C | $0.66 | 10 |
| [LemonSqueezy](/leaderboard/claudecode/api/lemonsqueezy) | 52 | D | $0.91 | 4 |
| [Paddle](/leaderboard/claudecode/api/paddle) | 38 | D | $0.51 | 3 |
| [Razorpay](/leaderboard/claudecode/api/razorpay) | 13 | D | $0.00 | 0 |
| [Square](/leaderboard/claudecode/api/square) | 13 | D | $0.00 | 0 |
| [Adyen](/leaderboard/claudecode/api/adyen) | 12 | D | $— | 0 |
| [Airwallex](/leaderboard/claudecode/api/airwallex) | 9 | D | $— | 0 |

## Search
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Jina AI](/leaderboard/claudecode/api/jina-ai) | 85 | B | $0.13 | 0 |
| [Tavily](/leaderboard/claudecode/api/tavily) | 81 | B | $0.07 | 0 |
| [Firecrawl](/leaderboard/claudecode/api/firecrawl) | 78 | B | $0.12 | 1 |
| [Exa](/leaderboard/claudecode/api/exa) | 71 | C | $0.11 | 1 |
| [You.com](/leaderboard/claudecode/api/you-com) | 68 | C | $0.18 | 5 |
| [Brave Search](/leaderboard/claudecode/api/brave-search) | 9 | D | $— | 0 |

## Voice STT
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [AssemblyAI](/leaderboard/claudecode/api/assemblyai) | 80 | B | $0.10 | 3 |
| [Rev AI](/leaderboard/claudecode/api/rev-ai) | 61 | C | $0.08 | 1 |
| [Deepgram](/leaderboard/claudecode/api/deepgram) | 59 | C | $1.13 | 12 |
| [OpenAI Whisper](/leaderboard/claudecode/api/openai-whisper) | 25 | D | $— | 0 |
| [Speechmatics](/leaderboard/claudecode/api/speechmatics) | 21 | D | $— | 0 |

## Voice TTS
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [ElevenLabs](/leaderboard/claudecode/api/elevenlabs) | 81 | B | $0.07 | 1 |
| [Cartesia](/leaderboard/claudecode/api/cartesia) | 61 | C | $0.21 | 2 |
| [LMNT](/leaderboard/claudecode/api/lmnt) | 60 | C | $0.17 | 4 |
| [Resemble AI](/leaderboard/claudecode/api/resemble-ai) | 47 | D | $0.18 | 5 |
| [Rime](/leaderboard/claudecode/api/rime) | 40 | D | $0.00 | 0 |

## Voice Telephony
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Telnyx](/leaderboard/claudecode/api/telnyx) | 66 | C | $0.39 | 3 |
| [Plivo](/leaderboard/claudecode/api/plivo) | 59 | C | $0.60 | 8 |
| [Twilio](/leaderboard/claudecode/api/twilio) | 57 | C | $1.58 | 8 |
| [Sinch](/leaderboard/claudecode/api/sinch) | 10 | D | $0.00 | 0 |
| [Vonage](/leaderboard/claudecode/api/vonage) | 10 | D | $0.00 | 0 |
| [Bandwidth](/leaderboard/claudecode/api/bandwidth) | 9 | D | $— | 0 |
| [Infobip](/leaderboard/claudecode/api/infobip) | 4 | D | $— | 0 |

## Voice Infra
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Daily](/leaderboard/claudecode/api/daily) | 57 | C | $0.35 | 5 |
| [LiveKit](/leaderboard/claudecode/api/livekit) | 46 | D | $0.16 | 1 |
| [Agora](/leaderboard/claudecode/api/agora) | 35 | D | $0.47 | 6 |
| [100ms](/leaderboard/claudecode/api/100ms) | 17 | D | $— | 0 |
| [Pipecat](/leaderboard/claudecode/api/pipecat) | 4 | D | $— | 0 |

## Sandboxes
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Sprites](/leaderboard/claudecode/api/sprites) | 75 | B | $0.24 | 0 |
| [Modal](/leaderboard/claudecode/api/modal) | 67 | C | $0.23 | 2 |
| [Daytona](/leaderboard/claudecode/api/daytona) | 62 | C | $0.14 | 0 |
| [E2B](/leaderboard/claudecode/api/e2b) | 59 | C | $0.09 | 2 |
| [Cloudflare Workers](/leaderboard/claudecode/api/cloudflare-workers) | 8 | D | $— | 0 |
| [Vercel](/leaderboard/claudecode/api/vercel) | 8 | D | $— | 0 |

## Vector Databases
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Qdrant](/leaderboard/claudecode/api/qdrant) | 72 | C | $0.60 | 8 |
| [Pinecone](/leaderboard/claudecode/api/pinecone) | 51 | D | $0.29 | 4 |
| [Chroma](/leaderboard/claudecode/api/chroma) | 48 | D | $0.51 | 11 |
| [LanceDB](/leaderboard/claudecode/api/lancedb) | 41 | D | $0.44 | 10 |
| [Zilliz Cloud](/leaderboard/claudecode/api/zilliz-cloud) | 39 | D | $0.29 | 6 |
| [Weaviate](/leaderboard/claudecode/api/weaviate) | 13 | D | $0.17 | 3 |

## Database
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Convex](/leaderboard/claudecode/api/convex) | 34 | D | $1.06 | 19 |

## Stablecoin
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [BlindPay](/leaderboard/claudecode/api/blindpay) | 59 | C | $0.76 | 3 |
| [Circle](/leaderboard/claudecode/api/circle) | 43 | D | $2.78 | 33 |
| [DFNS](/leaderboard/claudecode/api/dfns) | 17 | D | $— | 0 |
| [Coinbase Payments](/leaderboard/claudecode/api/coinbase-payments) | 10 | D | $1.94 | 15 |
| [Fireblocks](/leaderboard/claudecode/api/fireblocks) | 10 | D | $0.00 | 0 |
| [Triple-A](/leaderboard/claudecode/api/triple-a) | 4 | D | $— | 0 |

## Meeting Bot
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Meetstream](/leaderboard/claudecode/api/meetstream) | 63 | C | $0.29 | 4 |
| [MeetGeek](/leaderboard/claudecode/api/meetgeek) | 47 | D | $0.13 | 1 |
| [Meeting BaaS](/leaderboard/claudecode/api/meeting-baas) | 39 | D | $1.62 | 26 |
| [Recall.ai](/leaderboard/claudecode/api/recall-ai) | 29 | D | $0.34 | 4 |
| [CueMeet](/leaderboard/claudecode/api/cuemeet) | 4 | D | $— | 0 |

## Durable Workflow
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Restate](/leaderboard/claudecode/api/restate) | 70 | C | $0.27 | 5 |
| [Temporal](/leaderboard/claudecode/api/temporal) | 65 | C | $0.26 | 3 |
| [Prefect](/leaderboard/claudecode/api/prefect) | 50 | D | $0.00 | 4 |
| [AWS Step Functions](/leaderboard/claudecode/api/aws-step-functions) | 21 | D | $— | 0 |
| [Akka](/leaderboard/claudecode/api/akka) | 21 | D | $— | 0 |
| [Camunda](/leaderboard/claudecode/api/camunda) | 15 | D | $4.15 | 19 |
| [Cadence](/leaderboard/claudecode/api/cadence) | 12 | D | $— | 0 |
| [Netflix Conductor](/leaderboard/claudecode/api/netflix-conductor) | 9 | D | $— | 0 |

## Cloud Hosting
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Render](/leaderboard/claudecode/api/render) | 78 | B | $0.29 | 0 |
| [Netlify](/leaderboard/claudecode/api/netlify) | 43 | D | $0.18 | 5 |
| [DigitalOcean](/leaderboard/claudecode/api/digitalocean) | 12 | D | $— | 0 |
| [Railway](/leaderboard/claudecode/api/railway) | 5 | D | $— | 0 |

## Observability
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Datadog](/leaderboard/claudecode/api/datadog) | 44 | D | $0.21 | 4 |

## Email
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Agentmail](/leaderboard/claudecode/api/agentmail) | 74 | C | $0.22 | 2 |
| [Resend](/leaderboard/claudecode/api/resend) | 65 | C | $0.43 | 2 |
| [Nylas](/leaderboard/claudecode/api/nylas) | 13 | D | $0.00 | 0 |

## Geocoding
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [OpenCageData](/leaderboard/claudecode/api/opencagedata) | 9 | D | $— | 0 |

## Proxy
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Massive](/leaderboard/claudecode/api/massive) | 45 | D | $0.24 | 5 |

## Browser Automation
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Anchor Browser](/leaderboard/claudecode/api/anchor-browser) | 9 | D | $— | 0 |

## Webscraping
| Provider | Score | Grade | Cost | Errors |
|----------|-------|-------|------|--------|
| [Scrapfly](/leaderboard/claudecode/api/scrapfly) | 80 | B | $0.14 | 0 |
| [Nimbleway](/leaderboard/claudecode/api/nimbleway) | 50 | D | $0.16 | 5 |