Skip to content

Serving inference for

Products

Four toolkits, one platform.

Managed endpoints for language, documents and voice — plus the open-source libraries our own engineers use to run them. One API, one SDK, one invoice.

LLM toolkit

Chat, completion, embeddings and function calling on 40+ open-weight models — with streaming, batching, structured output and prompt versioning built in.

POST /v1/chat/completions
  • Fine-tuning and LoRA adapters on your own corpus
  • Eval suites that run on every prompt change
  • 1M-token context and tool-use primitives

OCR & document AI

Invoices, IDs, contracts, handwriting, tables. Layout-aware models return typed JSON with coordinates — not a wall of text you have to re-parse.

POST /v1/vision/ocr
  • 190+ languages, rotated and low-contrast scans
  • Per-field confidence scores for review queues
  • Batch mode: 100k pages per job, async webhooks

Speech — TTS & STT

Natural synthesis in 42 voices and 30 languages, streamed in under 300 ms, plus realtime transcription with word-level timestamps.

POST /v1/audio/speech
  • Voice cloning with verified consent and watermarking
  • SSML, pronunciation lexicons and pace control
  • Telephony-ready 8 kHz and 48 kHz output

Enterprise studio

Our engineers design the system with yours: model selection, guardrails, data flow, rollout plan and the cost model — then hand over the documentation.

SCOPED 4–12 week engagements
  • Private VPC or fully on-prem deployment
  • Security review, DPA and architecture sign-off
  • Named architect on call through go-live
In production

Boring where it counts.

Inference is the easiest part of an AI feature to get wrong in production. We handle the parts nobody wants to build twice.

Autoscaling GPUs

Warm pools keep cold starts under 400 ms, and idle capacity scales to zero so staging costs nothing.

Streaming first

Server-sent events and WebSockets everywhere. Tokens, partial transcripts and audio chunks arrive as they are produced.

Guardrails & evals

PII redaction, prompt-injection filters and regression suites that run before a prompt reaches production.

Cost controls

Per-key budgets, spend alerts and hard caps. Cache hits and batch jobs are billed at a fraction of realtime rates.

Per-request traces

Token accounting, latency percentiles and model versions on every call — exported to your own OpenTelemetry collector.

Typed SDKs

First-class TypeScript, Python and Go clients, a CLI, and a self-hostable gateway that speaks the same API.

By the numbers

Capacity you never have to think about.

Six regions, burst to thousands of concurrent requests, and a rate limit you will only ever meet if you try to.

  • us-east
  • us-west
  • eu-central
  • ap-south
  • ap-northeast
  • sa-east
  • 1.4BTokens served every day across all endpoints
  • 180msMedian time to first token, streaming
  • 99.99%Uptime over the last 12 months
  • 190+Languages supported by OCR and speech

“We replaced three vendor SDKs and eleven million pages of OCR with one integration. The p95 latency chart stopped being a topic in our standups.”

Dana Whitfield · VP Engineering, Northwind
The platform

One integration for every modality.

Swap models without touching your code, keep the same auth, the same SDKs and the same observability — whether the request is a chat turn, a scanned invoice or a voice line.

  1. Get a key

    Create an API key and make your first call in the playground. No card required for the free tier.

  2. Call the API

    Use the typed SDKs or plain HTTP. Point at api.sapphire.studio and stream the response.

  3. Scale & govern

    Add budgets, guardrails and evals as traffic grows — or lift the whole stack into your own VPC.

Read the API reference

  • sapphire-llm-70bchat · tools · 1M context
    Streaming
  • sapphire-ocr-v3documents · tables · handwriting
    Batch
  • sapphire-tts-v242 voices · 30 languages
    Realtime
Tokens served · last 30 days+18.4%
Pricing

Pay for tokens, not for seats.

Start with a million free tokens a month. Metered usage after that, with hard caps you control.

Developer

For prototypes, side projects and evaluation.

$0 / month

Create an API key
  • 1M tokens free every month
  • LLM, OCR and TTS endpoints
  • Community SDKs and docs
  • Best-effort rate limits

Enterprise

For regulated workloads and your own hardware.

Custom

Talk to an engineer
  • On-prem or single-tenant VPC
  • Custom models on your corpus
  • Zero data retention & BYOK
  • HIPAA BAA, DPA and procurement support
  • Solution design engagement included

Every plan includes streaming, batching, TLS in transit, audit logging and unlimited API keys. Batch and cached requests are billed at 50% off.

Questions

The practical details

Do you train on our data?

Never. Prompts, documents and audio are processed for your request only. Standard plans retain inputs for 30 days for abuse monitoring, and Enterprise plans can switch to zero retention — we also sign a DPA and, where needed, a HIPAA BAA.

Can we run the models on our own hardware?

Yes. Enterprise customers deploy the same serving stack into their own VPC or on-prem cluster — same API surface, same SDKs, your GPUs or your reserved capacity. We ship Helm charts, container images and a reference architecture, and our engineers run the first rollout with your team.

How accurate is the OCR, really?

On our public benchmark set of invoices, receipts and IDs, sapphire-ocr-v3 returns 99.2% character accuracy and 96.8% field-level accuracy. Every field comes back with a confidence score so you can route the uncertain 3% to a human review queue instead of guessing.

What stops someone cloning a voice they do not own?

Voice cloning requires a verified consent recording from the speaker, is limited to your organization, and every synthesis is watermarked in the audio signal. We take down reported misuse, and cloning is disabled by default on the Developer plan.

How does billing work when traffic is spiky?

You pay per million tokens, per page and per character of audio — no seat fees. Bursts are fine: we autoscale and bill the extra usage. To make invoices predictable you can reserve throughput, set per-key budgets and hard caps, and see spend alerts at 80% of any limit.

Is any of this open source?

The SDKs, CLI and our self-hostable gateway are MIT licensed, and we publish the serving benchmarks we use internally. If you would rather run everything yourself, start with the gateway and bring your own models — the API stays the same.

Your first million tokens are on us.

No card, no sales call, no expiry. Create a key, copy three lines of code and see your first response stream back in under a minute.