Experiential
ModelsLogs
Star us on GitHubDocsSettings
Sign in
Continue with GoogleContinue with GitHub
or
Models

GPT-4o

gpt-4oby GPT
Try in Playground

Context

128K

Max output

16K

Price per million tokens

$2.50in$1.25cached$10out

Fastest

248 tok/s

Released

-

Waterfall

  1. 1
    Experiential Cloud$2.50/$10100% up248 tok/s2.99s
  2. 2
    Azure Foundry via Experiential Cloud$2.50/$10100% up80.7 tok/s1.58s

Quickstart

I want you to route my LLM calls for "gpt-4o" through the Experiential gateway instead of calling the provider directly. It speaks the OpenAI Chat Completions API, so this is a base-URL and key swap. Please:

1. Point the client at https://api.experientiallabs.ai/v1 as the base URL.
2. Authenticate with my Experiential API key from the EXPLABS_API_KEY environment variable. If it isn't set, stop and tell me to create one under Settings -> API Keys and export it.
3. Use the model id "gpt-4o" exactly.
4. Update every place my code builds an LLM client for this model to use that base URL and key, leaving streaming and tool-calls as they are.
5. Make one test call and show me the reply plus the token usage, so we confirm it runs on my Experiential credits.

Tell me which files you changed.
CapabilitiesAccepts text

Sampling

Temperature0-2Top-p0-1Stop sequences

Tools & structure

ToolsStrict toolsParallel tool callsStructured output*

Streaming

Streaming

Limits

Max output16,384

Sending an unsupported field? See error reference

Providers serving this model5
Status
Experiential Cloudexperiential248 tok/s2.99s100%#2 / 2128K16K$2.50Pro 5% · Max 10% · Ultra 20% off$10cache$1.25-no dataactivemeasured
Azure Foundry via Experiential Cloudexperientialgpt-4o80.7 tok/s1.58s100%#1 / 2128K16K$2.50$10cache$1.25-no dataactivemeasured
Azure Foundrygpt-4o-2024-05-13deployed 2024-05-1380.7 tok/s1.58s100%-128K16K$0.61≈$2.94≈no data≈-no dataactivemeasured
Azure Foundrygpt-4o-2024-11-20deployed 2024-11-2080.7 tok/s1.58s100%-128K16K$0.61≈$2.94≈no data≈-no dataactivemeasured
Azure Foundrygpt-4o-2024-08-06deployed 2024-08-0680.7 tok/s1.58s100%-128K16K$0.61≈$2.94≈no data≈-no dataactivemeasured
Release notes