Context
no data
Max output
no data
Price per million tokens
no datainno dataout
Released
-
Waterfall
No usable route yet. Experiential hosted routes appear automatically; connect a provider key below to use this model.
Quickstart
This model isn't hosted on Experiential credits. The gateway call below works only after you connect your own provider key for it, add one under "Ways to use".
I want you to route my LLM calls for "llama3-1-70b-instruct-v1-0-128k" through the Experiential gateway instead of calling the provider directly. It speaks the OpenAI Chat Completions API, so this is a base-URL and key swap. Please: 1. Point the client at https://api.experientiallabs.ai/v1 as the base URL. 2. Authenticate with my Experiential API key from the EXPLABS_API_KEY environment variable. If it isn't set, stop and tell me to create one under Settings -> API Keys and export it. 3. Use the model id "llama3-1-70b-instruct-v1-0-128k" exactly. 4. Update every place my code builds an LLM client for this model to use that base URL and key, leaving streaming and tool-calls as they are. 5. Make one test call and show me the reply plus the token usage, so we confirm it runs on my Experiential credits. Tell me which files you changed.
Sampling
Streaming
Sending an unsupported field? See error referenceBedrock docs