- [⌘Langbase](https://langbase.com/docs) - Search the docs... `K` Documentation - [Introduction](https://langbase.com/docs) - [Composable AI](https://langbase.com/docs/composable-ai) - [API Reference](https://langbase.com/docs/api-reference) - [Langbase SDK](https://langbase.com/docs/sdk) - [Langbase AI Studio](https://studio.langbase.com) - [BaseAI - Web AI Framework](https://BaseAI.dev) - [Supported LLMs & Providers](https://langbase.com/docs/supported-models-and-providers) Pipe (Agents) Memory (RAG) Langbase SDK Integrations Tools Guides Concepts Features Use cases Solutions Workshops Platform Docs API Reference Deprecated ## Documentation [⌘Langbase](https://langbase.com/docs) [API reference](https://langbase.com/docs/api-reference) [SDK](https://langbase.com/docs/sdk) # Supported LLM models and providers Langbase supports a wide range of latest Large Language Models (LLMs) and providers. We are continuously adding support for the latest models as they are released. Here are some of the models and providers supported by Langbase. ## [Supported LLM Providers](https://langbase.com/docs/supported-models-and-providers\#supported-llm-providers) We currently support the following LLM providers. - OpenAI - Together - Anthropic - Groq - Google - Cohere - Fireworks AI - Perplexity - Mistral AI - xAI - Deepseek You can use any of these providers to build your Pipe, by adding your provider's key. Please feel free to request any specific provider you would like to use. * * * ## [Supported LLM Models](https://langbase.com/docs/supported-models-and-providers\#supported-llm-models) We support the following LLM models from the above providers. Please feel free to request any specific model you would like to use. ### OpenAI | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | o1
ID: `openai:o1` Copy | OpenAI | OpenAI | 200,000 | $15.0 prompt
$60.0 completion | | o3-mini
ID: `openai:o3-mini` Copy | OpenAI | OpenAI | 200,000 | $1.1 prompt
$4.4 completion | | o1-preview
ID: `openai:o1-preview` Copy | OpenAI | OpenAI | 128,000 | $15.0 prompt
$60.0 completion | | o1-mini
ID: `openai:o1-mini` Copy | OpenAI | OpenAI | 128,000 | $3.0 prompt
$12.0 completion | | gpt-4o
ID: `openai:gpt-4o` Copy | OpenAI | OpenAI | 128,000 | $2.5 prompt
$10.0 completion | | gpt-4o-2024-08-06
ID: `openai:gpt-4o-2024-08-06` Copy | OpenAI | OpenAI | 128,000 | $2.5 prompt
$10.0 completion | | gpt-4o-mini
ID: `openai:gpt-4o-mini` Copy | OpenAI | OpenAI | 128,000 | $0.15 prompt
$0.6 completion | | gpt-4-turbo
ID: `openai:gpt-4-turbo` Copy | OpenAI | OpenAI | 128,000 | $10.0 prompt
$30.0 completion | | gpt-4-turbo-preview
ID: `openai:gpt-4-turbo-preview` Copy | OpenAI | OpenAI | 128,000 | $10.0 prompt
$30.0 completion | | gpt-4-0125-preview
ID: `openai:gpt-4-0125-preview` Copy | OpenAI | OpenAI | 128,000 | $10.0 prompt
$30.0 completion | | gpt-4-1106-preview
ID: `openai:gpt-4-1106-preview` Copy | OpenAI | OpenAI | 128,000 | $10.0 prompt
$30.0 completion | | gpt-4
ID: `openai:gpt-4` Copy | OpenAI | OpenAI | 8,192 | $30.0 prompt
$60.0 completion | | gpt-4-0613
ID: `openai:gpt-4-0613` Copy | OpenAI | OpenAI | 8,192 | $30.0 prompt
$60.0 completion | | gpt-4-32k
ID: `openai:gpt-4-32k` Copy | OpenAI | OpenAI | 32,768 | $60.0 prompt
$120.0 completion | | gpt-3.5-turbo-0125
ID: `openai:gpt-3.5-turbo-0125` Copy | OpenAI | OpenAI | 16,385 | $0.5 prompt
$1.5 completion | | gpt-3.5-turbo-1106
ID: `openai:gpt-3.5-turbo-1106` Copy | OpenAI | OpenAI | 16,385 | $1.0 prompt
$2.0 completion | | gpt-3.5-turbo
ID: `openai:gpt-3.5-turbo` Copy | OpenAI | OpenAI | 4,096 | $1.5 prompt
$2.0 completion | | gpt-3.5-turbo-16k
ID: `openai:gpt-3.5-turbo-16k` Copy | OpenAI | OpenAI | 16,385 | $3.0 prompt
$4.0 completion | \\* USD per Million tokens ### Anthropic | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | claude-3.5-sonnet-latest
ID: `anthropic:claude-3-5-sonnet-latest` Copy | Anthropic | Anthropic | 200K | $3 prompt
$15 completion | | claude-3-5-haiku-20241022
ID: `anthropic:claude-3-5-haiku-20241022` Copy | Anthropic | Anthropic | 200K | $1 prompt
$5 completion | | claude-3.5-sonnet-20240620
ID: `anthropic:claude-3-5-sonnet-20240620` Copy | Anthropic | Anthropic | 200K | $3 prompt
$15 completion | | claude-3-opus
ID: `anthropic:claude-3-opus-20240229` Copy | Anthropic | Anthropic | 200K | $15 prompt
$75 completion | | claude-3-sonnet
ID: `anthropic:claude-3-sonnet-20240229` Copy | Anthropic | Anthropic | 200K | $3 prompt
$15 completion | | claude-3-haiku
ID: `anthropic:claude-3-haiku-20240307` Copy | Anthropic | Anthropic | 200K | $0.25 prompt
$1.25 completion | \\* USD per Million tokens ### Google AI | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | gemini-1.5-pro
ID: `google:gemini-1.5-pro-latest` Copy | Google | Google | upto 1M | $7 prompt
$21 completion | | gemini-2.0-flash-exp
ID: `google:gemini-2.0-flash-exp` Copy | Google | Google | upto 1M | $0.075 prompt
$0.3 completion | | gemini-1.5-flash
ID: `google:gemini-1.5-flash-latest` Copy | Google | Google | upto 1M | $0.075 prompt
$0.3 completion | | gemini-1.5-flash-8b
ID: `google:gemini-1.5-flash-8b-latest` Copy | Google | Google | upto 1M | $0.0375 prompt
$0.15 completion | | gemini-1.0-pro
ID: `google:gemini-pro` Copy | Google | Google | 30,720 | $0.5 prompt
$1.5 completion | \\* USD per Million tokens ### Together AI | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | Llama-3.3-70B-Instruct-Turbo
ID: `together:meta-llama/Llama-3.3-70B-Instruct-Turbo` Copy | Together | Meta | 131,072 | $0.88 prompt
$0.88 completion | | deepseek-v3
ID: `together:deepseek-ai/DeepSeek-V3` Copy | Together | Deepseek | 131,072 | $1.25 prompt
$1.25 completion | | Llama-3.1-405B-Instruct-Turbo
ID: `together:meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo` Copy | Together | Meta | 4,096 | $5 prompt
$5 completion | | Qwen2.5-72b
ID: `together:Qwen/Qwen2.5-72B-Instruct-Turbo` Copy | Together | Qwen | 32,768 | $0.9 prompt
$0.9 completion | | Llama-3.1-70B-Instruct-Turbo
ID: `together:meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo` Copy | Together | Meta | 8,192 | $0.88 prompt
$0.88 completion | | Llama-3.1-8B-Instruct-Turbo
ID: `together:meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo` Copy | Together | Meta | 8,192 | $0.18 prompt
$0.18 completion | | Llama-3-70b-chat-hf
ID: `together:meta-llama/Llama-3-70b-chat-hf` Copy | Together | Meta | 8,192 | $0.9 prompt
$0.9 completion | | Llama-3-8b-chat-hf
ID: `together:meta-llama/Llama-3-8b-chat-hf` Copy | Together | Meta | 8,192 | $0.2 prompt
$0.2 completion | | Llama-2-13b-chat-hf
ID: `together:meta-llama/Llama-2-13b-chat-hf` Copy | Together | Meta | 4,096 | $0.225 prompt
$0.225 completion | | gemma-2b-it
ID: `together:google/gemma-2b-it` Copy | Together | Google | 8,192 | $0.1 prompt
$0.1 completion | | 7B-Instruct-v0.1
ID: `together:mistralai/Mistral-7B-Instruct-v0.1` Copy | Together | Mistral | 4,096 | $0.2 prompt
$0.2 completion | | 7B-Instruct-v0.2
ID: `together:mistralai/Mistral-7B-Instruct-v0.2` Copy | Together | Mistral | 32,768 | $0.2 prompt
$0.2 completion | | Mixtral-8x7B-Instruct-v0.1
ID: `together:mistralai/Mixtral-8x7B-Instruct-v0.1` Copy | Together | Mistral | 32,768 | $0.6 prompt
$0.6 completion | | Mixtral-8x22B-Instruct-v0.1
ID: `together:mistralai/Mixtral-8x22B-Instruct-v0.1` Copy | Together | Mistral | 64,000 | $1.2 prompt
$1.2 completion | | DBRX-instruct
ID: `together:databricks/dbrx-instruct` Copy | Together | Databricks | 32,768 | $1.2 prompt
$1.2 completion | \\* USD per Million tokens ### Fireworks AI | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | Llama 3.3 70B Instruct
ID: `fireworks:llama-v3p3-70b-instruct` Copy | Fireworks AI | Meta | 131,072 | $0.9 prompt
$0.9 completion | | deepseek-v3
ID: `fireworks:deepseek-v3` Copy | Fireworks AI | Deepseek | 131,072 | $0.9 prompt
$0.9 completion | | Llama-3.2-3b
ID: `fireworks:llama-v3p2-3b-instruct` Copy | Fireworks AI | Meta | 131,072 | $0.1 prompt
$0.1 completion | | Llama-3.2-1b
ID: `fireworks:llama-v3p2-1b-instruct` Copy | Fireworks AI | Meta | 131,072 | $0.1 prompt
$0.1 completion | | Llama-3.1-405b
ID: `fireworks:llama-v3p1-405b-instruct` Copy | Fireworks AI | Meta | 131,072 | $3 prompt
$3 completion | | Qwen2.5-72b
ID: `fireworks:qwen2p5-72b-instruct` Copy | Fireworks AI | Qwen | 32,768 | $0.9 prompt
$0.9 completion | | Llama-3.1-70b
ID: `fireworks:llama-v3p1-70b-instruct` Copy | Fireworks AI | Meta | 131,072 | $0.9 prompt
$0.9 completion | | Llama-3.1-8b
ID: `fireworks:llama-v3p1-8b-instruct` Copy | Fireworks AI | Meta | 131,072 | $0.2 prompt
$0.2 completion | | yi-large
ID: `fireworks:yi-large` Copy | Fireworks AI | 01.AI | 32,768 | $3 prompt
$3 completion | | Llama-3-70b
ID: `fireworks:llama-v3-70b-instruct` Copy | Fireworks AI | Meta | 8,192 | $0.9 prompt
$0.9 completion | \\* USD per Million tokens ### Groq | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | Llama-3.3-70b-versatile
ID: `groq:llama-3.3-70b-versatile` Copy | Groq | Meta | 128,000 | $0.59 prompt
$0.79 completion | | deepseek-r1-distill-llama-70b
ID: `groq:deepseek-r1-distill-llama-70b` Copy | Groq | DeepSeek | 128,000 | $0.75 prompt
$0.99 completion | | Llama-3.1-70b-versatile
ID: `groq:llama-3.1-70b-versatile` Copy | Groq | Meta | 131,072 | $0.59 prompt
$0.79 completion | | Llama-3.1-8b-instant
ID: `groq:llama-3.1-8b-instant` Copy | Groq | Meta | 131,072 | $0.59 prompt
$0.79 completion | | Llama-3-70b
ID: `groq:llama3-70b-8192` Copy | Groq | Meta | 8,192 | $0.59 prompt
$0.79 completion | | Llama-3-8b
ID: `groq:llama3-8b-8192` Copy | Groq | Meta | 8,192 | $0.05 prompt
$0.1 completion | | Mixtral-8x7B
ID: `groq:mixtral-8x7b-32768` Copy | Groq | Mistral | 32,768 | $0.27 prompt
$0.27 completion | | gemma2-9b-it
ID: `groq:gemma2-9b-it` Copy | Groq | Google | 8,192 | $0.2 prompt
$0.2 completion | \\* USD per Million tokens ### Perplexity | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | sonar-pro
ID: `perplexity:sonar-pro` Copy | Perplexity | Perplexity | 200,000 | $3 prompt
$15 completion | | sonar
ID: `perplexity:sonar` Copy | Perplexity | Perplexity | 127,072 | $1 prompt
$1 completion | | llama-3.1-sonar-huge-128k-online
ID: `perplexity:llama-3.1-sonar-huge-128k-online` Copy | Perplexity | Meta | 127,072 | $5 prompt
$5 completion | | llama-3.1-sonar-large-128k-online
ID: `perplexity:llama-3.1-sonar-large-128k-online` Copy | Perplexity | Meta | 127,072 | $1 prompt
$1 completion | | llama-3.1-sonar-small-128k-online
ID: `perplexity:llama-3.1-sonar-small-128k-online` Copy | Perplexity | Meta | 127,072 | $0.2 prompt
$0.2 completion | \\* USD per Million tokens. Perplexity charges **additional $5 per each request** on its online models. ### Mistral AI | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | Mistral Large 2
ID: `mistral:mistral-large-latest` Copy | Mistral AI | Mistral AI | 128K | $3 prompt
$9 completion | | Mistral Nemo
ID: `mistral:open-mistral-nemo` Copy | Mistral AI | Mistral AI | 128K | $0.3 prompt
$0.3 completion | | Codestral
ID: `mistral:codestral-latest` Copy | Mistral AI | Mistral AI | 32,768 | $1 prompt
$3 completion | \\* USD per Million tokens ### Deepseek | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | deepseek-reasoner
ID: `deepseek:deepseek-reasoner` Copy | Deepseek | Deepseek | 64K | $0.55 prompt
$2.19 completion | | deepseek-chat
ID: `deepseek:deepseek-chat` Copy | Deepseek | Deepseek | 64K | $0.14 prompt
$0.28 completion | \\* USD per Million tokens ### Cohere | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | command-r
ID: `cohere:command-r` Copy | Cohere | Cohere | 128K | $0.5 prompt
$1.5 completion | | command-r-plus
ID: `cohere:command-r-plus` Copy | Cohere | Cohere | 128K | $3 prompt
$15 completion | \\* USD per Million tokens ### xAI | Model | Provider | Owner | Context | Cost\* | | --- | --- | --- | --- | --- | | grok-2-1212
ID: `xai:grok-2-1212` Copy | xAI | xAI | 131,072 | $2 prompt
$10 completion | | grok-2-vision-1212
ID: `xai:grok-2-vision-1212` Copy | xAI | xAI | 32K | $2 prompt
$10 completion | | grok-beta
ID: `xai:grok-beta` Copy | xAI | xAI | 131,072 | $5 prompt
$15 completion | \\* USD per Million tokens * * * ## [JSON Mode Support](https://langbase.com/docs/supported-models-and-providers\#json-mode-support) See the [list of models that support JSON mode](https://langbase.com/docs/features/json-mode) and how to use it in your Pipe. Note Completion and Prompt costs are based on the provider's pricing. Langbase does not charge on top of the provider's costs. * * * ## [Tool Support](https://langbase.com/docs/supported-models-and-providers\#tool-support) The following models support tool calls on Langbase. ### OpenAI | Model | Parallel Tool Call Support | Tool Choice Support | | --- | --- | --- | | o1
ID: `openai:o1` Copy | `true` | `true` | | o3-mini
ID: `openai:o3-mini` Copy | `true` | `true` | | o1-preview
ID: `openai:o1-preview` Copy | `true` | `true` | | o1-mini
ID: `openai:o1-mini` Copy | `true` | `true` | | gpt-4o
ID: `openai:gpt-4o` Copy | `true` | `true` | | gpt-4o-2024-08-06
ID: `openai:gpt-4o-2024-08-06` Copy | `true` | `true` | | gpt-4o-mini
ID: `openai:gpt-4o-mini` Copy | `true` | `true` | | gpt-4-turbo
ID: `openai:gpt-4-turbo` Copy | `true` | `true` | | gpt-4-turbo-preview
ID: `openai:gpt-4-turbo-preview` Copy | `true` | `true` | | gpt-4-0125-preview
ID: `openai:gpt-4-0125-preview` Copy | `true` | `true` | | gpt-4-1106-preview
ID: `openai:gpt-4-1106-preview` Copy | `true` | `true` | | gpt-4
ID: `openai:gpt-4` Copy | `true` | `true` | | gpt-4-0613
ID: `openai:gpt-4-0613` Copy | `true` | `true` | | gpt-4-32k
ID: `openai:gpt-4-32k` Copy | `true` | `true` | | gpt-3.5-turbo-0125
ID: `openai:gpt-3.5-turbo-0125` Copy | `true` | `true` | | gpt-3.5-turbo-1106
ID: `openai:gpt-3.5-turbo-1106` Copy | `true` | `true` | | gpt-3.5-turbo
ID: `openai:gpt-3.5-turbo` Copy | `true` | `true` | | gpt-3.5-turbo-16k
ID: `openai:gpt-3.5-turbo-16k` Copy | `true` | `true` | ### Google | Model | Parallel Tool Call Support | Tool Choice Support | | --- | --- | --- | | gemini-1.5-pro
ID: `google:gemini-1.5-pro-latest` Copy | `true` | `true` | | gemini-2.0-flash-exp
ID: `google:gemini-2.0-flash-exp` Copy | Google | Google | | gemini-1.5-flash
ID: `google:gemini-1.5-flash-latest` Copy | `true` | `true` | | gemini-1.5-flash-8b
ID: `google:gemini-1.5-flash-8b-latest` Copy | `true` | `true` | | gemini-1.0-pro
ID: `google:gemini-pro` Copy | `false` | `false` | ### Anthropic | Model | Parallel Tool Call Support | Tool Choice Support | | --- | --- | --- | | claude-3.5-sonnet-latest
ID: `anthropic:claude-3-5-sonnet-latest` Copy | `true` | `true` | | claude-3.5-sonnet-20240620
ID: `anthropic:claude-3-5-sonnet-20240620` Copy | `true` | `true` | | claude-3-opus
ID: `anthropic:claude-3-opus-20240229` Copy | `true` | `true` | | claude-3-sonnet
ID: `anthropic:claude-3-sonnet-20240229` Copy | `true` | `true` | | claude-3-haiku
ID: `anthropic:claude-3-haiku-20240307` Copy | `true` | `true` | ### Together AI | Model | Parallel Tool Call Support | Tool Choice Support | | --- | --- | --- | | Llama-3.1-405B-Instruct-Turbo
ID: `together:meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo` Copy | `false` | `true` | | Llama-3.1-70B-Instruct-Turbo
ID: `together:meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo` Copy | `false` | `true` | | Llama-3.1-8B-Instruct-Turbo
ID: `together:meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo` Copy | `false` | `true` | | 7B-Instruct-v0.1
ID: `together:mistralai/Mistral-7B-Instruct-v0.1` Copy | `false` | `true` | | Mixtral-8x7B-Instruct-v0.1
ID: `together:mistralai/Mixtral-8x7B-Instruct-v0.1` Copy | `false` | `true` | ## [Deepseek](https://langbase.com/docs/supported-models-and-providers\#deepseek) | Model | Parallel Tool Call Support | Tool Choice Support | | --- | --- | --- | | deepseek-chat
ID: `deepseek:deepseek-chat` Copy | `false` | `true` | * * * ## [Deprecated Models](https://langbase.com/docs/supported-models-and-providers\#deprecated-models) The following models are deprecated and no longer available for use in pipes. It is recommended to switch to a supported model. | Model | Provider | Owner | Deprecated on | Reason | | --- | --- | --- | --- | --- | | llama-3.1-sonar-large-128k-chat | Perplexity | Meta | 23-01-2025 | Discontinued by Perplexity | | llama-3.1-sonar-small-128k-chat | Perplexity | Meta | 23-01-2025 | Discontinued by Perplexity | | gemma-7b-it | Groq | Google | 01-01-2025 | Discontinued by Groq | | qwen2-72b | Fireworks AI | QwenLM | 13-08-2024 | Discontinued by Fireworks AI | | Llama-3-70b-chat-hf | Together AI | Meta | 15-09-2024 | Discontinued by Together AI | | Llama-2-7B-32K-Instruct | Together AI | Meta | 15-09-2024 | Discontinued by Together AI | | gemma-7b-it | Together AI | Meta | 15-09-2024 | Discontinued by Together AI | * * *

Comparison Table: LLM API pricing, token limits, strengths, Japanese output

Criteria

Enrichments

Find more results