While creating a customized agent, you will need to select an LLM (Large Language Model), which will take care of a given task, such as retrieving information from the web or a data source to generate an answer relevant to the user’s query, analyzing data, summarizing content, creating content and much more.
...
| Table of Contents | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Available LLMs
Below is the list of available LLMs with their main characteristics :
Model name | Provider | Context window (Max number of tokens) |
|---|---|---|
GPT 4o (EU) | Azure OpenAI | 128K |
GPT 4o (East US) | Azure OpenAI | 128k |
GPT 4o (South US) | Azure OpenAI | 128k |
GPT 4o mini (EU) | Azure OpenAI | 128k |
GPT 4o mini (East US) | Azure OpenAI | 128k |
GPT 4o mini (South US) | Azure OpenAI | 128k |
Mistral Mini | Mistral | 128k |
Mistral Large | Mistral | 128k |
Mistral Small | Mistral | 128k |
Groq - Llama 3.2 11B | Groq | 128k |
Groq - Llama 3.2 90B | Groq | 128k |
Claude Haiku | Anthropic | 200k |
Claude Sonnet | Anthropic | 200k |
Gemini Flash | 1 mil | |
Gemini Pro | 2 mil |
Selection criteria
| Note |
|---|
need more info from comparison tests (Alban will do them when he has time) |
...
Below are our insights on the best-performing models. (might be outdated)
Overall,
GPT 4o is the best-performing model.
GPT 4o mini has good performance and is very fast and cheap.
Mistral Large is slightly worse than GPT 4o but slightly cheaper.
The Groq models are ideal when the text to generate is long.