Supported models
A complete list of models supported by RAGFlow, which will continue to expand.
| Provider | LLM | Image2Text | Speech2text | TTS | Embedding | Rerank | OCR |
|---|---|---|---|---|---|---|---|
| Anthropic | ✔️ | ||||||
| Azure-OpenAI | ✔️ | ✔️ | ✔️ | ✔️ | |||
| BaiChuan | ✔️ | ✔️ | |||||
| BaiduYiyan | ✔️ | ✔️ | ✔️ | ✔️ | |||
| Bedrock | ✔️ | ✔️ | |||||
| Cohere | ✔️ | ✔️ | ✔️ | ✔️ | |||
| DeepSeek | ✔️ | ||||||
| Fish Audio | ✔️ | ||||||
| Gemini | ✔️ | ✔️ | ✔️ | ||||
| Google Cloud | ✔️ | ||||||
| GPUStack | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | ||
| Groq | ✔️ | ||||||
| HuggingFace | ✔️ | ✔️ | |||||
| Jina | ✔️ | ✔️ | |||||
| LocalAI | ✔️ | ✔️ | ✔️ | ||||
| LongCat | ✔️ | ||||||
| LM-Studio | ✔️ | ✔️ | ✔️ | ||||
| MiniMax | ✔️ | ||||||
| MinerU | ✔️ | ||||||
| Mistral | ✔️ | ✔️ | |||||
| ModelScope | ✔️ | ||||||
| Moonshot | ✔️ | ✔️ | |||||
| NovitaAI | ✔️ | ✔️ | |||||
| NVIDIA | ✔️ | ✔️ | ✔️ | ✔️ | |||
| Ollama | ✔️ | ✔️ | ✔️ | ||||
| OpenAI | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | ||
| OpenAI-API-Compatible | ✔️ | ✔️ | ✔️ | ✔️ | |||
| OpenRouter | ✔️ | ✔️ | |||||
| Replicate | ✔️ | ✔️ | |||||
| PPIO | ✔️ | ||||||
| SILICONFLOW | ✔️ | ✔️ | ✔️ | ✔️ | |||
| StepFun | ✔️ | ||||||
| Tencent Hunyuan | ✔️ | ||||||
| Tencent Cloud | ✔️ | ||||||
| TogetherAI | ✔️ | ✔️ | ✔️ | ✔️ | |||
| TokenPony | ✔️ | ||||||
| Tongyi-Qianwen | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | |
| Upstage | ✔️ | ✔️ | |||||
| VLLM | ✔️ | ✔️ | ✔️ | ✔️ | |||
| VolcEngine | ✔️ | ||||||
| Voyage AI | ✔️ | ✔️ | ✔️ | ||||
| Xinference | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | |
| XunFei Spark | ✔️ | ✔️ | |||||
| xAI | ✔️ | ✔️ | |||||
| ZHIPU-AI | ✔️ | ✔️ | ✔️ | ||||
| DeepInfra | ✔️ | ✔️ | ✔️ | ✔️ | |||
| 302.AI | ✔️ | ✔️ | ✔️ | ✔️ | |||
| CometAPI | ✔️ | ✔️ | |||||
| DeerAPI | ✔️ | ✔️ | ✔️ | ✔️ | |||
| Jiekou.AI | ✔️ | ✔️ | ✔️ |
IMPORTANT
If your model is not listed here but has APIs compatible with those of OpenAI, click OpenAI-API-Compatible on the Model providers page to configure your model.
Example: AI Badgr (OpenAI-compatible)
You can use AI Badgr with RAGFlow via the existing OpenAI-API-Compatible provider.
To configure AI Badgr:
- Provider:
OpenAI-API-Compatible - Base URL:
https://aibadgr.com/api/v1 - API Key: your AI Badgr API key (from the AI Badgr dashboard)
- Model: any AI Badgr chat or embedding model ID, as exposed by AI Badgr's OpenAI-compatible APIs
AI Badgr implements OpenAI-compatible endpoints for /v1/chat/completions, /v1/embeddings, and /v1/models, so no additional code changes in RAGFlow are required.
note
The list of supported models is extracted from this source and may not be the most current. For the latest supported model list, please refer to the Python file.