Skip to main content

Model providers

A complete list of model providers supported by RAGFlow, which will continue to expand.

ProviderURL
Anthropichttps://www.anthropic.com
Astraflowhttps://astraflow.ucloud-global.com/en-us
Astraflow-CNhttps://astraflow.ucloud.cn/
Avianhttps://www.avian.io
Azure-OpenAIhttps://azure.microsoft.com/en-us/products/ai-services/openai-service
BaiChuanhttps://www.baichuan-ai.com
BaiduYiyanhttps://yiyan.baidu.com
Bedrockhttps://aws.amazon.com/bedrock/
Coherehttps://cohere.com
DeepSeekhttps://www.deepseek.com
Fish Audiohttps://fish.audio
FuturMixhttps://futurmix.ai
Geminihttps://gemini.google.com
Google Cloudhttps://cloud.google.com
GPUStackhttps://gpustack.ai
Groqhttps://groq.com
HuggingFacehttps://huggingface.co
Jinahttps://jina.ai
LocalAIhttps://localai.io
LongCathttps://longcat.chat
LM-Studiohttps://lmstudio.ai
MiniMaxhttps://www.minimaxi.com
MinerUhttps://mineru.net/
Mistralhttps://mistral.ai
ModelScopehttps://www.modelscope.cn
Moonshothttps://www.moonshot.cn
NovitaAIhttps://novita.ai
NVIDIAhttps://www.nvidia.com
Ollamahttps://ollama.com
OpenAIhttps://openai.com
OpenAI-API-CompatibleN/A
OpenRouterhttps://openrouter.ai
Perplexityhttps://www.perplexity.ai
Replicatehttps://replicate.com
PPIOhttps://ppio.com
SILICONFLOWhttps://siliconflow.cn
StepFunhttps://www.stepfun.com
Tencent Hunyuanhttps://hunyuan.tencent.com
Tencent Cloudhttps://cloud.tencent.com
TogetherAIhttps://www.together.ai
TokenPonyhttps://tokenpony.cn
Tongyi-Qianwenhttps://tongyi.aliyun.com
Upstagehttps://www.upstage.ai
VLLMhttps://vllm.ai
VolcEnginehttps://www.volcengine.com
Voyage AIhttps://www.voyageai.com
Xinferencehttps://github.com/xorbitsai/inference
XunFei Sparkhttps://xinghuo.xfyun.cn
xAIhttps://x.ai
ZHIPU-AIhttps://www.zhipuai.cn
DeepInfrahttps://deepinfra.com
302.AIhttps://302.ai
CometAPIhttps://cometapi.com
DeerAPIhttps://deerapi.com
Jiekou.AIhttps://jiekou.ai
IMPORTANT

If your model is not listed here but has APIs compatible with those of OpenAI, click OpenAI-API-Compatible on the Model providers page to configure your model.

Example: AI Badgr (OpenAI-compatible)

You can use AI Badgr with RAGFlow via the existing OpenAI-API-Compatible provider.

To configure AI Badgr:

  • Provider: OpenAI-API-Compatible
  • Base URL: https://aibadgr.com/api/v1
  • API Key: your AI Badgr API key (from the AI Badgr dashboard)
  • Model: any AI Badgr chat or embedding model ID, as exposed by AI Badgr's OpenAI-compatible APIs

AI Badgr implements OpenAI-compatible endpoints for /v1/chat/completions, /v1/embeddings, and /v1/models, so no additional code changes in RAGFlow are required.

note

The list of supported models is extracted from this source and may not be the most current. For the latest supported model list, please refer to the Python file.