AnythingLLM
AnythingLLM uses FreeTheAI through its Generic OpenAI provider.
Category: Chat apps. Before you start, you need a FreeTheAI account, an API key, and today's check-in.
Settings
| Setting | Value |
|---|---|
| LLM Provider | Generic OpenAI |
| Base URL | https://api.freetheai.org/v1 |
| API Key | Your FreeTheAI key (ftai_..., 53 characters) |
| Selected Model | fta/zai/glm-5.3 |
| Model context window | 128000 |
| Max Tokens | 8192 |
Steps
Open the LLM settings
Open Settings, then AI Providers, then LLM.
Choose Generic OpenAI
Set the provider to Generic OpenAI and fill in the values above.
Save
Press Save changes. Workspaces now answer with the FreeTheAI model.
Tips
- Keep embeddings on AnythingLLM's built-in embedder. FreeTheAI serves chat models only.
Common questions
Which provider do I pick in AnythingLLM?
Generic OpenAI. The plain OpenAI provider always calls api.openai.com.
More help
How this guide was checked
Checked against AnythingLLM's source (Generic OpenAI options) on 2026-09-29.