---
url: https://docs.freetheai.org/guides/anythingllm.md
description: >-
  Use FreeTheAI as the LLM in AnythingLLM with the Generic OpenAI provider: base
  URL, key, model, context window, and max tokens.
---

# AnythingLLM

AnythingLLM uses FreeTheAI through its Generic OpenAI provider.

Category: [Chat apps](/guides/#chat-apps). Before you start, you need a FreeTheAI account, an API key, and today's [check-in](/getting-started/check-in).

## Settings

| Setting | Value |
| --- | --- |
| LLM Provider | `Generic OpenAI` |
| Base URL | `https://api.freetheai.org/v1` |
| API Key | Your FreeTheAI key (`ftai_...`, 53 characters) |
| Selected Model | `fta/zai/glm-5.3` |
| Model context window | `128000` |
| Max Tokens | `8192` |

## Steps

### Open the LLM settings

Open Settings, then AI Providers, then LLM.

### Choose Generic OpenAI

Set the provider to Generic OpenAI and fill in the values above.

### Save

Press Save changes. Workspaces now answer with the FreeTheAI model.

## Tips

* Keep embeddings on AnythingLLM's built-in embedder. FreeTheAI serves chat models only.

## Common questions

### Which provider do I pick in AnythingLLM?

Generic OpenAI. The plain OpenAI provider always calls api.openai.com.

## More help

* [Every API error and its fix](/errors)
* [Limits and the daily reset](/concepts/limits)
* [AnythingLLM website](https://anythingllm.com) and [source code](https://github.com/Mintplex-Labs/anything-llm)

::: info How this guide was checked
Checked against AnythingLLM's source (Generic OpenAI options) on 2026-09-29.
:::