> For the complete documentation index, see [llms.txt](https://docs.aichatone.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.aichatone.com/product-guides/custom-chatbots/anyscale.md).

# Anyscale

[Anyscale](https://www.anyscale.com/endpoints) provides fast, cost-efficient, serverless APIs for LLM serving and fine tuning

## Preparation[​](https://doc.chathub.gg/custom-chatbots/openai#preparation) <a href="#preparation" id="preparation"></a>

Sign up to Anyscale and generate an API key from <https://app.endpoints.anyscale.com/console/credentials>.

## Configuration <a href="#configuration" id="configuration"></a>

<figure><img src="/files/Zg6OmdWoIeqPKVVzT8qd" alt=""><figcaption></figcaption></figure>

We're using the `mistralai/Mixtral-8x7B-Instruct-v0.1` model in this example.

You can find all the available models from Anyscale website: <https://docs.endpoints.anyscale.com/category/supported-models>