> For the complete documentation index, see [llms.txt](https://docs.float16.cloud/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.float16.cloud/getting-started/one-click-deploy/features/openai-compatible.md).

# OpenAI Compatible

### Available Endpoint

`/{dedicate}/v1/chat/completions`

`/{dedicate}/v1/completions`

[Read the full details about request parameter](/getting-started/one-click-deploy/endpoint-specification.md)s

### Authentication

The endpoint provides an API key to access it.

### Rate limit

The endpoint does not have a rate limit, but it does have a limited batch size (similar to concurrency). The batch size is determined by GPU VRAM.

### Chat template

The endpoint has an option to automatically apply a chat template or use the prompt from the request. The chat template is determined by the `chat_template` attribute in the `tokenizer_config.json` file."