> For the complete documentation index, see [llms.txt](https://docs.float16.cloud/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.float16.cloud/getting-started/one-click-deploy/features.md).

# Features

All features are automatically enabled by default to improve overall performance.

### **OpenAI Compatible**

Supports OpenAI clients for chat and completion use cases, and Continue.dev for Co-Pilot use cases.

### **Batch size, Max input length, Number token**

Supports long contexts up to 1M context length and dynamic batching to improve utilization.

### **Quantization**

Reduces memory footprint to deploy LLMs to half the original model size.

Improves inference speed by 2 times.

### **Context caching**

Reduces redundant computation when requests have the same context.

Improves inference speed by 1.5 to 2 times on evaluation datasets and over 10 times in ideal scenarios.