# LLM as a service

{% hint style="danger" %}
This service is under maintenance.
{% endhint %}

## What is LLM as a service?

LLM as a Service is a large language model on-demand API service designed for users who want to utilize LLMs without deploying or managing the extensive resources they require. It's also suitable for those in the decision-making stage who wish to test models.

<figure><img src="/files/q6hOpobzhxwjyi50xQhv" alt=""><figcaption><p>LLM as a Service's Overview</p></figcaption></figure>

Our service provides instant API access, allowing users to:

1. Choose their desired LLM model
2. Obtain our API key
3. Implement the service immediately

Users can focus on developing their products without worrying about deployment complexities.

## Pricing

We charge based on the number of tokens used, with separate rates for prompt and completion tokens. Pricing varies between models.

For more detailed pricing information, please visit [this link](https://float16.cloud/product#pricing).

## Explore Use Case

<table data-view="cards"><thead><tr><th></th><th></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><strong>Q&#x26;A Bot</strong></td><td>Create your chatbot</td><td><a href="/pages/eqUbhq7l4KvY2g0O46KN">/pages/eqUbhq7l4KvY2g0O46KN</a></td></tr><tr><td><strong>Text-to-SQL</strong></td><td>Easily convert to SQL</td><td><a href="/pages/KaGTQdhZN3OghaGq9X63">/pages/KaGTQdhZN3OghaGq9X63</a></td></tr></tbody></table>


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.float16.cloud/getting-started/llm-as-a-service.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
