> ## Documentation Index
> Fetch the complete documentation index at: https://docs.shaktistudio.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Large Language Models

The LLM (Large Language Model) playground offers a versatile space for text generation and conversational AI. Users can:

* **Chat**: Engage in interactive conversations with the model, simulating real-world dialogue.
* **Configure Output**: Adjust settings like output length, temperature and top-P to customize the responses generated by the model.
* **Experiment with Prompts**: Input different prompts and scenarios to see how the model responds, allowing for creative and practical applications.
* **Evaluate Interactions**: Analyze the generated text for coherence, creativity, and relevance to ensure it meets the required standards.

<img src="https://mintcdn.com/simplismart-2/M-JhZ2nDy3THo2rP/images/Screenshot2025-08-18at3.44.11PM.png?fit=max&auto=format&n=M-JhZ2nDy3THo2rP&q=85&s=5e52ad04e008bded318a7654a89186c5" alt="Screenshot 2025-08-18 at 3.44.11 PM.png" width="2570" height="1416" data-path="images/Screenshot2025-08-18at3.44.11PM.png" />

***

### Settings explained

`output tokens:` The maximum length of the generated response, important for controlling the verbosity of the output.

`temperature:` Controls randomness in the output; higher values produce more creative results, while lower values yield more deterministic responses.

`top-P:` Uses nucleus sampling to choose tokens from the top P cumulative probability mass, balancing creativity and coherence.

`stop sequence:` Specific sequences that, when generated, will halt further output.

`system prompt:` The initial instruction or context setting the behaviour of the model.

***

<Note>
  Access the **Llama model**  API documentation [here](/api-reference/inference/llama3.1-8B) for endpoints, parameters, and code examples.
</Note>
