> ## Documentation Index
> Fetch the complete documentation index at: https://phidatainc-redirect-agent-platform-overview.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Llama Cpp

> Run your chat model using Llama CPP. For the examples below make sure to download `ggml-org/gpt-oss-20b-GGUF`. Please also make sure that the model is reachable at `http://127.0.0.

| Example                                                                     | Description                                                 |
| --------------------------------------------------------------------------- | ----------------------------------------------------------- |
| [Llama Cpp Basic](/examples/models/llama-cpp/basic)                         | Cookbook example for `llama_cpp/basic.py`.                  |
| [Retry](/examples/models/llama-cpp/retry)                                   | Example demonstrating how to set up retries with llama.cpp. |
| [Llama Cpp Structured Output](/examples/models/llama-cpp/structured-output) | Cookbook example for `llama_cpp/structured_output.py`.      |
| [Tool Use](/examples/models/llama-cpp/tool-use)                             | Llama Cpp model example.                                    |