Distributions Overview — llama-stack documentation (original) (raw)

A distribution is a pre-packaged set of Llama Stack components that can be deployed together.

This section provides an overview of the distributions available in Llama Stack.

• Using Llama Stack as a Library
  • Setup Llama Stack without a Server
• Configuring a “Stack”
  • Providers
  • Resources
  • Server Configuration
    * Authentication Configuration
    * Quota Configuration
  • Extending to handle Safety
• Available List of Distributions
  • Selection of a Distribution / Template
    * Distribution Details
    * On-Device Distributions
• Kubernetes Deployment Guide
  • Prerequisites
  • Deploying Llama Stack Server in Kubernetes
  • Verifying the Deployment
• Build your own Distribution
  • Setting your log level
  • Llama Stack Build
  • Running your Stack server
  • Listing Distributions
  • Removing a Distribution
  • Troubleshooting