Fal AI | liteLLM (original) (raw)

Fal AI provides fast, scalable access to state-of-the-art image generation models including FLUX, Stable Diffusion, Imagen, and more.

Overview​

Setup​

API Key​

import os

# Set your Fal AI API key
os.environ["FAL_AI_API_KEY"] = "your-fal-api-key"

Get your API key from fal.ai.

Supported Models​

Image Generation​

Usage - LiteLLM Python SDK​

• Basic Usage
• Imagen 4
• Recraft v3
• Async Usage
• Advanced Parameters

Basic Image Generation

import litellm
import os

# Set your API key
os.environ["FAL_AI_API_KEY"] = "your-fal-api-key"

# Generate an image
response = litellm.image_generation(
    model="fal_ai/fal-ai/flux-pro/v1.1-ultra",
    prompt="A serene mountain landscape at sunset with vibrant colors"
)

print(response.data[0].url)

Usage - LiteLLM Proxy Server​

1. Configure your config.yaml​

Fal AI Image Generation Configuration

model_list:
  - model_name: flux-ultra
    litellm_params:
      model: fal_ai/fal-ai/flux-pro/v1.1-ultra
      api_key: os.environ/FAL_AI_API_KEY
    model_info:
      mode: image_generation
  
  - model_name: imagen4
    litellm_params:
      model: fal_ai/fal-ai/imagen4/preview
      api_key: os.environ/FAL_AI_API_KEY
    model_info:
      mode: image_generation
  
  - model_name: stable-diffusion
    litellm_params:
      model: fal_ai/fal-ai/stable-diffusion-v35-medium
      api_key: os.environ/FAL_AI_API_KEY
    model_info:
      mode: image_generation

general_settings:
  master_key: sk-1234

2. Start LiteLLM Proxy Server​

Start Proxy Server

litellm --config /path/to/config.yaml

# RUNNING on http://0.0.0.0:4000

3. Make requests​

• OpenAI SDK
• LiteLLM SDK
• cURL

Generate via Proxy - OpenAI SDK

from openai import OpenAI

client = OpenAI(
    base_url="http://localhost:4000",
    api_key="sk-1234"
)

response = client.images.generate(
    model="flux-ultra",
    prompt="A beautiful sunset over the ocean",
    n=1,
    size="1024x1024"
)

print(response.data[0].url)

Using Model-Specific Parameters​

LiteLLM forwards any additional parameters directly to the Fal AI API. You can pass model-specific parameters in your request and they will be sent to Fal AI.

Pass Model-Specific Parameters

import litellm

# Any parameters beyond the standard ones are forwarded to Fal AI
response = litellm.image_generation(
    model="fal_ai/fal-ai/flux-pro/v1.1-ultra",
    prompt="A beautiful sunset",
    # Model-specific Fal AI parameters
    aspect_ratio="16:9",
    safety_tolerance="2",
    enhance_prompt=True,
    seed=42
)

For the complete list of parameters supported by each model, see:

• FLUX Pro v1.1-ultra Parameters ↗
• Imagen 4 Parameters ↗
• Recraft v3 Parameters ↗
• Stable Diffusion v3.5 Parameters ↗
• Bria 3.2 Parameters ↗

Supported Parameters​

Standard OpenAI-compatible parameters that work across all models:

Getting Started​

1. Sign up at fal.ai
2. Get your API key from your account settings
3. Set FAL_AI_API_KEY environment variable
4. Choose a model from the Fal AI model gallery
5. Start generating images with LiteLLM

Additional Resources​

• Fal AI Documentation
• Model Gallery
• API Reference
• Pricing