Using Diffusers with other modalities (original) (raw)
Diffusers documentation
Using Diffusers with other modalities
Get started
🧨 Diffusers Quicktour Effective and efficient diffusion Installation
Tutorials
Overview Understanding pipelines, models and schedulers AutoPipeline Train a diffusion model
Load pipelines and adapters
Load pipelines Load community pipelines and components Load schedulers and models Model files and layouts Push files to the Hub
Adapters
Generative tasks
Unconditional image generation Text-to-image Image-to-image Inpainting Video generation Depth-to-image
Inference techniques
Overview Create a server Distributed inference Scheduler features Pipeline callbacks Reproducible pipelines Controlling image quality Prompt techniques
Advanced inference
Hybrid Inference
Overview VAE Decode VAE Encode API Reference
Specific pipeline examples
ConsisID Stable Diffusion XL SDXL Turbo Kandinsky OmniGen PAG Latent Consistency Model Shap-E DiffEdit Trajectory Consistency Distillation-LoRA Stable Video Diffusion Marigold Computer Vision
Training
Overview Create a dataset for training Adapt a model to a new task
Models
Methods
Quantization Methods
Getting Started bitsandbytes gguf torchao quanto
Accelerate inference and reduce memory
Accelerate inference Caching Reduce memory usage Pruna xFormers Token merging DeepCache TGATE xDiT ParaAttention
Optimized model formats
JAX/Flax ONNX OpenVINO Core ML
Optimized hardware
Metal Performance Shaders (MPS) Intel Gaudi AWS Neuron
Conceptual Guides
Philosophy Controlled generation How to contribute? Diffusers' Ethical Guidelines Evaluating Diffusion Models
Community Projects
API
Main Classes
Loaders
Models
Pipelines
Schedulers
Internal classes
You are viewing main version, which requires
. If you'd like regular pip install, checkout the latest stable version (v0.33.1).
Join the Hugging Face community
and get access to the augmented documentation experience
Collaborate on models, datasets and Spaces
Faster examples with accelerated inference
Switch between documentation themes
to get started
Using Diffusers with other modalities
Diffusers is in the process of expanding to modalities other than images.
| Example type | Colab | Pipeline |
|---|---|---|
| Molecule conformation generation |  |
❌ |
More coming soon!