Installation on Intel Silicon (original) (raw)

Stable Diffusion WebUI Support (Preview)

Stable Diffusion WebUI can now be run on hardware like Intel CPUs and GPUs (both integrated and discrete Graphics) with Intel® Distribution of OpenVINO™ toolkit. This is a preview support in active development and we actively welcome feedback and contributions from the community.

Important Notes

To achieve the best performance in WebUI on Windows, launch webui-user.bat using the following steps:

• Launch command prompt as administrator
• cd to stable-diffusion-webui directory
• run webui-user.bat

Some features are not supported at the moment with OpenVINO acceleration script:

• Hires Fix
• Other custom scripts

Instructions to run WebUI with OpenVINO:

OpenVINO support is provided through a custom script. The custom script uses PyTorch's torch.compile feature and HuggingFace Diffusers library for improved performance. Below are the instructions to get started:

• If you are familiar with the Automatic1111 workflow, use this fork from OpenVINOToolKit instead of Automatic1111 and follow the instructions. Alternatively, follow the below instructions:

Linux

Make sure Python version is 3.10+

python -m venv sd_env source sd_env/bin/activate git clone https://github.com/openvinotoolkit/stable-diffusion-webui.git cd stable-diffusion-webui

export PYTORCH_TRACING_MODE=TORCHFX export COMMANDLINE_ARGS="--skip-torch-cuda-test --precision full --no-half"

Launch the WebUI

./webui.sh

• After launching the WebUI by running ./webui.sh, Use the OpenVINO custom script by following the instructions here

Windows

• Download and install git and Python 3.10.6 (tick Add to PATH)

git clone https://github.com/openvinotoolkit/stable-diffusion-webui.git cd stable-diffusion-webui webui-user.bat

• Use the OpenVINO custom script by following the instructions here

Notes:

• The steps above will create a virtual environment and install the required packages into this environment. If you want to use your own virtual environment to run Stable Diffusion WebUI, please update VENV_DIR= lines to VENV_DIR=- in first-time-runner.bat and torch-install.ps1 files.
• PyTorch doesn't support torch.compile officially on windows yet. Launching torch-install.bat installs PyTorch and enables torch.compile for OpenVINO backend.

Enabling Public Access

To enable public access, please add "--share --listen" arguments into the COMMANLINE_ARGUMENTS variable (On Windows, you can do this by updating webui-user.bat file).

Installation Instructions

Install OpenVINO:

Install from Pypi:

OpenVINO with torch.compile support is now available in preview in the OpenVINO prerelease package. Install the latest prerelease package from using the command pip install --pre openvino

Build and install from source:

OpenVINO can also be built from source using the instructions provided here

Known Issues

• Changing the sampling method to DPM++ or Karras methods recompiles the model due to some modifications it makes to the graph. It is recommended to exclude the time for first image generation for any performance measurements
• Regular Stable Diffusion 2.1 has known issues on discrete GPUs at this time. Please use the Stable Diffusion 2.1-base version instead.