Install OpenVINO™ GenAI — OpenVINO™ documentation (original) (raw)

OpenVINO GenAI is a tool, simplifying generative AI model inference. It is based on the OpenVINO Runtime, hiding the complexity of the generation process and minimizing the amount of code required. You provide a model and the input context directly to the tool, while it performs tokenization of the input text, executes the generation loop on the selected device, and returns the generated content. For a quickstart guide, refer to theGenAI API Guide.

To see OpenVINO GenAI in action, check these Jupyter notebooks:LLM-powered ChatbotandLLM Instruction-following pipeline.

OpenVINO GenAI is available for installation via PyPI and Archive distributions. A detailed guideon how to build OpenVINO GenAI is available in the OpenVINO GenAI repository.

PyPI Installation#

To install the GenAI package via PyPI, follow the standard installation steps, but use the openvino-genai package instead of openvino:

python -m pip install openvino-genai

Archive Installation#

The OpenVINO GenAI archive package includes the OpenVINO™ Runtime, as well as Tokenizers. It installs the same way as the standard OpenVINO Runtime, so follow its installation steps, just use the OpenVINO GenAI package instead:

Linux#

x86_64

Ubuntu 24.04

curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.4/linux/openvino_genai_ubuntu24_2025.4.0.0_x86_64.tar.gz --output openvino_genai_2025.4.0.0.tgz tar -xf openvino_genai_2025.4.0.0.tgz

Ubuntu 22.04

curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.4/linux/openvino_genai_ubuntu22_2025.4.0.0_x86_64.tar.gz --output openvino_genai_2025.4.0.0.tgz tar -xf openvino_genai_2025.4.0.0.tgz

Ubuntu 20.04

curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.4/linux/openvino_genai_ubuntu20_2025.4.0.0_x86_64.tar.gz --output openvino_genai_2025.4.0.0.tgz tar -xf openvino_genai_2025.4.0.0.tgz

ARM 64-bit

curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.4/linux/openvino_genai_ubuntu20_2025.4.0.0_arm64.tar.gz -O openvino_genai_2025.4.0.0.tgz tar -xf openvino_genai_2025.4.0.0.tgz

Windows#

cd /Downloads curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.4/windows/openvino_genai_windows_2025.4.0.0_x86_64.zip --output openvino_genai_2025.4.0.0.zip

macOS#

x86, 64-bit

curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.4/macos/openvino_genai_macos_12_6_2025.4.0.0_x86_64.tar.gz --output openvino_genai_2025.4.0.0.tgz tar -xf openvino_genai_2025.4.0.0.tgz

ARM, 64-bit

curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.4/macos/openvino_genai_macos_12_6_2025.4.0.0_arm64.tar.gz --output openvino_genai_2025.4.0.0.tgz tar -xf openvino_genai_2025.4.0.0.tgz

Here are the full guides:Linux,Windows, andmacOS.

npm Installation#

To install the GenAI package via npm, follow the standard installation steps, but use the openvino-genai-node package instead of openvino-node:

npm install openvino-genai-node