Installation — vLLM (original) (raw)

Installation#

vLLM supports the following hardware platforms:

• GPU
  • NVIDIA CUDA
  • AMD ROCm
  • Intel XPU
• CPU
  • Intel/AMD x86
  • ARM AArch64
  • Apple silicon
  • IBM Z (S390X)
• Other AI accelerators
  • Google TPU
  • Intel Gaudi
  • AWS Neuron