docker model (original) (raw)

Description	Docker Model Runner

Use Docker Model Runner to run and interact with AI models directly from the command line. For more information, see thedocumentation

Command	Description
docker model bench	Benchmark a model's performance at different concurrency levels
docker model inspect	Display detailed information on one model
docker model install-runner	Install Docker Model Runner (Docker Engine only)
docker model list	List the models pulled to your local environment
docker model logs	Fetch the Docker Model Runner logs
docker model package	Package a GGUF file, Safetensors directory, or existing model into a Docker model OCI artifact.
docker model pull	Pull a model from Docker Hub or HuggingFace to your local environment
docker model purge	Remove all models
docker model push	Push a model to Docker Hub
docker model reinstall-runner	Reinstall Docker Model Runner (Docker Engine only)
docker model restart-runner	Restart Docker Model Runner (Docker Engine only)
docker model rm	Remove local models downloaded from Docker Hub
docker model run	Run a model and interact with it using a submitted prompt or chat mode
docker model start-runner	Start Docker Model Runner (Docker Engine only)
docker model status	Check if the Docker Model Runner is running
docker model stop-runner	Stop Docker Model Runner (Docker Engine only)
docker model tag	Tag a model
docker model uninstall-runner	Uninstall Docker Model Runner (Docker Engine only)
docker model version	Show the Docker Model Runner version