wllama.cpp tool calling demo (original) (raw)

Tool Calling Demo (OAI-compat API)

Step 1: Load model

Downloads ~530MB from Hugging Face

Or pick a local GGUF file:

Step 2: Available tools

Step 3: Run a prompt

Demo prompts:

Generating…