Tools — llama-stack documentation (original) (raw)
Tools are functions that can be invoked by an agent to perform tasks. They are organized into tool groups and registered with specific providers. Each tool group represents a collection of related tools from a single provider. They are organized into groups so that state can be externalized: the collection operates on the same state typically. An example of this would be a “db_access” tool group that contains tools for interacting with a database. “list_tables”, “query_table”, “insert_row” could be examples of tools in this group.
Tools are treated as any other resource in llama stack like models. You can register them, have providers for them etc.
When instantiating an agent, you can provide it a list of tool groups that it has access to. Agent gets the corresponding tool definitions for the specified tool groups and passes them along to the model.
Refer to the Building AI Applications notebook for more examples on how to use tools.
Types of Tool Group providers
There are three types of providers for tool groups that are supported by Llama Stack.
- Built-in providers
- Model Context Protocol (MCP) providers
- Client provided tools
Built-in providers
Built-in providers come packaged with Llama Stack. These providers provide common functionalities like web search, code interpretation, and computational capabilities.
Web Search providers
There are three web search providers that are supported by Llama Stack.
- Brave Search
- Bing Search
- Tavily Search
Example client SDK call to register a “websearch” toolgroup that is provided by brave-search.
Register Brave Search tool group
client.toolgroups.register( toolgroup_id="builtin::websearch", provider_id="brave-search", args={"max_results": 5}, )
The tool requires an API key which can be provided either in the configuration or through the request header X-LlamaStack-Provider-Data
. The format of the header is {"<provider_name>_api_key": <your api key>}
.
NOTE: When using Tavily Search and Bing Search, the inference output will still display “Brave Search.” This is because Llama models have been trained with Brave Search as a built-in tool. Tavily and bing is just being used in lieu of Brave search.
WolframAlpha
The WolframAlpha tool provides access to computational knowledge through the WolframAlpha API.
Register WolframAlpha tool group
client.toolgroups.register( toolgroup_id="builtin::wolfram_alpha", provider_id="wolfram-alpha" )
Example usage:
result = client.tool_runtime.invoke_tool( tool_name="wolfram_alpha", args={"query": "solve x^2 + 2x + 1 = 0"} )
RAG
The RAG tool enables retrieval of context from various types of memory banks (vector, key-value, keyword, and graph).
Register Memory tool group
client.toolgroups.register( toolgroup_id="builtin::rag", provider_id="faiss", args={"max_chunks": 5, "max_tokens_in_context": 4096}, )
Features:
- Support for multiple memory bank types
- Configurable query generation
- Context retrieval with token limits
Note: By default, llama stack run.yaml defines toolgroups for web search, wolfram alpha and rag, that are provided by tavily-search, wolfram-alpha and rag providers.
Model Context Protocol (MCP) Tools
MCP tools are special tools that can interact with llama stack over model context protocol. These tools are dynamically discovered from an MCP endpoint and can be used to extend the agent’s capabilities.
Refer to https://github.com/modelcontextprotocol/servers for available MCP servers.
start your MCP server
mkdir /tmp/content touch /tmp/content/foo touch /tmp/content/bar npx -y supergateway --port 8000 --stdio 'npx -y @modelcontextprotocol/server-filesystem /tmp/content'
Then register the MCP server as a tool group,
client.toolgroups.register( toolgroup_id="mcp::filesystem", provider_id="model-context-protocol", mcp_endpoint=URL(uri="http://localhost:8000/sse"), )
MCP tools require:
- A valid MCP endpoint URL
- The endpoint must implement the Model Context Protocol
- Tools are discovered dynamically from the endpoint
Adding Custom Tools
When you want to use tools other than the built-in tools, you just need to implement a python function with a docstring. The content of the docstring will be used to describe the tool and the parameters and passed along to the generative model.
Example tool definition
def my_tool(input: int) -> int: """ Runs my awesome tool.
:param input: some int parameter
"""
return input * 2
NOTE: We employ python docstrings to describe the tool and the parameters. It is important to document the tool and the parameters so that the model can use the tool correctly. It is recommended to experiment with different docstrings to see how they affect the model’s behavior.
Once defined, simply pass the tool to the agent config. Agent
will take care of the rest (calling the model with the tool definition, executing the tool, and returning the result to the model for the next iteration).
Example agent config with client provided tools
agent = Agent(client, ..., tools=[my_tool])
Refer to llama-stack-apps for an example of how to use client provided tools.
Tool Invocation
Tools can be invoked using the invoke_tool
method:
result = client.tool_runtime.invoke_tool( tool_name="web_search", kwargs={"query": "What is the capital of France?"} )
The result contains:
content
: The tool’s outputerror_message
: Optional error message if the tool failederror_code
: Optional error code if the tool failed
Listing Available Tools
You can list all available tools or filter by tool group:
List all tools
all_tools = client.tools.list_tools()
List tools in a specific group
group_tools = client.tools.list_tools(toolgroup_id="search_tools")
Simple Example: Using an Agent with the Code-Interpreter Tool
from llama_stack_client import Agent
Instantiate the AI agent with the given configuration
agent = Agent( client, name="code-interpreter", description="A code interpreter agent for executing Python code snippets", instructions=""" You are a highly reliable, concise, and precise assistant. Always show the generated code, never generate your own code, and never anticipate results. """, model="meta-llama/Llama-3.2-3B-Instruct", tools=["builtin::code_interpreter"], max_infer_iters=5, )
Start a session
session_id = agent.create_session("tool_session")
Send a query to the AI agent for code execution
response = agent.create_turn( messages=[{"role": "user", "content": "Run this code: print(3 ** 4 - 5 * 2)"}], session_id=session_id, )
Simple Example 2: Using an Agent with the Web Search Tool
- Start by registering a Tavily API key at Tavily.
- [Optional] Provide the API key directly to the Llama Stack server
export TAVILY_SEARCH_API_KEY="your key"
--env TAVILY_SEARCH_API_KEY=${TAVILY_SEARCH_API_KEY}
- Run the following script.
from llama_stack_client.lib.agents.agent import Agent from llama_stack_client.types.agent_create_params import AgentConfig from llama_stack_client.lib.agents.event_logger import EventLogger from llama_stack_client import LlamaStackClient
client = LlamaStackClient( base_url=f"http://localhost:8321", provider_data={ "tavily_search_api_key": "your_TAVILY_SEARCH_API_KEY" }, # Set this from the client side. No need to provide it if it has already been configured on the Llama Stack server. )
agent = Agent( client, model="meta-llama/Llama-3.2-3B-Instruct", instructions=( "You are a web search assistant, must use websearch tool to look up the most current and precise information available. " ), tools=["builtin::websearch"], )
session_id = agent.create_session("websearch-session")
response = agent.create_turn( messages=[ {"role": "user", "content": "How did the USA perform in the last Olympics?"} ], session_id=session_id, ) for log in EventLogger().log(response): log.print()
Simple Example3: Using an Agent with the WolframAlpha Tool
- Start by registering for a WolframAlpha API key at WolframAlpha Developer Portal.
- Provide the API key either when starting the Llama Stack server:
--env WOLFRAM_ALPHA_API_KEY=${WOLFRAM_ALPHA_API_KEY}
or from the client side:
client = LlamaStackClient(
base_url="http://localhost:8321",
provider_data={"wolfram_alpha_api_key": wolfram_api_key},
) - Configure the tools in the Agent by setting
tools=["builtin::wolfram_alpha"]
. - Example user query:
response = agent.create_turn(
messages=[{"role": "user", "content": "Solve x^2 + 2x + 1 = 0 using WolframAlpha"}],
session_id=session_id,
)