Generators (original) (raw)

Generator Description Streaming Support
AmazonBedrockChatGenerator Enables chat completion using models through Amazon Bedrock service.
AmazonBedrockGenerator Enables text generation using models through Amazon Bedrock service.
AnthropicChatGenerator This component enables chat completions using Anthropic large language models (LLMs).
AnthropicVertexChatGenerator This component enables chat completions using AnthropicVertex API.
AnthropicGenerator This component enables text completions using Anthropic large language models (LLMs).
AzureOpenAIChatGenerator Enables chat completion using OpenAI’s LLMs through Azure services.
AzureOpenAIGenerator Enables text generation using OpenAI’s LLMs through Azure services.
CohereChatGenerator Enables chat completion using Cohere's LLMs.
CohereGenerator Queries the LLM using Cohere API.
GoogleAIGeminiChatGenerator Enables chat completion using Google Gemini models.
GoogleAIGeminiGenerator Enables text generation using Google Gemini models.
HuggingFaceAPIChatGenerator Enables chat completion using various Hugging Face APIs.
HuggingFaceAPIGenerator Enables text generation using various Hugging Face APIs.
HuggingFaceLocalChatGenerator Provides an interface for chat completion using a Hugging Face model that runs locally.
HuggingFaceLocalGenerator Provides an interface to generate text using a Hugging Face model that runs locally.
LlamaCppChatGenerator Enables chat completion using an LLM running on Llama.cpp.
LlamaCppGenerator Generate text using an LLM running with Llama.cpp.
MistralChatGenerator Enables chat completion using Mistral’s text generation models.
NvidiaGenerator Provides an interface for generating text using LLMs self-hosted with NVIDIA NIM or models hosted on the NVIDIA API catalog.
OllamaChatGenerator Enables chat completion using an LLM running on Ollama.
OllamaGenerator Provides an interface to generate text using an LLM running on Ollama.
OpenAIChatGenerator Enables chat completion using OpenAI’s large language models (LLMs).
OpenAIGenerator Enables text generation using OpenAI's large language models (LLMs).
SagemakerGenerator Enables text generation using LLMs deployed on Amazon Sagemaker.
STACKITChatGenerator Enables chat completions using the STACKIT API.
VertexAICodeGenerator Enables code generation using Google Vertex AI generative model.
VertexAIGeminiChatGenerator Enables chat completion using Google Gemini models with GCP Vertex AI.
VertexAIGeminiGenerator Enables text generation using Google Gemini models with GCP Vertex AI.
VertexAIImageCaptioner Enables text generation using Google Vertex AI imagetext generative model.
VertexAIImageGenerator Enables image generation using Google Vertex AI generative model.
VertexAIImageQA Enables text generation (image captioning) using Google Vertex AI generative models.
VertexAITextGenerator Enables text generation using Google Vertex AI generative models.