GenerationConfiguration - Amazon Bedrock (original) (raw)

Contains configurations for response generation based on the knowledge base query results.

This data type is used in the following API operations:

• RetrieveAndGenerate request

Contents

additionalModelRequestFields

Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows users to provide custom model parameters specific to the language model being used.

Type: String to JSON value map

Key Length Constraints: Minimum length of 1. Maximum length of 100.

Required: No

guardrailConfiguration

The configuration details for the guardrail.

Type: GuardrailConfiguration object

Required: No

inferenceConfig

Configuration settings for inference when using RetrieveAndGenerate to generate responses while using a knowledge base as a source.

Type: InferenceConfig object

Required: No

performanceConfig

The latency configuration for the model.

Type: PerformanceConfiguration object

Required: No

promptTemplate

Contains the template for the prompt that's sent to the model for response generation. Generation prompts must include the $search_results$ variable. For more information, see Use placeholder variables in the user guide.

Type: PromptTemplate object

Required: No

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following:

• AWS SDK for C++
• AWS SDK for Java V2
• AWS SDK for Ruby V3

GeneratedResponsePart

GuardrailAssessment

Did this page help you? - Yes

Thanks for letting us know we're doing a good job!

If you've got a moment, please tell us what we did right so we can do more of it.

Did this page help you? - No

Thanks for letting us know this page needs work. We're sorry we let you down.

If you've got a moment, please tell us how we can make the documentation better.