LLMs

Copilot LLM (Azure OpenAI)

Language Model from Azure OpenAI for Copilot experiences

Category: LLMs · Plans: Pro, Premium, Enterprise · Type: AzureOpenAILLM

Inputs#

FieldTypeRequiredDefaultWhat it does
InputTextNo{input}The message to send to the LLM. Use {input} for connected step output, or {node_id.output_name} for specific outputs.
System PromptTextNoYou are a helpful assistantSystem message to define the LLM’s role and behavior.
Deployment NameTextNo(empty)The name of the Azure OpenAI deployment to use
OpenAI API VersionTextNo(empty)The OpenAI API version to use
Azure OpenAI EndpointTextNo(empty)The endpoint for Azure OpenAI
Azure OpenAI API KeyTextNo(empty)The API key for Azure OpenAI authentication
Max TokensNumberNo4000Maximum tokens in the response
TemperatureNumberNo0.7Sampling temperature (0.0-1.0)
Include Chat HistoryYes/NoNoOffInclude conversation history in the LLM context
History Message CountNumberNo5Number of recent messages to include
History Max TokensNumberNo800Maximum tokens for chat history
Message TypesTextNoUser Messages, AI MessagesSelect which message types to include in chat history Options: User Messages, AI Messages, Tool Calls
Structured OutputYes/NoNoOffEnable structured JSON output with a defined schema
Output SchematableNo—Define output fields: name, type (string/int/float/bool/list/dict), description
ImagesTextNo—Images to be used in the input to the model.

Outputs#

OutputType
MessageAny
ModelAny
Max TokensAny
TemperatureAny
Chat History EnabledAny
Structured Output EnabledAny