Client Secrets
Create client secret
client.Realtime.ClientSecrets.New(ctx, body) (*ClientSecretNewResponse, error)
post /realtime/client_secrets
Create client secret
Parameters
-
body ClientSecretNewParams-
ExpiresAfter param.Field[ClientSecretNewParamsExpiresAfter]Configuration for the client secret expiration. Expiration refers to the time after which a client secret will no longer be valid for creating sessions. The session itself may continue after that time once started. A secret can be used to create multiple sessions until it expires.
-
Anchor stringThe anchor point for the client secret expiration, meaning that
secondswill be added to thecreated_attime of the client secret to produce an expiration timestamp. Onlycreated_atis currently supported.const ClientSecretNewParamsExpiresAfterAnchorCreatedAt ClientSecretNewParamsExpiresAfterAnchor = "created_at"
-
Seconds int64The number of seconds from the anchor point to the expiration. Select a value between
10and7200(2 hours). This default to 600 seconds (10 minutes) if not specified.
-
-
Session param.Field[ClientSecretNewParamsSessionUnion]Session configuration to use for the client secret. Choose either a realtime session or a transcription session.
-
type RealtimeSessionCreateRequest struct{…}Realtime session object configuration.
-
Type RealtimeThe type of session to create. Always
realtimefor the Realtime API.const RealtimeRealtime Realtime = "realtime"
-
Audio RealtimeAudioConfigConfiguration for input and output audio.
-
Input RealtimeAudioConfigInput-
Format RealtimeAudioFormatsUnionThe format of the input audio.
-
type RealtimeAudioFormatsAudioPCM struct{…}The PCM audio format. Only a 24kHz sample rate is supported.
-
Rate int64The sample rate of the audio. Always
24000.const RealtimeAudioFormatsAudioPCMRate24000 RealtimeAudioFormatsAudioPCMRate = 24000
-
Type stringThe audio format. Always
audio/pcm.const RealtimeAudioFormatsAudioPCMTypeAudioPCM RealtimeAudioFormatsAudioPCMType = "audio/pcm"
-
-
type RealtimeAudioFormatsAudioPCMU struct{…}The G.711 μ-law format.
-
Type stringThe audio format. Always
audio/pcmu.const RealtimeAudioFormatsAudioPCMUTypeAudioPCMU RealtimeAudioFormatsAudioPCMUType = "audio/pcmu"
-
-
type RealtimeAudioFormatsAudioPCMA struct{…}The G.711 A-law format.
-
Type stringThe audio format. Always
audio/pcma.const RealtimeAudioFormatsAudioPCMATypeAudioPCMA RealtimeAudioFormatsAudioPCMAType = "audio/pcma"
-
-
-
NoiseReduction RealtimeAudioConfigInputNoiseReductionConfiguration for input audio noise reduction. This can be set to
nullto turn off. Noise reduction filters audio added to the input audio buffer before it is sent to VAD and the model. Filtering the audio can improve VAD and turn detection accuracy (reducing false positives) and model performance by improving perception of the input audio.-
Type NoiseReductionTypeType of noise reduction.
near_fieldis for close-talking microphones such as headphones,far_fieldis for far-field microphones such as laptop or conference room microphones.-
const NoiseReductionTypeNearField NoiseReductionType = "near_field" -
const NoiseReductionTypeFarField NoiseReductionType = "far_field"
-
-
-
Transcription AudioTranscriptionConfiguration for input audio transcription, defaults to off and can be set to
nullto turn off once on. Input audio transcription is not native to the model, since the model consumes audio directly. Transcription runs asynchronously through the /audio/transcriptions endpoint and should be treated as guidance of input audio content rather than precisely what the model heard. The client can optionally set the language and prompt for transcription, these offer additional guidance to the transcription service.-
Delay AudioTranscriptionDelayControls how long the model waits before emitting transcription text. Higher values can improve transcription accuracy at the cost of latency. Only supported with
gpt-realtime-whisperin GA Realtime sessions.-
const AudioTranscriptionDelayMinimal AudioTranscriptionDelay = "minimal" -
const AudioTranscriptionDelayLow AudioTranscriptionDelay = "low" -
const AudioTranscriptionDelayMedium AudioTranscriptionDelay = "medium" -
const AudioTranscriptionDelayHigh AudioTranscriptionDelay = "high" -
const AudioTranscriptionDelayXhigh AudioTranscriptionDelay = "xhigh"
-
-
Language stringThe language of the input audio. Supplying the input language in ISO-639-1 (e.g.
en) format will improve accuracy and latency. -
Model AudioTranscriptionModelThe model to use for transcription. Current options are
whisper-1,gpt-4o-mini-transcribe,gpt-4o-mini-transcribe-2025-12-15,gpt-4o-transcribe,gpt-4o-transcribe-diarize, andgpt-realtime-whisper. Usegpt-4o-transcribe-diarizewhen you need diarization with speaker labels.-
string -
type AudioTranscriptionModel stringThe model to use for transcription. Current options are
whisper-1,gpt-4o-mini-transcribe,gpt-4o-mini-transcribe-2025-12-15,gpt-4o-transcribe,gpt-4o-transcribe-diarize, andgpt-realtime-whisper. Usegpt-4o-transcribe-diarizewhen you need diarization with speaker labels.-
const AudioTranscriptionModelWhisper1 AudioTranscriptionModel = "whisper-1" -
const AudioTranscriptionModelGPT4oMiniTranscribe AudioTranscriptionModel = "gpt-4o-mini-transcribe" -
const AudioTranscriptionModelGPT4oMiniTranscribe2025_12_15 AudioTranscriptionModel = "gpt-4o-mini-transcribe-2025-12-15" -
const AudioTranscriptionModelGPT4oTranscribe AudioTranscriptionModel = "gpt-4o-transcribe" -
const AudioTranscriptionModelGPT4oTranscribeDiarize AudioTranscriptionModel = "gpt-4o-transcribe-diarize" -
const AudioTranscriptionModelGPTRealtimeWhisper AudioTranscriptionModel = "gpt-realtime-whisper"
-
-
-
Prompt stringAn optional text to guide the model's style or continue a previous audio segment. For
whisper-1, the prompt is a list of keywords. Forgpt-4o-transcribemodels (excludinggpt-4o-transcribe-diarize), the prompt is a free text string, for example "expect words related to technology". Prompt is not supported withgpt-realtime-whisperin GA Realtime sessions.
-
-
TurnDetection RealtimeAudioInputTurnDetectionUnionConfiguration for turn detection, ether Server VAD or Semantic VAD. This can be set to
nullto turn off, in which case the client must manually trigger model response.Server VAD means that the model will detect the start and end of speech based on audio volume and respond at the end of user speech.
Semantic VAD is more advanced and uses a turn detection model (in conjunction with VAD) to semantically estimate whether the user has finished speaking, then dynamically sets a timeout based on this probability. For example, if user audio trails off with "uhhm", the model will score a low probability of turn end and wait longer for the user to continue speaking. This can be useful for more natural conversations, but may have a higher latency.
For
gpt-realtime-whispertranscription sessions, turn detection must be set tonull; VAD is not supported.-
RealtimeAudioInputTurnDetectionServerVad-
Type ServerVadType of turn detection,
server_vadto turn on simple Server VAD.const ServerVadServerVad ServerVad = "server_vad"
-
CreateResponse boolWhether or not to automatically generate a response when a VAD stop event occurs. If
interrupt_responseis set tofalsethis may fail to create a response if the model is already responding.If both
create_responseandinterrupt_responseare set tofalse, the model will never respond automatically but VAD events will still be emitted. -
IdleTimeoutMs int64Optional timeout after which a model response will be triggered automatically. This is useful for situations in which a long pause from the user is unexpected, such as a phone call. The model will effectively prompt the user to continue the conversation based on the current context.
The timeout value will be applied after the last model response's audio has finished playing, i.e. it's set to the
response.donetime plus audio playback duration.An
input_audio_buffer.timeout_triggeredevent (plus events associated with the Response) will be emitted when the timeout is reached. Idle timeout is currently only supported forserver_vadmode. -
InterruptResponse boolWhether or not to automatically interrupt (cancel) any ongoing response with output to the default conversation (i.e.
conversationofauto) when a VAD start event occurs. Iftruethen the response will be cancelled, otherwise it will continue until complete.If both
create_responseandinterrupt_responseare set tofalse, the model will never respond automatically but VAD events will still be emitted. -
PrefixPaddingMs int64Used only for
server_vadmode. Amount of audio to include before the VAD detected speech (in milliseconds). Defaults to 300ms. -
SilenceDurationMs int64Used only for
server_vadmode. Duration of silence to detect speech stop (in milliseconds). Defaults to 500ms. With shorter values the model will respond more quickly, but may jump in on short pauses from the user. -
Threshold float64Used only for
server_vadmode. Activation threshold for VAD (0.0 to 1.0), this defaults to 0.5. A higher threshold will require louder audio to activate the model, and thus might perform better in noisy environments.
-
-
RealtimeAudioInputTurnDetectionSemanticVad-
Type SemanticVadType of turn detection,
semantic_vadto turn on Semantic VAD.const SemanticVadSemanticVad SemanticVad = "semantic_vad"
-
CreateResponse boolWhether or not to automatically generate a response when a VAD stop event occurs.
-
Eagerness stringUsed only for
semantic_vadmode. The eagerness of the model to respond.lowwill wait longer for the user to continue speaking,highwill respond more quickly.autois the default and is equivalent tomedium.low,medium, andhighhave max timeouts of 8s, 4s, and 2s respectively.-
const RealtimeAudioInputTurnDetectionSemanticVadEagernessLow RealtimeAudioInputTurnDetectionSemanticVadEagerness = "low" -
const RealtimeAudioInputTurnDetectionSemanticVadEagernessMedium RealtimeAudioInputTurnDetectionSemanticVadEagerness = "medium" -
const RealtimeAudioInputTurnDetectionSemanticVadEagernessHigh RealtimeAudioInputTurnDetectionSemanticVadEagerness = "high" -
const RealtimeAudioInputTurnDetectionSemanticVadEagernessAuto RealtimeAudioInputTurnDetectionSemanticVadEagerness = "auto"
-
-
InterruptResponse boolWhether or not to automatically interrupt any ongoing response with output to the default conversation (i.e.
conversationofauto) when a VAD start event occurs.
-
-
-
-
Output RealtimeAudioConfigOutput-
Format RealtimeAudioFormatsUnionThe format of the output audio.
-
Speed float64The speed of the model's spoken response as a multiple of the original speed. 1.0 is the default speed. 0.25 is the minimum speed. 1.5 is the maximum speed. This value can only be changed in between model turns, not while a response is in progress.
This parameter is a post-processing adjustment to the audio after it is generated, it's also possible to prompt the model to speak faster or slower.
-
Voice RealtimeAudioConfigOutputVoiceUnionThe voice the model uses to respond. Supported built-in voices are
alloy,ash,ballad,coral,echo,sage,shimmer,verse,marin, andcedar. You may also provide a custom voice object with anid, for example{ "id": "voice_1234" }. Voice cannot be changed during the session once the model has responded with audio at least once. We recommendmarinandcedarfor best quality.-
string -
string-
const RealtimeAudioConfigOutputVoiceString2Alloy RealtimeAudioConfigOutputVoiceString2 = "alloy" -
const RealtimeAudioConfigOutputVoiceString2Ash RealtimeAudioConfigOutputVoiceString2 = "ash" -
const RealtimeAudioConfigOutputVoiceString2Ballad RealtimeAudioConfigOutputVoiceString2 = "ballad" -
const RealtimeAudioConfigOutputVoiceString2Coral RealtimeAudioConfigOutputVoiceString2 = "coral" -
const RealtimeAudioConfigOutputVoiceString2Echo RealtimeAudioConfigOutputVoiceString2 = "echo" -
const RealtimeAudioConfigOutputVoiceString2Sage RealtimeAudioConfigOutputVoiceString2 = "sage" -
const RealtimeAudioConfigOutputVoiceString2Shimmer RealtimeAudioConfigOutputVoiceString2 = "shimmer" -
const RealtimeAudioConfigOutputVoiceString2Verse RealtimeAudioConfigOutputVoiceString2 = "verse" -
const RealtimeAudioConfigOutputVoiceString2Marin RealtimeAudioConfigOutputVoiceString2 = "marin" -
const RealtimeAudioConfigOutputVoiceString2Cedar RealtimeAudioConfigOutputVoiceString2 = "cedar"
-
-
RealtimeAudioConfigOutputVoiceID-
ID stringThe custom voice ID, e.g.
voice_1234.
-
-
-
-
-
Include []stringAdditional fields to include in server outputs.
item.input_audio_transcription.logprobs: Include logprobs for input audio transcription.const RealtimeSessionCreateRequestIncludeItemInputAudioTranscriptionLogprobs RealtimeSessionCreateRequestInclude = "item.input_audio_transcription.logprobs"
-
Instructions stringThe default system instructions (i.e. system message) prepended to model calls. This field allows the client to guide the model on desired responses. The model can be instructed on response content and format, (e.g. "be extremely succinct", "act friendly", "here are examples of good responses") and on audio behavior (e.g. "talk quickly", "inject emotion into your voice", "laugh frequently"). The instructions are not guaranteed to be followed by the model, but they provide guidance to the model on the desired behavior.
Note that the server sets default instructions which will be used if this field is not set and are visible in the
session.createdevent at the start of the session. -
MaxOutputTokens RealtimeSessionCreateRequestMaxOutputTokensUnionMaximum number of output tokens for a single assistant response, inclusive of tool calls. Provide an integer between 1 and 4096 to limit output tokens, or
inffor the maximum available tokens for a given model. Defaults toinf.-
int64 -
Infconst InfInf Inf = "inf"
-
-
Model RealtimeSessionCreateRequestModelThe Realtime model used for this session.
-
string -
RealtimeSessionCreateRequestModel-
const RealtimeSessionCreateRequestModelGPTRealtime RealtimeSessionCreateRequestModel = "gpt-realtime" -
const RealtimeSessionCreateRequestModelGPTRealtime1_5 RealtimeSessionCreateRequestModel = "gpt-realtime-1.5" -
const RealtimeSessionCreateRequestModelGPTRealtime2 RealtimeSessionCreateRequestModel = "gpt-realtime-2" -
const RealtimeSessionCreateRequestModelGPTRealtime2_1 RealtimeSessionCreateRequestModel = "gpt-realtime-2.1" -
const RealtimeSessionCreateRequestModelGPTRealtime2_1Mini RealtimeSessionCreateRequestModel = "gpt-realtime-2.1-mini" -
const RealtimeSessionCreateRequestModelGPTRealtime2025_08_28 RealtimeSessionCreateRequestModel = "gpt-realtime-2025-08-28" -
const RealtimeSessionCreateRequestModelGPT4oRealtimePreview RealtimeSessionCreateRequestModel = "gpt-4o-realtime-preview" -
const RealtimeSessionCreateRequestModelGPT4oRealtimePreview2024_10_01 RealtimeSessionCreateRequestModel = "gpt-4o-realtime-preview-2024-10-01" -
const RealtimeSessionCreateRequestModelGPT4oRealtimePreview2024_12_17 RealtimeSessionCreateRequestModel = "gpt-4o-realtime-preview-2024-12-17" -
const RealtimeSessionCreateRequestModelGPT4oRealtimePreview2025_06_03 RealtimeSessionCreateRequestModel = "gpt-4o-realtime-preview-2025-06-03" -
const RealtimeSessionCreateRequestModelGPT4oMiniRealtimePreview RealtimeSessionCreateRequestModel = "gpt-4o-mini-realtime-preview" -
const RealtimeSessionCreateRequestModelGPT4oMiniRealtimePreview2024_12_17 RealtimeSessionCreateRequestModel = "gpt-4o-mini-realtime-preview-2024-12-17" -
const RealtimeSessionCreateRequestModelGPTRealtimeMini RealtimeSessionCreateRequestModel = "gpt-realtime-mini" -
const RealtimeSessionCreateRequestModelGPTRealtimeMini2025_10_06 RealtimeSessionCreateRequestModel = "gpt-realtime-mini-2025-10-06" -
const RealtimeSessionCreateRequestModelGPTRealtimeMini2025_12_15 RealtimeSessionCreateRequestModel = "gpt-realtime-mini-2025-12-15" -
const RealtimeSessionCreateRequestModelGPTAudio1_5 RealtimeSessionCreateRequestModel = "gpt-audio-1.5" -
const RealtimeSessionCreateRequestModelGPTAudioMini RealtimeSessionCreateRequestModel = "gpt-audio-mini" -
const RealtimeSessionCreateRequestModelGPTAudioMini2025_10_06 RealtimeSessionCreateRequestModel = "gpt-audio-mini-2025-10-06" -
const RealtimeSessionCreateRequestModelGPTAudioMini2025_12_15 RealtimeSessionCreateRequestModel = "gpt-audio-mini-2025-12-15"
-
-
-
OutputModalities []stringThe set of modalities the model can respond with. It defaults to
["audio"], indicating that the model will respond with audio plus a transcript.["text"]can be used to make the model respond with text only. It is not possible to request bothtextandaudioat the same time.-
const RealtimeSessionCreateRequestOutputModalityText RealtimeSessionCreateRequestOutputModality = "text" -
const RealtimeSessionCreateRequestOutputModalityAudio RealtimeSessionCreateRequestOutputModality = "audio"
-
-
ParallelToolCalls boolWhether the model may call multiple tools in parallel. Only supported by reasoning Realtime models such as
gpt-realtime-2. -
Prompt ResponsePromptReference to a prompt template and its variables. Learn more.
-
ID stringThe unique identifier of the prompt template to use.
-
Variables map[string, ResponsePromptVariableUnion]Optional map of values to substitute in for variables in your prompt. The substitution values can either be strings, or other Response input types like images or files.
-
string -
type ResponseInputText struct{…}A text input to the model.
-
Text stringThe text input to the model.
-
Type InputTextThe type of the input item. Always
input_text.const InputTextInputText InputText = "input_text"
-
PromptCacheBreakpoint ResponseInputTextPromptCacheBreakpointMarks the exact end of a reusable prompt prefix. The breakpoint inherits its TTL from the request's
prompt_cache_options.ttl; the boundary is not rounded to a token block.-
Mode ExplicitThe breakpoint mode. Always
explicit.const ExplicitExplicit Explicit = "explicit"
-
-
-
type ResponseInputImage struct{…}An image input to the model. Learn about image inputs.
-
Detail ResponseInputImageDetailThe detail level of the image to be sent to the model. One of
high,low,auto, ororiginal. Defaults toauto.-
const ResponseInputImageDetailLow ResponseInputImageDetail = "low" -
const ResponseInputImageDetailHigh ResponseInputImageDetail = "high" -
const ResponseInputImageDetailAuto ResponseInputImageDetail = "auto" -
const ResponseInputImageDetailOriginal ResponseInputImageDetail = "original"
-
-
Type InputImageThe type of the input item. Always
input_image.const InputImageInputImage InputImage = "input_image"
-
FileID stringThe ID of the file to be sent to the model.
-
ImageURL stringThe URL of the image to be sent to the model. A fully qualified URL or base64 encoded image in a data URL.
-
PromptCacheBreakpoint ResponseInputImagePromptCacheBreakpointMarks the exact end of a reusable prompt prefix. The breakpoint inherits its TTL from the request's
prompt_cache_options.ttl; the boundary is not rounded to a token block.-
Mode ExplicitThe breakpoint mode. Always
explicit.const ExplicitExplicit Explicit = "explicit"
-
-
-
type ResponseInputFile struct{…}A file input to the model.
-
Type InputFileThe type of the input item. Always
input_file.const InputFileInputFile InputFile = "input_file"
-
Detail ResponseInputFileDetailThe detail level of the file to be sent to the model. Use
autoto let the system select the detail level; for GPT-5.6 and later models,autouses high-quality rendering, which may increase input token usage. Uselowfor lower-cost rendering, orhighto render the file at higher quality. Defaults toauto.-
const ResponseInputFileDetailAuto ResponseInputFileDetail = "auto" -
const ResponseInputFileDetailLow ResponseInputFileDetail = "low" -
const ResponseInputFileDetailHigh ResponseInputFileDetail = "high"
-
-
FileData stringThe content of the file to be sent to the model.
-
FileID stringThe ID of the file to be sent to the model.
-
FileURL stringThe URL of the file to be sent to the model.
-
Filename stringThe name of the file to be sent to the model.
-
PromptCacheBreakpoint ResponseInputFilePromptCacheBreakpointMarks the exact end of a reusable prompt prefix. The breakpoint inherits its TTL from the request's
prompt_cache_options.ttl; the boundary is not rounded to a token block.-
Mode ExplicitThe breakpoint mode. Always
explicit.const ExplicitExplicit Explicit = "explicit"
-
-
-
-
Version stringOptional version of the prompt template.
-
-
Reasoning RealtimeReasoningConfiguration for reasoning-capable Realtime models such as
gpt-realtime-2.-
Effort RealtimeReasoningEffortConstrains effort on reasoning for reasoning-capable Realtime models such as
gpt-realtime-2.-
const RealtimeReasoningEffortMinimal RealtimeReasoningEffort = "minimal" -
const RealtimeReasoningEffortLow RealtimeReasoningEffort = "low" -
const RealtimeReasoningEffortMedium RealtimeReasoningEffort = "medium" -
const RealtimeReasoningEffortHigh RealtimeReasoningEffort = "high" -
const RealtimeReasoningEffortXhigh RealtimeReasoningEffort = "xhigh"
-
-
-
ToolChoice RealtimeToolChoiceConfigUnionHow the model chooses tools. Provide one of the string modes or force a specific function/MCP tool.
-
type ToolChoiceOptions stringControls which (if any) tool is called by the model.
nonemeans the model will not call any tool and instead generates a message.automeans the model can pick between generating a message or calling one or more tools.requiredmeans the model must call one or more tools.-
const ToolChoiceOptionsNone ToolChoiceOptions = "none" -
const ToolChoiceOptionsAuto ToolChoiceOptions = "auto" -
const ToolChoiceOptionsRequired ToolChoiceOptions = "required"
-
-
type ToolChoiceFunction struct{…}Use this option to force the model to call a specific function.
-
Name stringThe name of the function to call.
-
Type FunctionFor function calling, the type is always
function.const FunctionFunction Function = "function"
-
-
type ToolChoiceMcp struct{…}Use this option to force the model to call a specific tool on a remote MCP server.
-
ServerLabel stringThe label of the MCP server to use.
-
Type McpFor MCP tools, the type is always
mcp.const McpMcp Mcp = "mcp"
-
Name stringThe name of the tool to call on the server.
-
-
-
Tools RealtimeToolsConfigTools available to the model.
-
type RealtimeFunctionTool struct{…}-
Description stringThe description of the function, including guidance on when and how to call it, and guidance about what to tell the user when calling (if anything).
-
Name stringThe name of the function.
-
Parameters anyParameters of the function in JSON Schema.
-
Type RealtimeFunctionToolTypeThe type of the tool, i.e.
function.const RealtimeFunctionToolTypeFunction RealtimeFunctionToolType = "function"
-
-
RealtimeToolsConfigUnionMcp-
ServerLabel stringA label for this MCP server, used to identify it in tool calls.
-
Type McpThe type of the MCP tool. Always
mcp.const McpMcp Mcp = "mcp"
-
AllowedCallers []stringThe tool invocation context(s).
-
const RealtimeToolsConfigUnionMcpAllowedCallerDirect RealtimeToolsConfigUnionMcpAllowedCaller = "direct" -
const RealtimeToolsConfigUnionMcpAllowedCallerProgrammatic RealtimeToolsConfigUnionMcpAllowedCaller = "programmatic"
-
-
AllowedTools RealtimeToolsConfigUnionMcpAllowedToolsList of allowed tool names or a filter object.
-
[]string -
RealtimeToolsConfigUnionMcpAllowedToolsMcpToolFilter-
ReadOnly boolIndicates whether or not a tool modifies data or is read-only. If an MCP server is annotated with
readOnlyHint, it will match this filter. -
ToolNames []stringList of allowed tool names.
-
-
-
Authorization stringAn OAuth access token that can be used with a remote MCP server, either with a custom MCP server URL or a service connector. Your application must handle the OAuth authorization flow and provide the token here.
-
ConnectorID stringIdentifier for service connectors, like those available in ChatGPT. One of
server_url,connector_id, ortunnel_idmust be provided. Learn more about service connectors here.Currently supported
connector_idvalues are:-
Dropbox:
connector_dropbox -
Gmail:
connector_gmail -
Google Calendar:
connector_googlecalendar -
Google Drive:
connector_googledrive -
Microsoft Teams:
connector_microsoftteams -
Outlook Calendar:
connector_outlookcalendar -
Outlook Email:
connector_outlookemail -
SharePoint:
connector_sharepoint -
const RealtimeToolsConfigUnionMcpConnectorIDConnectorDropbox RealtimeToolsConfigUnionMcpConnectorID = "connector_dropbox" -
const RealtimeToolsConfigUnionMcpConnectorIDConnectorGmail RealtimeToolsConfigUnionMcpConnectorID = "connector_gmail" -
const RealtimeToolsConfigUnionMcpConnectorIDConnectorGooglecalendar RealtimeToolsConfigUnionMcpConnectorID = "connector_googlecalendar" -
const RealtimeToolsConfigUnionMcpConnectorIDConnectorGoogledrive RealtimeToolsConfigUnionMcpConnectorID = "connector_googledrive" -
const RealtimeToolsConfigUnionMcpConnectorIDConnectorMicrosoftteams RealtimeToolsConfigUnionMcpConnectorID = "connector_microsoftteams" -
const RealtimeToolsConfigUnionMcpConnectorIDConnectorOutlookcalendar RealtimeToolsConfigUnionMcpConnectorID = "connector_outlookcalendar" -
const RealtimeToolsConfigUnionMcpConnectorIDConnectorOutlookemail RealtimeToolsConfigUnionMcpConnectorID = "connector_outlookemail" -
const RealtimeToolsConfigUnionMcpConnectorIDConnectorSharepoint RealtimeToolsConfigUnionMcpConnectorID = "connector_sharepoint"
-
-
DeferLoading boolWhether this MCP tool is deferred and discovered via tool search.
-
Headers map[string, string]Optional HTTP headers to send to the MCP server. Use for authentication or other purposes.
-
RequireApproval RealtimeToolsConfigUnionMcpRequireApprovalSpecify which of the MCP server's tools require approval.
-
RealtimeToolsConfigUnionMcpRequireApprovalMcpToolApprovalFilter-
Always RealtimeToolsConfigUnionMcpRequireApprovalMcpToolApprovalFilterAlwaysA filter object to specify which tools are allowed.
-
ReadOnly boolIndicates whether or not a tool modifies data or is read-only. If an MCP server is annotated with
readOnlyHint, it will match this filter. -
ToolNames []stringList of allowed tool names.
-
-
Never RealtimeToolsConfigUnionMcpRequireApprovalMcpToolApprovalFilterNeverA filter object to specify which tools are allowed.
-
ReadOnly boolIndicates whether or not a tool modifies data or is read-only. If an MCP server is annotated with
readOnlyHint, it will match this filter. -
ToolNames []stringList of allowed tool names.
-
-
-
string-
const RealtimeToolsConfigUnionMcpRequireApprovalMcpToolApprovalSettingAlways RealtimeToolsConfigUnionMcpRequireApprovalMcpToolApprovalSetting = "always" -
const RealtimeToolsConfigUnionMcpRequireApprovalMcpToolApprovalSettingNever RealtimeToolsConfigUnionMcpRequireApprovalMcpToolApprovalSetting = "never"
-
-
-
ServerDescription stringOptional description of the MCP server, used to provide more context.
-
ServerURL stringThe URL for the MCP server. One of
server_url,connector_id, ortunnel_idmust be provided. -
TunnelID stringThe Secure MCP Tunnel ID to use instead of a direct server URL. One of
server_url,connector_id, ortunnel_idmust be provided.
-
-
-
Tracing RealtimeTracingConfigUnionRealtime API can write session traces to the Traces Dashboard. Set to null to disable tracing. Once tracing is enabled for a session, the configuration cannot be modified.
autowill create a trace for the session with default values for the workflow name, group id, and metadata.-
Autoconst AutoAuto Auto = "auto"
-
RealtimeTracingConfigTracingConfiguration-
GroupID stringThe group id to attach to this trace to enable filtering and grouping in the Traces Dashboard.
-
Metadata anyThe arbitrary metadata to attach to this trace to enable filtering in the Traces Dashboard.
-
WorkflowName stringThe name of the workflow to attach to this trace. This is used to name the trace in the Traces Dashboard.
-
-
-
Truncation RealtimeTruncationUnionWhen the number of tokens in a conversation exceeds the model's input token limit, the conversation be truncated, meaning messages (starting from the oldest) will not be included in the model's context. A 32k context model with 4,096 max output tokens can only include 28,224 tokens in the context before truncation occurs.
Clients can configure truncation behavior to truncate with a lower max token limit, which is an effective way to control token usage and cost.
Truncation will reduce the number of cached tokens on the next turn (busting the cache), since messages are dropped from the beginning of the context. However, clients can also configure truncation to retain messages up to a fraction of the maximum context size, which will reduce the need for future truncations and thus improve the cache rate.
Truncation can be disabled entirely, which means the server will never truncate but would instead return an error if the conversation exceeds the model's input token limit.
-
type RealtimeTruncationRealtimeTruncationStrategy stringThe truncation strategy to use for the session.
autois the default truncation strategy.disabledwill disable truncation and emit errors when the conversation exceeds the input token limit.-
const RealtimeTruncationRealtimeTruncationStrategyAuto RealtimeTruncationRealtimeTruncationStrategy = "auto" -
const RealtimeTruncationRealtimeTruncationStrategyDisabled RealtimeTruncationRealtimeTruncationStrategy = "disabled"
-
-
type RealtimeTruncationRetentionRatio struct{…}Retain a fraction of the conversation tokens when the conversation exceeds the input token limit. This allows you to amortize truncations across multiple turns, which can help improve cached token usage.
-
RetentionRatio float64Fraction of post-instruction conversation tokens to retain (
0.0-1.0) when the conversation exceeds the input token limit. Setting this to0.8means that messages will be dropped until 80% of the maximum allowed tokens are used. This helps reduce the frequency of truncations and improve cache rates. -
Type RetentionRatioUse retention ratio truncation.
const RetentionRatioRetentionRatio RetentionRatio = "retention_ratio"
-
TokenLimits RealtimeTruncationRetentionRatioTokenLimitsOptional custom token limits for this truncation strategy. If not provided, the model's default token limits will be used.
-
PostInstructions int64Maximum tokens allowed in the conversation after instructions (which including tool definitions). For example, setting this to 5,000 would mean that truncation would occur when the conversation exceeds 5,000 tokens after instructions. This cannot be higher than the model's context window size minus the maximum output tokens.
-
-
-
-
-
type RealtimeTranscriptionSessionCreateRequest struct{…}Realtime transcription session object configuration.
-
Type TranscriptionThe type of session to create. Always
transcriptionfor transcription sessions.const TranscriptionTranscription Transcription = "transcription"
-
Audio RealtimeTranscriptionSessionAudioConfiguration for input and output audio.
-
Input RealtimeTranscriptionSessionAudioInput-
Format RealtimeAudioFormatsUnionThe PCM audio format. Only a 24kHz sample rate is supported.
-
NoiseReduction RealtimeTranscriptionSessionAudioInputNoiseReductionConfiguration for input audio noise reduction. This can be set to
nullto turn off. Noise reduction filters audio added to the input audio buffer before it is sent to VAD and the model. Filtering the audio can improve VAD and turn detection accuracy (reducing false positives) and model performance by improving perception of the input audio.-
Type NoiseReductionTypeType of noise reduction.
near_fieldis for close-talking microphones such as headphones,far_fieldis for far-field microphones such as laptop or conference room microphones.
-
-
Transcription AudioTranscriptionConfiguration for input audio transcription, defaults to off and can be set to
nullto turn off once on. Input audio transcription is not native to the model, since the model consumes audio directly. Transcription runs asynchronously through the /audio/transcriptions endpoint and should be treated as guidance of input audio content rather than precisely what the model heard. The client can optionally set the language and prompt for transcription, these offer additional guidance to the transcription service. -
TurnDetection RealtimeTranscriptionSessionAudioInputTurnDetectionUnionConfiguration for turn detection, ether Server VAD or Semantic VAD. This can be set to
nullto turn off, in which case the client must manually trigger model response.Server VAD means that the model will detect the start and end of speech based on audio volume and respond at the end of user speech.
Semantic VAD is more advanced and uses a turn detection model (in conjunction with VAD) to semantically estimate whether the user has finished speaking, then dynamically sets a timeout based on this probability. For example, if user audio trails off with "uhhm", the model will score a low probability of turn end and wait longer for the user to continue speaking. This can be useful for more natural conversations, but may have a higher latency.
For
gpt-realtime-whispertranscription sessions, turn detection must be set tonull; VAD is not supported.-
RealtimeTranscriptionSessionAudioInputTurnDetectionServerVad-
Type ServerVadType of turn detection,
server_vadto turn on simple Server VAD.const ServerVadServerVad ServerVad = "server_vad"
-
CreateResponse boolWhether or not to automatically generate a response when a VAD stop event occurs. If
interrupt_responseis set tofalsethis may fail to create a response if the model is already responding.If both
create_responseandinterrupt_responseare set tofalse, the model will never respond automatically but VAD events will still be emitted. -
IdleTimeoutMs int64Optional timeout after which a model response will be triggered automatically. This is useful for situations in which a long pause from the user is unexpected, such as a phone call. The model will effectively prompt the user to continue the conversation based on the current context.
The timeout value will be applied after the last model response's audio has finished playing, i.e. it's set to the
response.donetime plus audio playback duration.An
input_audio_buffer.timeout_triggeredevent (plus events associated with the Response) will be emitted when the timeout is reached. Idle timeout is currently only supported forserver_vadmode. -
InterruptResponse boolWhether or not to automatically interrupt (cancel) any ongoing response with output to the default conversation (i.e.
conversationofauto) when a VAD start event occurs. Iftruethen the response will be cancelled, otherwise it will continue until complete.If both
create_responseandinterrupt_responseare set tofalse, the model will never respond automatically but VAD events will still be emitted. -
PrefixPaddingMs int64Used only for
server_vadmode. Amount of audio to include before the VAD detected speech (in milliseconds). Defaults to 300ms. -
SilenceDurationMs int64Used only for
server_vadmode. Duration of silence to detect speech stop (in milliseconds). Defaults to 500ms. With shorter values the model will respond more quickly, but may jump in on short pauses from the user. -
Threshold float64Used only for
server_vadmode. Activation threshold for VAD (0.0 to 1.0), this defaults to 0.5. A higher threshold will require louder audio to activate the model, and thus might perform better in noisy environments.
-
-
RealtimeTranscriptionSessionAudioInputTurnDetectionSemanticVad-
Type SemanticVadType of turn detection,
semantic_vadto turn on Semantic VAD.const SemanticVadSemanticVad SemanticVad = "semantic_vad"
-
CreateResponse boolWhether or not to automatically generate a response when a VAD stop event occurs.
-
Eagerness stringUsed only for
semantic_vadmode. The eagerness of the model to respond.lowwill wait longer for the user to continue speaking,highwill respond more quickly.autois the default and is equivalent tomedium.low,medium, andhighhave max timeouts of 8s, 4s, and 2s respectively.-
const RealtimeTranscriptionSessionAudioInputTurnDetectionSemanticVadEagernessLow RealtimeTranscriptionSessionAudioInputTurnDetectionSemanticVadEagerness = "low" -
const RealtimeTranscriptionSessionAudioInputTurnDetectionSemanticVadEagernessMedium RealtimeTranscriptionSessionAudioInputTurnDetectionSemanticVadEagerness = "medium" -
const RealtimeTranscriptionSessionAudioInputTurnDetectionSemanticVadEagernessHigh RealtimeTranscriptionSessionAudioInputTurnDetectionSemanticVadEagerness = "high" -
const RealtimeTranscriptionSessionAudioInputTurnDetectionSemanticVadEagernessAuto RealtimeTranscriptionSessionAudioInputTurnDetectionSemanticVadEagerness = "auto"
-
-
InterruptResponse boolWhether or not to automatically interrupt any ongoing response with output to the default conversation (i.e.
conversationofauto) when a VAD start event occurs.
-
-
-
-
-
Include []stringAdditional fields to include in server outputs.
item.input_audio_transcription.logprobs: Include logprobs for input audio transcription.const RealtimeTranscriptionSessionCreateRequestIncludeItemInputAudioTranscriptionLogprobs RealtimeTranscriptionSessionCreateRequestInclude = "item.input_audio_transcription.logprobs"
-
-
-
Returns
-
type ClientSecretNewResponse struct{…}Response from creating a session and client secret for the Realtime API.
-
ExpiresAt int64Expiration timestamp for the client secret, in seconds since epoch.
-
Session ClientSecretNewResponseSessionUnionThe session configuration for either a realtime or transcription session.
-
type RealtimeSessionCreateResponse struct{…}A Realtime session configuration object.
-
ID stringUnique identifier for the session that looks like
sess_1234567890abcdef. -
Object RealtimeSessionThe object type. Always
realtime.session.const RealtimeSessionRealtimeSession RealtimeSession = "realtime.session"
-
Type RealtimeThe type of session to create. Always
realtimefor the Realtime API.const RealtimeRealtime Realtime = "realtime"
-
Audio RealtimeSessionCreateResponseAudioConfiguration for input and output audio.
-
Input RealtimeSessionCreateResponseAudioInput-
Format RealtimeAudioFormatsUnionThe format of the input audio.
-
type RealtimeAudioFormatsAudioPCM struct{…}The PCM audio format. Only a 24kHz sample rate is supported.
-
Rate int64The sample rate of the audio. Always
24000.const RealtimeAudioFormatsAudioPCMRate24000 RealtimeAudioFormatsAudioPCMRate = 24000
-
Type stringThe audio format. Always
audio/pcm.const RealtimeAudioFormatsAudioPCMTypeAudioPCM RealtimeAudioFormatsAudioPCMType = "audio/pcm"
-
-
type RealtimeAudioFormatsAudioPCMU struct{…}The G.711 μ-law format.
-
Type stringThe audio format. Always
audio/pcmu.const RealtimeAudioFormatsAudioPCMUTypeAudioPCMU RealtimeAudioFormatsAudioPCMUType = "audio/pcmu"
-
-
type RealtimeAudioFormatsAudioPCMA struct{…}The G.711 A-law format.
-
Type stringThe audio format. Always
audio/pcma.const RealtimeAudioFormatsAudioPCMATypeAudioPCMA RealtimeAudioFormatsAudioPCMAType = "audio/pcma"
-
-
-
NoiseReduction RealtimeSessionCreateResponseAudioInputNoiseReductionConfiguration for input audio noise reduction. This can be set to
nullto turn off. Noise reduction filters audio added to the input audio buffer before it is sent to VAD and the model. Filtering the audio can improve VAD and turn detection accuracy (reducing false positives) and model performance by improving perception of the input audio.-
Type NoiseReductionTypeType of noise reduction.
near_fieldis for close-talking microphones such as headphones,far_fieldis for far-field microphones such as laptop or conference room microphones.-
const NoiseReductionTypeNearField NoiseReductionType = "near_field" -
const NoiseReductionTypeFarField NoiseReductionType = "far_field"
-
-
-
Transcription AudioTranscription-
Delay AudioTranscriptionDelayControls how long the model waits before emitting transcription text. Higher values can improve transcription accuracy at the cost of latency. Only supported with
gpt-realtime-whisperin GA Realtime sessions.-
const AudioTranscriptionDelayMinimal AudioTranscriptionDelay = "minimal" -
const AudioTranscriptionDelayLow AudioTranscriptionDelay = "low" -
const AudioTranscriptionDelayMedium AudioTranscriptionDelay = "medium" -
const AudioTranscriptionDelayHigh AudioTranscriptionDelay = "high" -
const AudioTranscriptionDelayXhigh AudioTranscriptionDelay = "xhigh"
-
-
Language stringThe language of the input audio. Supplying the input language in ISO-639-1 (e.g.
en) format will improve accuracy and latency. -
Model AudioTranscriptionModelThe model to use for transcription. Current options are
whisper-1,gpt-4o-mini-transcribe,gpt-4o-mini-transcribe-2025-12-15,gpt-4o-transcribe,gpt-4o-transcribe-diarize, andgpt-realtime-whisper. Usegpt-4o-transcribe-diarizewhen you need diarization with speaker labels.-
string -
type AudioTranscriptionModel stringThe model to use for transcription. Current options are
whisper-1,gpt-4o-mini-transcribe,gpt-4o-mini-transcribe-2025-12-15,gpt-4o-transcribe,gpt-4o-transcribe-diarize, andgpt-realtime-whisper. Usegpt-4o-transcribe-diarizewhen you need diarization with speaker labels.-
const AudioTranscriptionModelWhisper1 AudioTranscriptionModel = "whisper-1" -
const AudioTranscriptionModelGPT4oMiniTranscribe AudioTranscriptionModel = "gpt-4o-mini-transcribe" -
const AudioTranscriptionModelGPT4oMiniTranscribe2025_12_15 AudioTranscriptionModel = "gpt-4o-mini-transcribe-2025-12-15" -
const AudioTranscriptionModelGPT4oTranscribe AudioTranscriptionModel = "gpt-4o-transcribe" -
const AudioTranscriptionModelGPT4oTranscribeDiarize AudioTranscriptionModel = "gpt-4o-transcribe-diarize" -
const AudioTranscriptionModelGPTRealtimeWhisper AudioTranscriptionModel = "gpt-realtime-whisper"
-
-
-
Prompt stringAn optional text to guide the model's style or continue a previous audio segment. For
whisper-1, the prompt is a list of keywords. Forgpt-4o-transcribemodels (excludinggpt-4o-transcribe-diarize), the prompt is a free text string, for example "expect words related to technology". Prompt is not supported withgpt-realtime-whisperin GA Realtime sessions.
-
-
TurnDetection RealtimeSessionCreateResponseAudioInputTurnDetectionUnionConfiguration for turn detection, ether Server VAD or Semantic VAD. This can be set to
nullto turn off, in which case the client must manually trigger model response.Server VAD means that the model will detect the start and end of speech based on audio volume and respond at the end of user speech.
Semantic VAD is more advanced and uses a turn detection model (in conjunction with VAD) to semantically estimate whether the user has finished speaking, then dynamically sets a timeout based on this probability. For example, if user audio trails off with "uhhm", the model will score a low probability of turn end and wait longer for the user to continue speaking. This can be useful for more natural conversations, but may have a higher latency.
For
gpt-realtime-whispertranscription sessions, turn detection must be set tonull; VAD is not supported.-
type RealtimeSessionCreateResponseAudioInputTurnDetectionServerVad struct{…}Server-side voice activity detection (VAD) which flips on when user speech is detected and off after a period of silence.
-
Type ServerVadType of turn detection,
server_vadto turn on simple Server VAD.const ServerVadServerVad ServerVad = "server_vad"
-
CreateResponse boolWhether or not to automatically generate a response when a VAD stop event occurs. If
interrupt_responseis set tofalsethis may fail to create a response if the model is already responding.If both
create_responseandinterrupt_responseare set tofalse, the model will never respond automatically but VAD events will still be emitted. -
IdleTimeoutMs int64Optional timeout after which a model response will be triggered automatically. This is useful for situations in which a long pause from the user is unexpected, such as a phone call. The model will effectively prompt the user to continue the conversation based on the current context.
The timeout value will be applied after the last model response's audio has finished playing, i.e. it's set to the
response.donetime plus audio playback duration.An
input_audio_buffer.timeout_triggeredevent (plus events associated with the Response) will be emitted when the timeout is reached. Idle timeout is currently only supported forserver_vadmode. -
InterruptResponse boolWhether or not to automatically interrupt (cancel) any ongoing response with output to the default conversation (i.e.
conversationofauto) when a VAD start event occurs. Iftruethen the response will be cancelled, otherwise it will continue until complete.If both
create_responseandinterrupt_responseare set tofalse, the model will never respond automatically but VAD events will still be emitted. -
PrefixPaddingMs int64Used only for
server_vadmode. Amount of audio to include before the VAD detected speech (in milliseconds). Defaults to 300ms. -
SilenceDurationMs int64Used only for
server_vadmode. Duration of silence to detect speech stop (in milliseconds). Defaults to 500ms. With shorter values the model will respond more quickly, but may jump in on short pauses from the user. -
Threshold float64Used only for
server_vadmode. Activation threshold for VAD (0.0 to 1.0), this defaults to 0.5. A higher threshold will require louder audio to activate the model, and thus might perform better in noisy environments.
-
-
type RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVad struct{…}Server-side semantic turn detection which uses a model to determine when the user has finished speaking.
-
Type SemanticVadType of turn detection,
semantic_vadto turn on Semantic VAD.const SemanticVadSemanticVad SemanticVad = "semantic_vad"
-
CreateResponse boolWhether or not to automatically generate a response when a VAD stop event occurs.
-
Eagerness stringUsed only for
semantic_vadmode. The eagerness of the model to respond.lowwill wait longer for the user to continue speaking,highwill respond more quickly.autois the default and is equivalent tomedium.low,medium, andhighhave max timeouts of 8s, 4s, and 2s respectively.-
const RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagernessLow RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagerness = "low" -
const RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagernessMedium RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagerness = "medium" -
const RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagernessHigh RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagerness = "high" -
const RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagernessAuto RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagerness = "auto"
-
-
InterruptResponse boolWhether or not to automatically interrupt any ongoing response with output to the default conversation (i.e.
conversationofauto) when a VAD start event occurs.
-
-
-
-
Output RealtimeSessionCreateResponseAudioOutput-
Format RealtimeAudioFormatsUnionThe format of the output audio.
-
Speed float64The speed of the model's spoken response as a multiple of the original speed. 1.0 is the default speed. 0.25 is the minimum speed. 1.5 is the maximum speed. This value can only be changed in between model turns, not while a response is in progress.
This parameter is a post-processing adjustment to the audio after it is generated, it's also possible to prompt the model to speak faster or slower.
-
Voice stringThe voice the model uses to respond. Voice cannot be changed during the session once the model has responded with audio at least once. Current voice options are
alloy,ash,ballad,coral,echo,sage,shimmer,verse,marin, andcedar. We recommendmarinandcedarfor best quality.-
string -
string-
const RealtimeSessionCreateResponseAudioOutputVoiceAlloy RealtimeSessionCreateResponseAudioOutputVoice = "alloy" -
const RealtimeSessionCreateResponseAudioOutputVoiceAsh RealtimeSessionCreateResponseAudioOutputVoice = "ash" -
const RealtimeSessionCreateResponseAudioOutputVoiceBallad RealtimeSessionCreateResponseAudioOutputVoice = "ballad" -
const RealtimeSessionCreateResponseAudioOutputVoiceCoral RealtimeSessionCreateResponseAudioOutputVoice = "coral" -
const RealtimeSessionCreateResponseAudioOutputVoiceEcho RealtimeSessionCreateResponseAudioOutputVoice = "echo" -
const RealtimeSessionCreateResponseAudioOutputVoiceSage RealtimeSessionCreateResponseAudioOutputVoice = "sage" -
const RealtimeSessionCreateResponseAudioOutputVoiceShimmer RealtimeSessionCreateResponseAudioOutputVoice = "shimmer" -
const RealtimeSessionCreateResponseAudioOutputVoiceVerse RealtimeSessionCreateResponseAudioOutputVoice = "verse" -
const RealtimeSessionCreateResponseAudioOutputVoiceMarin RealtimeSessionCreateResponseAudioOutputVoice = "marin" -
const RealtimeSessionCreateResponseAudioOutputVoiceCedar RealtimeSessionCreateResponseAudioOutputVoice = "cedar"
-
-
-
-
-
ExpiresAt int64Expiration timestamp for the session, in seconds since epoch.
-
Include []stringAdditional fields to include in server outputs.
item.input_audio_transcription.logprobs: Include logprobs for input audio transcription.const RealtimeSessionCreateResponseIncludeItemInputAudioTranscriptionLogprobs RealtimeSessionCreateResponseInclude = "item.input_audio_transcription.logprobs"
-
Instructions stringThe default system instructions (i.e. system message) prepended to model calls. This field allows the client to guide the model on desired responses. The model can be instructed on response content and format, (e.g. "be extremely succinct", "act friendly", "here are examples of good responses") and on audio behavior (e.g. "talk quickly", "inject emotion into your voice", "laugh frequently"). The instructions are not guaranteed to be followed by the model, but they provide guidance to the model on the desired behavior.
Note that the server sets default instructions which will be used if this field is not set and are visible in the
session.createdevent at the start of the session. -
MaxOutputTokens RealtimeSessionCreateResponseMaxOutputTokensUnionMaximum number of output tokens for a single assistant response, inclusive of tool calls. Provide an integer between 1 and 4096 to limit output tokens, or
inffor the maximum available tokens for a given model. Defaults toinf.-
int64 -
type Inf stringconst InfInf Inf = "inf"
-
-
Model RealtimeSessionCreateResponseModelThe Realtime model used for this session.
-
string -
type RealtimeSessionCreateResponseModel stringThe Realtime model used for this session.
-
const RealtimeSessionCreateResponseModelGPTRealtime RealtimeSessionCreateResponseModel = "gpt-realtime" -
const RealtimeSessionCreateResponseModelGPTRealtime1_5 RealtimeSessionCreateResponseModel = "gpt-realtime-1.5" -
const RealtimeSessionCreateResponseModelGPTRealtime2 RealtimeSessionCreateResponseModel = "gpt-realtime-2" -
const RealtimeSessionCreateResponseModelGPTRealtime2_1 RealtimeSessionCreateResponseModel = "gpt-realtime-2.1" -
const RealtimeSessionCreateResponseModelGPTRealtime2_1Mini RealtimeSessionCreateResponseModel = "gpt-realtime-2.1-mini" -
const RealtimeSessionCreateResponseModelGPTRealtime2025_08_28 RealtimeSessionCreateResponseModel = "gpt-realtime-2025-08-28" -
const RealtimeSessionCreateResponseModelGPT4oRealtimePreview RealtimeSessionCreateResponseModel = "gpt-4o-realtime-preview" -
const RealtimeSessionCreateResponseModelGPT4oRealtimePreview2024_10_01 RealtimeSessionCreateResponseModel = "gpt-4o-realtime-preview-2024-10-01" -
const RealtimeSessionCreateResponseModelGPT4oRealtimePreview2024_12_17 RealtimeSessionCreateResponseModel = "gpt-4o-realtime-preview-2024-12-17" -
const RealtimeSessionCreateResponseModelGPT4oRealtimePreview2025_06_03 RealtimeSessionCreateResponseModel = "gpt-4o-realtime-preview-2025-06-03" -
const RealtimeSessionCreateResponseModelGPT4oMiniRealtimePreview RealtimeSessionCreateResponseModel = "gpt-4o-mini-realtime-preview" -
const RealtimeSessionCreateResponseModelGPT4oMiniRealtimePreview2024_12_17 RealtimeSessionCreateResponseModel = "gpt-4o-mini-realtime-preview-2024-12-17" -
const RealtimeSessionCreateResponseModelGPTRealtimeMini RealtimeSessionCreateResponseModel = "gpt-realtime-mini" -
const RealtimeSessionCreateResponseModelGPTRealtimeMini2025_10_06 RealtimeSessionCreateResponseModel = "gpt-realtime-mini-2025-10-06" -
const RealtimeSessionCreateResponseModelGPTRealtimeMini2025_12_15 RealtimeSessionCreateResponseModel = "gpt-realtime-mini-2025-12-15" -
const RealtimeSessionCreateResponseModelGPTAudio1_5 RealtimeSessionCreateResponseModel = "gpt-audio-1.5" -
const RealtimeSessionCreateResponseModelGPTAudioMini RealtimeSessionCreateResponseModel = "gpt-audio-mini" -
const RealtimeSessionCreateResponseModelGPTAudioMini2025_10_06 RealtimeSessionCreateResponseModel = "gpt-audio-mini-2025-10-06" -
const RealtimeSessionCreateResponseModelGPTAudioMini2025_12_15 RealtimeSessionCreateResponseModel = "gpt-audio-mini-2025-12-15"
-
-
-
OutputModalities []stringThe set of modalities the model can respond with. It defaults to
["audio"], indicating that the model will respond with audio plus a transcript.["text"]can be used to make the model respond with text only. It is not possible to request bothtextandaudioat the same time.-
const RealtimeSessionCreateResponseOutputModalityText RealtimeSessionCreateResponseOutputModality = "text" -
const RealtimeSessionCreateResponseOutputModalityAudio RealtimeSessionCreateResponseOutputModality = "audio"
-
-
Prompt ResponsePromptReference to a prompt template and its variables. Learn more.
-
ID stringThe unique identifier of the prompt template to use.
-
Variables map[string, ResponsePromptVariableUnion]Optional map of values to substitute in for variables in your prompt. The substitution values can either be strings, or other Response input types like images or files.
-
string -
type ResponseInputText struct{…}A text input to the model.
-
Text stringThe text input to the model.
-
Type InputTextThe type of the input item. Always
input_text.const InputTextInputText InputText = "input_text"
-
PromptCacheBreakpoint ResponseInputTextPromptCacheBreakpointMarks the exact end of a reusable prompt prefix. The breakpoint inherits its TTL from the request's
prompt_cache_options.ttl; the boundary is not rounded to a token block.-
Mode ExplicitThe breakpoint mode. Always
explicit.const ExplicitExplicit Explicit = "explicit"
-
-
-
type ResponseInputImage struct{…}An image input to the model. Learn about image inputs.
-
Detail ResponseInputImageDetailThe detail level of the image to be sent to the model. One of
high,low,auto, ororiginal. Defaults toauto.-
const ResponseInputImageDetailLow ResponseInputImageDetail = "low" -
const ResponseInputImageDetailHigh ResponseInputImageDetail = "high" -
const ResponseInputImageDetailAuto ResponseInputImageDetail = "auto" -
const ResponseInputImageDetailOriginal ResponseInputImageDetail = "original"
-
-
Type InputImageThe type of the input item. Always
input_image.const InputImageInputImage InputImage = "input_image"
-
FileID stringThe ID of the file to be sent to the model.
-
ImageURL stringThe URL of the image to be sent to the model. A fully qualified URL or base64 encoded image in a data URL.
-
PromptCacheBreakpoint ResponseInputImagePromptCacheBreakpointMarks the exact end of a reusable prompt prefix. The breakpoint inherits its TTL from the request's
prompt_cache_options.ttl; the boundary is not rounded to a token block.-
Mode ExplicitThe breakpoint mode. Always
explicit.const ExplicitExplicit Explicit = "explicit"
-
-
-
type ResponseInputFile struct{…}A file input to the model.
-
Type InputFileThe type of the input item. Always
input_file.const InputFileInputFile InputFile = "input_file"
-
Detail ResponseInputFileDetailThe detail level of the file to be sent to the model. Use
autoto let the system select the detail level; for GPT-5.6 and later models,autouses high-quality rendering, which may increase input token usage. Uselowfor lower-cost rendering, orhighto render the file at higher quality. Defaults toauto.-
const ResponseInputFileDetailAuto ResponseInputFileDetail = "auto" -
const ResponseInputFileDetailLow ResponseInputFileDetail = "low" -
const ResponseInputFileDetailHigh ResponseInputFileDetail = "high"
-
-
FileData stringThe content of the file to be sent to the model.
-
FileID stringThe ID of the file to be sent to the model.
-
FileURL stringThe URL of the file to be sent to the model.
-
Filename stringThe name of the file to be sent to the model.
-
PromptCacheBreakpoint ResponseInputFilePromptCacheBreakpointMarks the exact end of a reusable prompt prefix. The breakpoint inherits its TTL from the request's
prompt_cache_options.ttl; the boundary is not rounded to a token block.-
Mode ExplicitThe breakpoint mode. Always
explicit.const ExplicitExplicit Explicit = "explicit"
-
-
-
-
Version stringOptional version of the prompt template.
-
-
Reasoning RealtimeReasoningConfiguration for reasoning-capable Realtime models such as
gpt-realtime-2.-
Effort RealtimeReasoningEffortConstrains effort on reasoning for reasoning-capable Realtime models such as
gpt-realtime-2.-
const RealtimeReasoningEffortMinimal RealtimeReasoningEffort = "minimal" -
const RealtimeReasoningEffortLow RealtimeReasoningEffort = "low" -
const RealtimeReasoningEffortMedium RealtimeReasoningEffort = "medium" -
const RealtimeReasoningEffortHigh RealtimeReasoningEffort = "high" -
const RealtimeReasoningEffortXhigh RealtimeReasoningEffort = "xhigh"
-
-
-
ToolChoice RealtimeSessionCreateResponseToolChoiceUnionHow the model chooses tools. Provide one of the string modes or force a specific function/MCP tool.
-
type ToolChoiceOptions stringControls which (if any) tool is called by the model.
nonemeans the model will not call any tool and instead generates a message.automeans the model can pick between generating a message or calling one or more tools.requiredmeans the model must call one or more tools.-
const ToolChoiceOptionsNone ToolChoiceOptions = "none" -
const ToolChoiceOptionsAuto ToolChoiceOptions = "auto" -
const ToolChoiceOptionsRequired ToolChoiceOptions = "required"
-
-
type ToolChoiceFunction struct{…}Use this option to force the model to call a specific function.
-
Name stringThe name of the function to call.
-
Type FunctionFor function calling, the type is always
function.const FunctionFunction Function = "function"
-
-
type ToolChoiceMcp struct{…}Use this option to force the model to call a specific tool on a remote MCP server.
-
ServerLabel stringThe label of the MCP server to use.
-
Type McpFor MCP tools, the type is always
mcp.const McpMcp Mcp = "mcp"
-
Name stringThe name of the tool to call on the server.
-
-
-
Tools []RealtimeSessionCreateResponseToolUnionTools available to the model.
-
type RealtimeFunctionTool struct{…}-
Description stringThe description of the function, including guidance on when and how to call it, and guidance about what to tell the user when calling (if anything).
-
Name stringThe name of the function.
-
Parameters anyParameters of the function in JSON Schema.
-
Type RealtimeFunctionToolTypeThe type of the tool, i.e.
function.const RealtimeFunctionToolTypeFunction RealtimeFunctionToolType = "function"
-
-
type RealtimeSessionCreateResponseToolMcpTool struct{…}Give the model access to additional tools via remote Model Context Protocol (MCP) servers. Learn more about MCP.
-
ServerLabel stringA label for this MCP server, used to identify it in tool calls.
-
Type McpThe type of the MCP tool. Always
mcp.const McpMcp Mcp = "mcp"
-
AllowedCallers []stringThe tool invocation context(s).
-
const RealtimeSessionCreateResponseToolMcpToolAllowedCallerDirect RealtimeSessionCreateResponseToolMcpToolAllowedCaller = "direct" -
const RealtimeSessionCreateResponseToolMcpToolAllowedCallerProgrammatic RealtimeSessionCreateResponseToolMcpToolAllowedCaller = "programmatic"
-
-
AllowedTools RealtimeSessionCreateResponseToolMcpToolAllowedToolsUnionList of allowed tool names or a filter object.
-
type RealtimeSessionCreateResponseToolMcpToolAllowedToolsMcpAllowedTools []stringA string array of allowed tool names
-
type RealtimeSessionCreateResponseToolMcpToolAllowedToolsMcpToolFilter struct{…}A filter object to specify which tools are allowed.
-
ReadOnly boolIndicates whether or not a tool modifies data or is read-only. If an MCP server is annotated with
readOnlyHint, it will match this filter. -
ToolNames []stringList of allowed tool names.
-
-
-
Authorization stringAn OAuth access token that can be used with a remote MCP server, either with a custom MCP server URL or a service connector. Your application must handle the OAuth authorization flow and provide the token here.
-
ConnectorID stringIdentifier for service connectors, like those available in ChatGPT. One of
server_url,connector_id, ortunnel_idmust be provided. Learn more about service connectors here.Currently supported
connector_idvalues are:-
Dropbox:
connector_dropbox -
Gmail:
connector_gmail -
Google Calendar:
connector_googlecalendar -
Google Drive:
connector_googledrive -
Microsoft Teams:
connector_microsoftteams -
Outlook Calendar:
connector_outlookcalendar -
Outlook Email:
connector_outlookemail -
SharePoint:
connector_sharepoint -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorDropbox RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_dropbox" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorGmail RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_gmail" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorGooglecalendar RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_googlecalendar" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorGoogledrive RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_googledrive" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorMicrosoftteams RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_microsoftteams" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorOutlookcalendar RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_outlookcalendar" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorOutlookemail RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_outlookemail" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorSharepoint RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_sharepoint"
-
-
DeferLoading boolWhether this MCP tool is deferred and discovered via tool search.
-
Headers map[string, string]Optional HTTP headers to send to the MCP server. Use for authentication or other purposes.
-
RequireApproval RealtimeSessionCreateResponseToolMcpToolRequireApprovalUnionSpecify which of the MCP server's tools require approval.
-
type RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalFilter struct{…}Specify which of the MCP server's tools require approval. Can be
always,never, or a filter object associated with tools that require approval.-
Always RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalFilterAlwaysA filter object to specify which tools are allowed.
-
ReadOnly boolIndicates whether or not a tool modifies data or is read-only. If an MCP server is annotated with
readOnlyHint, it will match this filter. -
ToolNames []stringList of allowed tool names.
-
-
Never RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalFilterNeverA filter object to specify which tools are allowed.
-
ReadOnly boolIndicates whether or not a tool modifies data or is read-only. If an MCP server is annotated with
readOnlyHint, it will match this filter. -
ToolNames []stringList of allowed tool names.
-
-
-
type RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalSetting stringSpecify a single approval policy for all tools. One of
alwaysornever. When set toalways, all tools will require approval. When set tonever, all tools will not require approval.-
const RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalSettingAlways RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalSetting = "always" -
const RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalSettingNever RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalSetting = "never"
-
-
-
ServerDescription stringOptional description of the MCP server, used to provide more context.
-
ServerURL stringThe URL for the MCP server. One of
server_url,connector_id, ortunnel_idmust be provided. -
TunnelID stringThe Secure MCP Tunnel ID to use instead of a direct server URL. One of
server_url,connector_id, ortunnel_idmust be provided.
-
-
-
Tracing RealtimeSessionCreateResponseTracingUnionRealtime API can write session traces to the Traces Dashboard. Set to null to disable tracing. Once tracing is enabled for a session, the configuration cannot be modified.
autowill create a trace for the session with default values for the workflow name, group id, and metadata.-
type Auto stringEnables tracing and sets default values for tracing configuration options. Always
auto.const AutoAuto Auto = "auto"
-
type RealtimeSessionCreateResponseTracingTracingConfiguration struct{…}Granular configuration for tracing.
-
GroupID stringThe group id to attach to this trace to enable filtering and grouping in the Traces Dashboard.
-
Metadata anyThe arbitrary metadata to attach to this trace to enable filtering in the Traces Dashboard.
-
WorkflowName stringThe name of the workflow to attach to this trace. This is used to name the trace in the Traces Dashboard.
-
-
-
Truncation RealtimeTruncationUnionWhen the number of tokens in a conversation exceeds the model's input token limit, the conversation be truncated, meaning messages (starting from the oldest) will not be included in the model's context. A 32k context model with 4,096 max output tokens can only include 28,224 tokens in the context before truncation occurs.
Clients can configure truncation behavior to truncate with a lower max token limit, which is an effective way to control token usage and cost.
Truncation will reduce the number of cached tokens on the next turn (busting the cache), since messages are dropped from the beginning of the context. However, clients can also configure truncation to retain messages up to a fraction of the maximum context size, which will reduce the need for future truncations and thus improve the cache rate.
Truncation can be disabled entirely, which means the server will never truncate but would instead return an error if the conversation exceeds the model's input token limit.
-
type RealtimeTruncationRealtimeTruncationStrategy stringThe truncation strategy to use for the session.
autois the default truncation strategy.disabledwill disable truncation and emit errors when the conversation exceeds the input token limit.-
const RealtimeTruncationRealtimeTruncationStrategyAuto RealtimeTruncationRealtimeTruncationStrategy = "auto" -
const RealtimeTruncationRealtimeTruncationStrategyDisabled RealtimeTruncationRealtimeTruncationStrategy = "disabled"
-
-
type RealtimeTruncationRetentionRatio struct{…}Retain a fraction of the conversation tokens when the conversation exceeds the input token limit. This allows you to amortize truncations across multiple turns, which can help improve cached token usage.
-
RetentionRatio float64Fraction of post-instruction conversation tokens to retain (
0.0-1.0) when the conversation exceeds the input token limit. Setting this to0.8means that messages will be dropped until 80% of the maximum allowed tokens are used. This helps reduce the frequency of truncations and improve cache rates. -
Type RetentionRatioUse retention ratio truncation.
const RetentionRatioRetentionRatio RetentionRatio = "retention_ratio"
-
TokenLimits RealtimeTruncationRetentionRatioTokenLimitsOptional custom token limits for this truncation strategy. If not provided, the model's default token limits will be used.
-
PostInstructions int64Maximum tokens allowed in the conversation after instructions (which including tool definitions). For example, setting this to 5,000 would mean that truncation would occur when the conversation exceeds 5,000 tokens after instructions. This cannot be higher than the model's context window size minus the maximum output tokens.
-
-
-
-
-
type RealtimeTranscriptionSessionCreateResponse struct{…}A Realtime transcription session configuration object.
-
ID stringUnique identifier for the session that looks like
sess_1234567890abcdef. -
Object stringThe object type. Always
realtime.transcription_session. -
Type TranscriptionThe type of session. Always
transcriptionfor transcription sessions.const TranscriptionTranscription Transcription = "transcription"
-
Audio RealtimeTranscriptionSessionCreateResponseAudioConfiguration for input audio for the session.
-
Input RealtimeTranscriptionSessionCreateResponseAudioInput-
Format RealtimeAudioFormatsUnionThe PCM audio format. Only a 24kHz sample rate is supported.
-
NoiseReduction RealtimeTranscriptionSessionCreateResponseAudioInputNoiseReductionConfiguration for input audio noise reduction.
-
Type NoiseReductionTypeType of noise reduction.
near_fieldis for close-talking microphones such as headphones,far_fieldis for far-field microphones such as laptop or conference room microphones.
-
-
Transcription AudioTranscription -
TurnDetection RealtimeTranscriptionSessionTurnDetectionConfiguration for turn detection. Can be set to
nullto turn off. Server VAD means that the model will detect the start and end of speech based on audio volume and respond at the end of user speech. Forgpt-realtime-whisper, this must benull; VAD is not supported.-
PrefixPaddingMs int64Amount of audio to include before the VAD detected speech (in milliseconds). Defaults to 300ms.
-
SilenceDurationMs int64Duration of silence to detect speech stop (in milliseconds). Defaults to 500ms. With shorter values the model will respond more quickly, but may jump in on short pauses from the user.
-
Threshold float64Activation threshold for VAD (0.0 to 1.0), this defaults to 0.5. A higher threshold will require louder audio to activate the model, and thus might perform better in noisy environments.
-
Type stringType of turn detection, only
server_vadis currently supported.
-
-
-
-
ExpiresAt int64Expiration timestamp for the session, in seconds since epoch.
-
Include []stringAdditional fields to include in server outputs.
-
item.input_audio_transcription.logprobs: Include logprobs for input audio transcription. -
const RealtimeTranscriptionSessionCreateResponseIncludeItemInputAudioTranscriptionLogprobs RealtimeTranscriptionSessionCreateResponseInclude = "item.input_audio_transcription.logprobs"
-
-
-
-
Value stringThe generated client secret value.
-
Example
package main
import (
"context"
"fmt"
"github.com/openai/openai-go"
"github.com/openai/openai-go/option"
"github.com/openai/openai-go/realtime"
)
func main() {
client := openai.NewClient(
option.WithAPIKey("My API Key"),
)
clientSecret, err := client.Realtime.ClientSecrets.New(context.TODO(), realtime.ClientSecretNewParams{
})
if err != nil {
panic(err.Error())
}
fmt.Printf("%+v\n", clientSecret.ExpiresAt)
}
Response
{
"expires_at": 0,
"session": {
"id": "id",
"object": "realtime.session",
"type": "realtime",
"audio": {
"input": {
"format": {
"rate": 24000,
"type": "audio/pcm"
},
"noise_reduction": {
"type": "near_field"
},
"transcription": {
"delay": "minimal",
"language": "language",
"model": "whisper-1",
"prompt": "prompt"
},
"turn_detection": {
"type": "server_vad",
"create_response": true,
"idle_timeout_ms": 5000,
"interrupt_response": true,
"prefix_padding_ms": 0,
"silence_duration_ms": 0,
"threshold": 0
}
},
"output": {
"format": {
"rate": 24000,
"type": "audio/pcm"
},
"speed": 0.25,
"voice": "ash"
}
},
"expires_at": 0,
"include": [
"item.input_audio_transcription.logprobs"
],
"instructions": "instructions",
"max_output_tokens": "inf",
"model": "gpt-realtime",
"output_modalities": [
"text"
],
"prompt": {
"id": "id",
"variables": {
"foo": "string"
},
"version": "version"
},
"reasoning": {
"effort": "minimal"
},
"tool_choice": "none",
"tools": [
{
"description": "description",
"name": "name",
"parameters": {},
"type": "function"
}
],
"tracing": "auto",
"truncation": "auto"
},
"value": "value"
}
Domain Types
Realtime Session Create Response
-
type RealtimeSessionCreateResponse struct{…}A Realtime session configuration object.
-
ID stringUnique identifier for the session that looks like
sess_1234567890abcdef. -
Object RealtimeSessionThe object type. Always
realtime.session.const RealtimeSessionRealtimeSession RealtimeSession = "realtime.session"
-
Type RealtimeThe type of session to create. Always
realtimefor the Realtime API.const RealtimeRealtime Realtime = "realtime"
-
Audio RealtimeSessionCreateResponseAudioConfiguration for input and output audio.
-
Input RealtimeSessionCreateResponseAudioInput-
Format RealtimeAudioFormatsUnionThe format of the input audio.
-
type RealtimeAudioFormatsAudioPCM struct{…}The PCM audio format. Only a 24kHz sample rate is supported.
-
Rate int64The sample rate of the audio. Always
24000.const RealtimeAudioFormatsAudioPCMRate24000 RealtimeAudioFormatsAudioPCMRate = 24000
-
Type stringThe audio format. Always
audio/pcm.const RealtimeAudioFormatsAudioPCMTypeAudioPCM RealtimeAudioFormatsAudioPCMType = "audio/pcm"
-
-
type RealtimeAudioFormatsAudioPCMU struct{…}The G.711 μ-law format.
-
Type stringThe audio format. Always
audio/pcmu.const RealtimeAudioFormatsAudioPCMUTypeAudioPCMU RealtimeAudioFormatsAudioPCMUType = "audio/pcmu"
-
-
type RealtimeAudioFormatsAudioPCMA struct{…}The G.711 A-law format.
-
Type stringThe audio format. Always
audio/pcma.const RealtimeAudioFormatsAudioPCMATypeAudioPCMA RealtimeAudioFormatsAudioPCMAType = "audio/pcma"
-
-
-
NoiseReduction RealtimeSessionCreateResponseAudioInputNoiseReductionConfiguration for input audio noise reduction. This can be set to
nullto turn off. Noise reduction filters audio added to the input audio buffer before it is sent to VAD and the model. Filtering the audio can improve VAD and turn detection accuracy (reducing false positives) and model performance by improving perception of the input audio.-
Type NoiseReductionTypeType of noise reduction.
near_fieldis for close-talking microphones such as headphones,far_fieldis for far-field microphones such as laptop or conference room microphones.-
const NoiseReductionTypeNearField NoiseReductionType = "near_field" -
const NoiseReductionTypeFarField NoiseReductionType = "far_field"
-
-
-
Transcription AudioTranscription-
Delay AudioTranscriptionDelayControls how long the model waits before emitting transcription text. Higher values can improve transcription accuracy at the cost of latency. Only supported with
gpt-realtime-whisperin GA Realtime sessions.-
const AudioTranscriptionDelayMinimal AudioTranscriptionDelay = "minimal" -
const AudioTranscriptionDelayLow AudioTranscriptionDelay = "low" -
const AudioTranscriptionDelayMedium AudioTranscriptionDelay = "medium" -
const AudioTranscriptionDelayHigh AudioTranscriptionDelay = "high" -
const AudioTranscriptionDelayXhigh AudioTranscriptionDelay = "xhigh"
-
-
Language stringThe language of the input audio. Supplying the input language in ISO-639-1 (e.g.
en) format will improve accuracy and latency. -
Model AudioTranscriptionModelThe model to use for transcription. Current options are
whisper-1,gpt-4o-mini-transcribe,gpt-4o-mini-transcribe-2025-12-15,gpt-4o-transcribe,gpt-4o-transcribe-diarize, andgpt-realtime-whisper. Usegpt-4o-transcribe-diarizewhen you need diarization with speaker labels.-
string -
type AudioTranscriptionModel stringThe model to use for transcription. Current options are
whisper-1,gpt-4o-mini-transcribe,gpt-4o-mini-transcribe-2025-12-15,gpt-4o-transcribe,gpt-4o-transcribe-diarize, andgpt-realtime-whisper. Usegpt-4o-transcribe-diarizewhen you need diarization with speaker labels.-
const AudioTranscriptionModelWhisper1 AudioTranscriptionModel = "whisper-1" -
const AudioTranscriptionModelGPT4oMiniTranscribe AudioTranscriptionModel = "gpt-4o-mini-transcribe" -
const AudioTranscriptionModelGPT4oMiniTranscribe2025_12_15 AudioTranscriptionModel = "gpt-4o-mini-transcribe-2025-12-15" -
const AudioTranscriptionModelGPT4oTranscribe AudioTranscriptionModel = "gpt-4o-transcribe" -
const AudioTranscriptionModelGPT4oTranscribeDiarize AudioTranscriptionModel = "gpt-4o-transcribe-diarize" -
const AudioTranscriptionModelGPTRealtimeWhisper AudioTranscriptionModel = "gpt-realtime-whisper"
-
-
-
Prompt stringAn optional text to guide the model's style or continue a previous audio segment. For
whisper-1, the prompt is a list of keywords. Forgpt-4o-transcribemodels (excludinggpt-4o-transcribe-diarize), the prompt is a free text string, for example "expect words related to technology". Prompt is not supported withgpt-realtime-whisperin GA Realtime sessions.
-
-
TurnDetection RealtimeSessionCreateResponseAudioInputTurnDetectionUnionConfiguration for turn detection, ether Server VAD or Semantic VAD. This can be set to
nullto turn off, in which case the client must manually trigger model response.Server VAD means that the model will detect the start and end of speech based on audio volume and respond at the end of user speech.
Semantic VAD is more advanced and uses a turn detection model (in conjunction with VAD) to semantically estimate whether the user has finished speaking, then dynamically sets a timeout based on this probability. For example, if user audio trails off with "uhhm", the model will score a low probability of turn end and wait longer for the user to continue speaking. This can be useful for more natural conversations, but may have a higher latency.
For
gpt-realtime-whispertranscription sessions, turn detection must be set tonull; VAD is not supported.-
type RealtimeSessionCreateResponseAudioInputTurnDetectionServerVad struct{…}Server-side voice activity detection (VAD) which flips on when user speech is detected and off after a period of silence.
-
Type ServerVadType of turn detection,
server_vadto turn on simple Server VAD.const ServerVadServerVad ServerVad = "server_vad"
-
CreateResponse boolWhether or not to automatically generate a response when a VAD stop event occurs. If
interrupt_responseis set tofalsethis may fail to create a response if the model is already responding.If both
create_responseandinterrupt_responseare set tofalse, the model will never respond automatically but VAD events will still be emitted. -
IdleTimeoutMs int64Optional timeout after which a model response will be triggered automatically. This is useful for situations in which a long pause from the user is unexpected, such as a phone call. The model will effectively prompt the user to continue the conversation based on the current context.
The timeout value will be applied after the last model response's audio has finished playing, i.e. it's set to the
response.donetime plus audio playback duration.An
input_audio_buffer.timeout_triggeredevent (plus events associated with the Response) will be emitted when the timeout is reached. Idle timeout is currently only supported forserver_vadmode. -
InterruptResponse boolWhether or not to automatically interrupt (cancel) any ongoing response with output to the default conversation (i.e.
conversationofauto) when a VAD start event occurs. Iftruethen the response will be cancelled, otherwise it will continue until complete.If both
create_responseandinterrupt_responseare set tofalse, the model will never respond automatically but VAD events will still be emitted. -
PrefixPaddingMs int64Used only for
server_vadmode. Amount of audio to include before the VAD detected speech (in milliseconds). Defaults to 300ms. -
SilenceDurationMs int64Used only for
server_vadmode. Duration of silence to detect speech stop (in milliseconds). Defaults to 500ms. With shorter values the model will respond more quickly, but may jump in on short pauses from the user. -
Threshold float64Used only for
server_vadmode. Activation threshold for VAD (0.0 to 1.0), this defaults to 0.5. A higher threshold will require louder audio to activate the model, and thus might perform better in noisy environments.
-
-
type RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVad struct{…}Server-side semantic turn detection which uses a model to determine when the user has finished speaking.
-
Type SemanticVadType of turn detection,
semantic_vadto turn on Semantic VAD.const SemanticVadSemanticVad SemanticVad = "semantic_vad"
-
CreateResponse boolWhether or not to automatically generate a response when a VAD stop event occurs.
-
Eagerness stringUsed only for
semantic_vadmode. The eagerness of the model to respond.lowwill wait longer for the user to continue speaking,highwill respond more quickly.autois the default and is equivalent tomedium.low,medium, andhighhave max timeouts of 8s, 4s, and 2s respectively.-
const RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagernessLow RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagerness = "low" -
const RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagernessMedium RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagerness = "medium" -
const RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagernessHigh RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagerness = "high" -
const RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagernessAuto RealtimeSessionCreateResponseAudioInputTurnDetectionSemanticVadEagerness = "auto"
-
-
InterruptResponse boolWhether or not to automatically interrupt any ongoing response with output to the default conversation (i.e.
conversationofauto) when a VAD start event occurs.
-
-
-
-
Output RealtimeSessionCreateResponseAudioOutput-
Format RealtimeAudioFormatsUnionThe format of the output audio.
-
Speed float64The speed of the model's spoken response as a multiple of the original speed. 1.0 is the default speed. 0.25 is the minimum speed. 1.5 is the maximum speed. This value can only be changed in between model turns, not while a response is in progress.
This parameter is a post-processing adjustment to the audio after it is generated, it's also possible to prompt the model to speak faster or slower.
-
Voice stringThe voice the model uses to respond. Voice cannot be changed during the session once the model has responded with audio at least once. Current voice options are
alloy,ash,ballad,coral,echo,sage,shimmer,verse,marin, andcedar. We recommendmarinandcedarfor best quality.-
string -
string-
const RealtimeSessionCreateResponseAudioOutputVoiceAlloy RealtimeSessionCreateResponseAudioOutputVoice = "alloy" -
const RealtimeSessionCreateResponseAudioOutputVoiceAsh RealtimeSessionCreateResponseAudioOutputVoice = "ash" -
const RealtimeSessionCreateResponseAudioOutputVoiceBallad RealtimeSessionCreateResponseAudioOutputVoice = "ballad" -
const RealtimeSessionCreateResponseAudioOutputVoiceCoral RealtimeSessionCreateResponseAudioOutputVoice = "coral" -
const RealtimeSessionCreateResponseAudioOutputVoiceEcho RealtimeSessionCreateResponseAudioOutputVoice = "echo" -
const RealtimeSessionCreateResponseAudioOutputVoiceSage RealtimeSessionCreateResponseAudioOutputVoice = "sage" -
const RealtimeSessionCreateResponseAudioOutputVoiceShimmer RealtimeSessionCreateResponseAudioOutputVoice = "shimmer" -
const RealtimeSessionCreateResponseAudioOutputVoiceVerse RealtimeSessionCreateResponseAudioOutputVoice = "verse" -
const RealtimeSessionCreateResponseAudioOutputVoiceMarin RealtimeSessionCreateResponseAudioOutputVoice = "marin" -
const RealtimeSessionCreateResponseAudioOutputVoiceCedar RealtimeSessionCreateResponseAudioOutputVoice = "cedar"
-
-
-
-
-
ExpiresAt int64Expiration timestamp for the session, in seconds since epoch.
-
Include []stringAdditional fields to include in server outputs.
item.input_audio_transcription.logprobs: Include logprobs for input audio transcription.const RealtimeSessionCreateResponseIncludeItemInputAudioTranscriptionLogprobs RealtimeSessionCreateResponseInclude = "item.input_audio_transcription.logprobs"
-
Instructions stringThe default system instructions (i.e. system message) prepended to model calls. This field allows the client to guide the model on desired responses. The model can be instructed on response content and format, (e.g. "be extremely succinct", "act friendly", "here are examples of good responses") and on audio behavior (e.g. "talk quickly", "inject emotion into your voice", "laugh frequently"). The instructions are not guaranteed to be followed by the model, but they provide guidance to the model on the desired behavior.
Note that the server sets default instructions which will be used if this field is not set and are visible in the
session.createdevent at the start of the session. -
MaxOutputTokens RealtimeSessionCreateResponseMaxOutputTokensUnionMaximum number of output tokens for a single assistant response, inclusive of tool calls. Provide an integer between 1 and 4096 to limit output tokens, or
inffor the maximum available tokens for a given model. Defaults toinf.-
int64 -
type Inf stringconst InfInf Inf = "inf"
-
-
Model RealtimeSessionCreateResponseModelThe Realtime model used for this session.
-
string -
type RealtimeSessionCreateResponseModel stringThe Realtime model used for this session.
-
const RealtimeSessionCreateResponseModelGPTRealtime RealtimeSessionCreateResponseModel = "gpt-realtime" -
const RealtimeSessionCreateResponseModelGPTRealtime1_5 RealtimeSessionCreateResponseModel = "gpt-realtime-1.5" -
const RealtimeSessionCreateResponseModelGPTRealtime2 RealtimeSessionCreateResponseModel = "gpt-realtime-2" -
const RealtimeSessionCreateResponseModelGPTRealtime2_1 RealtimeSessionCreateResponseModel = "gpt-realtime-2.1" -
const RealtimeSessionCreateResponseModelGPTRealtime2_1Mini RealtimeSessionCreateResponseModel = "gpt-realtime-2.1-mini" -
const RealtimeSessionCreateResponseModelGPTRealtime2025_08_28 RealtimeSessionCreateResponseModel = "gpt-realtime-2025-08-28" -
const RealtimeSessionCreateResponseModelGPT4oRealtimePreview RealtimeSessionCreateResponseModel = "gpt-4o-realtime-preview" -
const RealtimeSessionCreateResponseModelGPT4oRealtimePreview2024_10_01 RealtimeSessionCreateResponseModel = "gpt-4o-realtime-preview-2024-10-01" -
const RealtimeSessionCreateResponseModelGPT4oRealtimePreview2024_12_17 RealtimeSessionCreateResponseModel = "gpt-4o-realtime-preview-2024-12-17" -
const RealtimeSessionCreateResponseModelGPT4oRealtimePreview2025_06_03 RealtimeSessionCreateResponseModel = "gpt-4o-realtime-preview-2025-06-03" -
const RealtimeSessionCreateResponseModelGPT4oMiniRealtimePreview RealtimeSessionCreateResponseModel = "gpt-4o-mini-realtime-preview" -
const RealtimeSessionCreateResponseModelGPT4oMiniRealtimePreview2024_12_17 RealtimeSessionCreateResponseModel = "gpt-4o-mini-realtime-preview-2024-12-17" -
const RealtimeSessionCreateResponseModelGPTRealtimeMini RealtimeSessionCreateResponseModel = "gpt-realtime-mini" -
const RealtimeSessionCreateResponseModelGPTRealtimeMini2025_10_06 RealtimeSessionCreateResponseModel = "gpt-realtime-mini-2025-10-06" -
const RealtimeSessionCreateResponseModelGPTRealtimeMini2025_12_15 RealtimeSessionCreateResponseModel = "gpt-realtime-mini-2025-12-15" -
const RealtimeSessionCreateResponseModelGPTAudio1_5 RealtimeSessionCreateResponseModel = "gpt-audio-1.5" -
const RealtimeSessionCreateResponseModelGPTAudioMini RealtimeSessionCreateResponseModel = "gpt-audio-mini" -
const RealtimeSessionCreateResponseModelGPTAudioMini2025_10_06 RealtimeSessionCreateResponseModel = "gpt-audio-mini-2025-10-06" -
const RealtimeSessionCreateResponseModelGPTAudioMini2025_12_15 RealtimeSessionCreateResponseModel = "gpt-audio-mini-2025-12-15"
-
-
-
OutputModalities []stringThe set of modalities the model can respond with. It defaults to
["audio"], indicating that the model will respond with audio plus a transcript.["text"]can be used to make the model respond with text only. It is not possible to request bothtextandaudioat the same time.-
const RealtimeSessionCreateResponseOutputModalityText RealtimeSessionCreateResponseOutputModality = "text" -
const RealtimeSessionCreateResponseOutputModalityAudio RealtimeSessionCreateResponseOutputModality = "audio"
-
-
Prompt ResponsePromptReference to a prompt template and its variables. Learn more.
-
ID stringThe unique identifier of the prompt template to use.
-
Variables map[string, ResponsePromptVariableUnion]Optional map of values to substitute in for variables in your prompt. The substitution values can either be strings, or other Response input types like images or files.
-
string -
type ResponseInputText struct{…}A text input to the model.
-
Text stringThe text input to the model.
-
Type InputTextThe type of the input item. Always
input_text.const InputTextInputText InputText = "input_text"
-
PromptCacheBreakpoint ResponseInputTextPromptCacheBreakpointMarks the exact end of a reusable prompt prefix. The breakpoint inherits its TTL from the request's
prompt_cache_options.ttl; the boundary is not rounded to a token block.-
Mode ExplicitThe breakpoint mode. Always
explicit.const ExplicitExplicit Explicit = "explicit"
-
-
-
type ResponseInputImage struct{…}An image input to the model. Learn about image inputs.
-
Detail ResponseInputImageDetailThe detail level of the image to be sent to the model. One of
high,low,auto, ororiginal. Defaults toauto.-
const ResponseInputImageDetailLow ResponseInputImageDetail = "low" -
const ResponseInputImageDetailHigh ResponseInputImageDetail = "high" -
const ResponseInputImageDetailAuto ResponseInputImageDetail = "auto" -
const ResponseInputImageDetailOriginal ResponseInputImageDetail = "original"
-
-
Type InputImageThe type of the input item. Always
input_image.const InputImageInputImage InputImage = "input_image"
-
FileID stringThe ID of the file to be sent to the model.
-
ImageURL stringThe URL of the image to be sent to the model. A fully qualified URL or base64 encoded image in a data URL.
-
PromptCacheBreakpoint ResponseInputImagePromptCacheBreakpointMarks the exact end of a reusable prompt prefix. The breakpoint inherits its TTL from the request's
prompt_cache_options.ttl; the boundary is not rounded to a token block.-
Mode ExplicitThe breakpoint mode. Always
explicit.const ExplicitExplicit Explicit = "explicit"
-
-
-
type ResponseInputFile struct{…}A file input to the model.
-
Type InputFileThe type of the input item. Always
input_file.const InputFileInputFile InputFile = "input_file"
-
Detail ResponseInputFileDetailThe detail level of the file to be sent to the model. Use
autoto let the system select the detail level; for GPT-5.6 and later models,autouses high-quality rendering, which may increase input token usage. Uselowfor lower-cost rendering, orhighto render the file at higher quality. Defaults toauto.-
const ResponseInputFileDetailAuto ResponseInputFileDetail = "auto" -
const ResponseInputFileDetailLow ResponseInputFileDetail = "low" -
const ResponseInputFileDetailHigh ResponseInputFileDetail = "high"
-
-
FileData stringThe content of the file to be sent to the model.
-
FileID stringThe ID of the file to be sent to the model.
-
FileURL stringThe URL of the file to be sent to the model.
-
Filename stringThe name of the file to be sent to the model.
-
PromptCacheBreakpoint ResponseInputFilePromptCacheBreakpointMarks the exact end of a reusable prompt prefix. The breakpoint inherits its TTL from the request's
prompt_cache_options.ttl; the boundary is not rounded to a token block.-
Mode ExplicitThe breakpoint mode. Always
explicit.const ExplicitExplicit Explicit = "explicit"
-
-
-
-
Version stringOptional version of the prompt template.
-
-
Reasoning RealtimeReasoningConfiguration for reasoning-capable Realtime models such as
gpt-realtime-2.-
Effort RealtimeReasoningEffortConstrains effort on reasoning for reasoning-capable Realtime models such as
gpt-realtime-2.-
const RealtimeReasoningEffortMinimal RealtimeReasoningEffort = "minimal" -
const RealtimeReasoningEffortLow RealtimeReasoningEffort = "low" -
const RealtimeReasoningEffortMedium RealtimeReasoningEffort = "medium" -
const RealtimeReasoningEffortHigh RealtimeReasoningEffort = "high" -
const RealtimeReasoningEffortXhigh RealtimeReasoningEffort = "xhigh"
-
-
-
ToolChoice RealtimeSessionCreateResponseToolChoiceUnionHow the model chooses tools. Provide one of the string modes or force a specific function/MCP tool.
-
type ToolChoiceOptions stringControls which (if any) tool is called by the model.
nonemeans the model will not call any tool and instead generates a message.automeans the model can pick between generating a message or calling one or more tools.requiredmeans the model must call one or more tools.-
const ToolChoiceOptionsNone ToolChoiceOptions = "none" -
const ToolChoiceOptionsAuto ToolChoiceOptions = "auto" -
const ToolChoiceOptionsRequired ToolChoiceOptions = "required"
-
-
type ToolChoiceFunction struct{…}Use this option to force the model to call a specific function.
-
Name stringThe name of the function to call.
-
Type FunctionFor function calling, the type is always
function.const FunctionFunction Function = "function"
-
-
type ToolChoiceMcp struct{…}Use this option to force the model to call a specific tool on a remote MCP server.
-
ServerLabel stringThe label of the MCP server to use.
-
Type McpFor MCP tools, the type is always
mcp.const McpMcp Mcp = "mcp"
-
Name stringThe name of the tool to call on the server.
-
-
-
Tools []RealtimeSessionCreateResponseToolUnionTools available to the model.
-
type RealtimeFunctionTool struct{…}-
Description stringThe description of the function, including guidance on when and how to call it, and guidance about what to tell the user when calling (if anything).
-
Name stringThe name of the function.
-
Parameters anyParameters of the function in JSON Schema.
-
Type RealtimeFunctionToolTypeThe type of the tool, i.e.
function.const RealtimeFunctionToolTypeFunction RealtimeFunctionToolType = "function"
-
-
type RealtimeSessionCreateResponseToolMcpTool struct{…}Give the model access to additional tools via remote Model Context Protocol (MCP) servers. Learn more about MCP.
-
ServerLabel stringA label for this MCP server, used to identify it in tool calls.
-
Type McpThe type of the MCP tool. Always
mcp.const McpMcp Mcp = "mcp"
-
AllowedCallers []stringThe tool invocation context(s).
-
const RealtimeSessionCreateResponseToolMcpToolAllowedCallerDirect RealtimeSessionCreateResponseToolMcpToolAllowedCaller = "direct" -
const RealtimeSessionCreateResponseToolMcpToolAllowedCallerProgrammatic RealtimeSessionCreateResponseToolMcpToolAllowedCaller = "programmatic"
-
-
AllowedTools RealtimeSessionCreateResponseToolMcpToolAllowedToolsUnionList of allowed tool names or a filter object.
-
type RealtimeSessionCreateResponseToolMcpToolAllowedToolsMcpAllowedTools []stringA string array of allowed tool names
-
type RealtimeSessionCreateResponseToolMcpToolAllowedToolsMcpToolFilter struct{…}A filter object to specify which tools are allowed.
-
ReadOnly boolIndicates whether or not a tool modifies data or is read-only. If an MCP server is annotated with
readOnlyHint, it will match this filter. -
ToolNames []stringList of allowed tool names.
-
-
-
Authorization stringAn OAuth access token that can be used with a remote MCP server, either with a custom MCP server URL or a service connector. Your application must handle the OAuth authorization flow and provide the token here.
-
ConnectorID stringIdentifier for service connectors, like those available in ChatGPT. One of
server_url,connector_id, ortunnel_idmust be provided. Learn more about service connectors here.Currently supported
connector_idvalues are:-
Dropbox:
connector_dropbox -
Gmail:
connector_gmail -
Google Calendar:
connector_googlecalendar -
Google Drive:
connector_googledrive -
Microsoft Teams:
connector_microsoftteams -
Outlook Calendar:
connector_outlookcalendar -
Outlook Email:
connector_outlookemail -
SharePoint:
connector_sharepoint -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorDropbox RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_dropbox" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorGmail RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_gmail" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorGooglecalendar RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_googlecalendar" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorGoogledrive RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_googledrive" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorMicrosoftteams RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_microsoftteams" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorOutlookcalendar RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_outlookcalendar" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorOutlookemail RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_outlookemail" -
const RealtimeSessionCreateResponseToolMcpToolConnectorIDConnectorSharepoint RealtimeSessionCreateResponseToolMcpToolConnectorID = "connector_sharepoint"
-
-
DeferLoading boolWhether this MCP tool is deferred and discovered via tool search.
-
Headers map[string, string]Optional HTTP headers to send to the MCP server. Use for authentication or other purposes.
-
RequireApproval RealtimeSessionCreateResponseToolMcpToolRequireApprovalUnionSpecify which of the MCP server's tools require approval.
-
type RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalFilter struct{…}Specify which of the MCP server's tools require approval. Can be
always,never, or a filter object associated with tools that require approval.-
Always RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalFilterAlwaysA filter object to specify which tools are allowed.
-
ReadOnly boolIndicates whether or not a tool modifies data or is read-only. If an MCP server is annotated with
readOnlyHint, it will match this filter. -
ToolNames []stringList of allowed tool names.
-
-
Never RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalFilterNeverA filter object to specify which tools are allowed.
-
ReadOnly boolIndicates whether or not a tool modifies data or is read-only. If an MCP server is annotated with
readOnlyHint, it will match this filter. -
ToolNames []stringList of allowed tool names.
-
-
-
type RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalSetting stringSpecify a single approval policy for all tools. One of
alwaysornever. When set toalways, all tools will require approval. When set tonever, all tools will not require approval.-
const RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalSettingAlways RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalSetting = "always" -
const RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalSettingNever RealtimeSessionCreateResponseToolMcpToolRequireApprovalMcpToolApprovalSetting = "never"
-
-
-
ServerDescription stringOptional description of the MCP server, used to provide more context.
-
ServerURL stringThe URL for the MCP server. One of
server_url,connector_id, ortunnel_idmust be provided. -
TunnelID stringThe Secure MCP Tunnel ID to use instead of a direct server URL. One of
server_url,connector_id, ortunnel_idmust be provided.
-
-
-
Tracing RealtimeSessionCreateResponseTracingUnionRealtime API can write session traces to the Traces Dashboard. Set to null to disable tracing. Once tracing is enabled for a session, the configuration cannot be modified.
autowill create a trace for the session with default values for the workflow name, group id, and metadata.-
type Auto stringEnables tracing and sets default values for tracing configuration options. Always
auto.const AutoAuto Auto = "auto"
-
type RealtimeSessionCreateResponseTracingTracingConfiguration struct{…}Granular configuration for tracing.
-
GroupID stringThe group id to attach to this trace to enable filtering and grouping in the Traces Dashboard.
-
Metadata anyThe arbitrary metadata to attach to this trace to enable filtering in the Traces Dashboard.
-
WorkflowName stringThe name of the workflow to attach to this trace. This is used to name the trace in the Traces Dashboard.
-
-
-
Truncation RealtimeTruncationUnionWhen the number of tokens in a conversation exceeds the model's input token limit, the conversation be truncated, meaning messages (starting from the oldest) will not be included in the model's context. A 32k context model with 4,096 max output tokens can only include 28,224 tokens in the context before truncation occurs.
Clients can configure truncation behavior to truncate with a lower max token limit, which is an effective way to control token usage and cost.
Truncation will reduce the number of cached tokens on the next turn (busting the cache), since messages are dropped from the beginning of the context. However, clients can also configure truncation to retain messages up to a fraction of the maximum context size, which will reduce the need for future truncations and thus improve the cache rate.
Truncation can be disabled entirely, which means the server will never truncate but would instead return an error if the conversation exceeds the model's input token limit.
-
type RealtimeTruncationRealtimeTruncationStrategy stringThe truncation strategy to use for the session.
autois the default truncation strategy.disabledwill disable truncation and emit errors when the conversation exceeds the input token limit.-
const RealtimeTruncationRealtimeTruncationStrategyAuto RealtimeTruncationRealtimeTruncationStrategy = "auto" -
const RealtimeTruncationRealtimeTruncationStrategyDisabled RealtimeTruncationRealtimeTruncationStrategy = "disabled"
-
-
type RealtimeTruncationRetentionRatio struct{…}Retain a fraction of the conversation tokens when the conversation exceeds the input token limit. This allows you to amortize truncations across multiple turns, which can help improve cached token usage.
-
RetentionRatio float64Fraction of post-instruction conversation tokens to retain (
0.0-1.0) when the conversation exceeds the input token limit. Setting this to0.8means that messages will be dropped until 80% of the maximum allowed tokens are used. This helps reduce the frequency of truncations and improve cache rates. -
Type RetentionRatioUse retention ratio truncation.
const RetentionRatioRetentionRatio RetentionRatio = "retention_ratio"
-
TokenLimits RealtimeTruncationRetentionRatioTokenLimitsOptional custom token limits for this truncation strategy. If not provided, the model's default token limits will be used.
-
PostInstructions int64Maximum tokens allowed in the conversation after instructions (which including tool definitions). For example, setting this to 5,000 would mean that truncation would occur when the conversation exceeds 5,000 tokens after instructions. This cannot be higher than the model's context window size minus the maximum output tokens.
-
-
-
-
Realtime Transcription Session Create Response
-
type RealtimeTranscriptionSessionCreateResponse struct{…}A Realtime transcription session configuration object.
-
ID stringUnique identifier for the session that looks like
sess_1234567890abcdef. -
Object stringThe object type. Always
realtime.transcription_session. -
Type TranscriptionThe type of session. Always
transcriptionfor transcription sessions.const TranscriptionTranscription Transcription = "transcription"
-
Audio RealtimeTranscriptionSessionCreateResponseAudioConfiguration for input audio for the session.
-
Input RealtimeTranscriptionSessionCreateResponseAudioInput-
Format RealtimeAudioFormatsUnionThe PCM audio format. Only a 24kHz sample rate is supported.
-
type RealtimeAudioFormatsAudioPCM struct{…}The PCM audio format. Only a 24kHz sample rate is supported.
-
Rate int64The sample rate of the audio. Always
24000.const RealtimeAudioFormatsAudioPCMRate24000 RealtimeAudioFormatsAudioPCMRate = 24000
-
Type stringThe audio format. Always
audio/pcm.const RealtimeAudioFormatsAudioPCMTypeAudioPCM RealtimeAudioFormatsAudioPCMType = "audio/pcm"
-
-
type RealtimeAudioFormatsAudioPCMU struct{…}The G.711 μ-law format.
-
Type stringThe audio format. Always
audio/pcmu.const RealtimeAudioFormatsAudioPCMUTypeAudioPCMU RealtimeAudioFormatsAudioPCMUType = "audio/pcmu"
-
-
type RealtimeAudioFormatsAudioPCMA struct{…}The G.711 A-law format.
-
Type stringThe audio format. Always
audio/pcma.const RealtimeAudioFormatsAudioPCMATypeAudioPCMA RealtimeAudioFormatsAudioPCMAType = "audio/pcma"
-
-
-
NoiseReduction RealtimeTranscriptionSessionCreateResponseAudioInputNoiseReductionConfiguration for input audio noise reduction.
-
Type NoiseReductionTypeType of noise reduction.
near_fieldis for close-talking microphones such as headphones,far_fieldis for far-field microphones such as laptop or conference room microphones.-
const NoiseReductionTypeNearField NoiseReductionType = "near_field" -
const NoiseReductionTypeFarField NoiseReductionType = "far_field"
-
-
-
Transcription AudioTranscription-
Delay AudioTranscriptionDelayControls how long the model waits before emitting transcription text. Higher values can improve transcription accuracy at the cost of latency. Only supported with
gpt-realtime-whisperin GA Realtime sessions.-
const AudioTranscriptionDelayMinimal AudioTranscriptionDelay = "minimal" -
const AudioTranscriptionDelayLow AudioTranscriptionDelay = "low" -
const AudioTranscriptionDelayMedium AudioTranscriptionDelay = "medium" -
const AudioTranscriptionDelayHigh AudioTranscriptionDelay = "high" -
const AudioTranscriptionDelayXhigh AudioTranscriptionDelay = "xhigh"
-
-
Language stringThe language of the input audio. Supplying the input language in ISO-639-1 (e.g.
en) format will improve accuracy and latency. -
Model AudioTranscriptionModelThe model to use for transcription. Current options are
whisper-1,gpt-4o-mini-transcribe,gpt-4o-mini-transcribe-2025-12-15,gpt-4o-transcribe,gpt-4o-transcribe-diarize, andgpt-realtime-whisper. Usegpt-4o-transcribe-diarizewhen you need diarization with speaker labels.-
string -
type AudioTranscriptionModel stringThe model to use for transcription. Current options are
whisper-1,gpt-4o-mini-transcribe,gpt-4o-mini-transcribe-2025-12-15,gpt-4o-transcribe,gpt-4o-transcribe-diarize, andgpt-realtime-whisper. Usegpt-4o-transcribe-diarizewhen you need diarization with speaker labels.-
const AudioTranscriptionModelWhisper1 AudioTranscriptionModel = "whisper-1" -
const AudioTranscriptionModelGPT4oMiniTranscribe AudioTranscriptionModel = "gpt-4o-mini-transcribe" -
const AudioTranscriptionModelGPT4oMiniTranscribe2025_12_15 AudioTranscriptionModel = "gpt-4o-mini-transcribe-2025-12-15" -
const AudioTranscriptionModelGPT4oTranscribe AudioTranscriptionModel = "gpt-4o-transcribe" -
const AudioTranscriptionModelGPT4oTranscribeDiarize AudioTranscriptionModel = "gpt-4o-transcribe-diarize" -
const AudioTranscriptionModelGPTRealtimeWhisper AudioTranscriptionModel = "gpt-realtime-whisper"
-
-
-
Prompt stringAn optional text to guide the model's style or continue a previous audio segment. For
whisper-1, the prompt is a list of keywords. Forgpt-4o-transcribemodels (excludinggpt-4o-transcribe-diarize), the prompt is a free text string, for example "expect words related to technology". Prompt is not supported withgpt-realtime-whisperin GA Realtime sessions.
-
-
TurnDetection RealtimeTranscriptionSessionTurnDetectionConfiguration for turn detection. Can be set to
nullto turn off. Server VAD means that the model will detect the start and end of speech based on audio volume and respond at the end of user speech. Forgpt-realtime-whisper, this must benull; VAD is not supported.-
PrefixPaddingMs int64Amount of audio to include before the VAD detected speech (in milliseconds). Defaults to 300ms.
-
SilenceDurationMs int64Duration of silence to detect speech stop (in milliseconds). Defaults to 500ms. With shorter values the model will respond more quickly, but may jump in on short pauses from the user.
-
Threshold float64Activation threshold for VAD (0.0 to 1.0), this defaults to 0.5. A higher threshold will require louder audio to activate the model, and thus might perform better in noisy environments.
-
Type stringType of turn detection, only
server_vadis currently supported.
-
-
-
-
ExpiresAt int64Expiration timestamp for the session, in seconds since epoch.
-
Include []stringAdditional fields to include in server outputs.
-
item.input_audio_transcription.logprobs: Include logprobs for input audio transcription. -
const RealtimeTranscriptionSessionCreateResponseIncludeItemInputAudioTranscriptionLogprobs RealtimeTranscriptionSessionCreateResponseInclude = "item.input_audio_transcription.logprobs"
-
-
Realtime Transcription Session Turn Detection
-
type RealtimeTranscriptionSessionTurnDetection struct{…}Configuration for turn detection. Can be set to
nullto turn off. Server VAD means that the model will detect the start and end of speech based on audio volume and respond at the end of user speech. Forgpt-realtime-whisper, this must benull; VAD is not supported.-
PrefixPaddingMs int64Amount of audio to include before the VAD detected speech (in milliseconds). Defaults to 300ms.
-
SilenceDurationMs int64Duration of silence to detect speech stop (in milliseconds). Defaults to 500ms. With shorter values the model will respond more quickly, but may jump in on short pauses from the user.
-
Threshold float64Activation threshold for VAD (0.0 to 1.0), this defaults to 0.5. A higher threshold will require louder audio to activate the model, and thus might perform better in noisy environments.
-
Type stringType of turn detection, only
server_vadis currently supported.
-