Batches
Create batch
batches.create(**kwargs) -> Batch
post /batches
Create batch
Parameters
-
completion_window: :"24h"The time frame within which the batch should be processed. Currently only
24his supported.:"24h"
-
endpoint: :"/v1/responses" | :"/v1/chat/completions" | :"/v1/embeddings" | 5 moreThe endpoint to be used for all requests in the batch. Currently
/v1/responses,/v1/chat/completions,/v1/embeddings,/v1/completions,/v1/moderations,/v1/images/generations,/v1/images/edits, and/v1/videosare supported. Note that/v1/embeddingsbatches are also restricted to a maximum of 50,000 embedding inputs across all requests in the batch.-
:"/v1/responses" -
:"/v1/chat/completions" -
:"/v1/embeddings" -
:"/v1/completions" -
:"/v1/moderations" -
:"/v1/images/generations" -
:"/v1/images/edits" -
:"/v1/videos"
-
-
input_file_id: StringThe ID of an uploaded file that contains requests for the new batch.
See upload file for how to upload a file.
Your input file must be formatted as a JSONL file, and must be uploaded with the purpose
batch. The file can contain up to 50,000 requests, and can be up to 200 MB in size. -
metadata: MetadataSet of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard.
Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters.
-
output_expires_after: OutputExpiresAfter{ anchor, seconds}The expiration policy for the output and/or error file that are generated for a batch.
-
anchor: :created_atAnchor timestamp after which the expiration policy applies. Supported anchors:
created_at. Note that the anchor is the file creation time, not the time the batch is created.:created_at
-
seconds: IntegerThe number of seconds after the anchor time that the file will expire. Must be between 3600 (1 hour) and 2592000 (30 days).
-
Returns
-
class Batch-
id: String -
completion_window: StringThe time frame within which the batch should be processed.
-
created_at: IntegerThe Unix timestamp (in seconds) for when the batch was created.
-
endpoint: StringThe OpenAI API endpoint used by the batch.
-
input_file_id: StringThe ID of the input file for the batch.
-
object: :batchThe object type, which is always
batch.:batch
-
status: :validating | :failed | :in_progress | 5 moreThe current status of the batch.
-
:validating -
:failed -
:in_progress -
:finalizing -
:completed -
:expired -
:cancelling -
:cancelled
-
-
cancelled_at: IntegerThe Unix timestamp (in seconds) for when the batch was cancelled.
-
cancelling_at: IntegerThe Unix timestamp (in seconds) for when the batch started cancelling.
-
completed_at: IntegerThe Unix timestamp (in seconds) for when the batch was completed.
-
error_file_id: StringThe ID of the file containing the outputs of requests with errors.
-
errors: Errors{ data, object}-
data: Array[untyped] -
object: StringThe object type, which is always
list.
-
-
expired_at: IntegerThe Unix timestamp (in seconds) for when the batch expired.
-
expires_at: IntegerThe Unix timestamp (in seconds) for when the batch will expire.
-
failed_at: IntegerThe Unix timestamp (in seconds) for when the batch failed.
-
finalizing_at: IntegerThe Unix timestamp (in seconds) for when the batch started finalizing.
-
in_progress_at: IntegerThe Unix timestamp (in seconds) for when the batch started processing.
-
metadata: MetadataSet of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard.
Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters.
-
model: StringModel ID used to process the batch, like
gpt-5-2025-08-07. OpenAI offers a wide range of models with different capabilities, performance characteristics, and price points. Refer to the model guide to browse and compare available models. -
output_file_id: StringThe ID of the file containing the outputs of successfully executed requests.
-
request_counts: untyped -
usage: BatchUsageRepresents token usage details including input tokens, output tokens, a breakdown of output tokens, and the total tokens used. Only populated on batches created after September 7, 2025.
-
input_tokens: IntegerThe number of input tokens.
-
input_tokens_details: InputTokensDetails{ cached_tokens}A detailed breakdown of the input tokens.
-
cached_tokens: IntegerThe number of tokens that were retrieved from the cache. More on prompt caching.
-
-
output_tokens: IntegerThe number of output tokens.
-
output_tokens_details: OutputTokensDetails{ reasoning_tokens}A detailed breakdown of the output tokens.
-
reasoning_tokens: IntegerThe number of reasoning tokens.
-
-
total_tokens: IntegerThe total number of tokens used.
-
-
Example
require "openai"
openai = OpenAI::Client.new(api_key: "My API Key")
batch = openai.batches.create(
completion_window: :"24h",
endpoint: :"/v1/responses",
input_file_id: "input_file_id"
)
puts(batch)
Response
{
"id": "id",
"completion_window": "completion_window",
"created_at": 0,
"endpoint": "endpoint",
"input_file_id": "input_file_id",
"object": "batch",
"status": "validating",
"cancelled_at": 0,
"cancelling_at": 0,
"completed_at": 0,
"error_file_id": "error_file_id",
"errors": {
"data": [
{}
],
"object": "object"
},
"expired_at": 0,
"expires_at": 0,
"failed_at": 0,
"finalizing_at": 0,
"in_progress_at": 0,
"metadata": {
"foo": "string"
},
"model": "model",
"output_file_id": "output_file_id",
"request_counts": {},
"usage": {
"input_tokens": 0,
"input_tokens_details": {
"cached_tokens": 0
},
"output_tokens": 0,
"output_tokens_details": {
"reasoning_tokens": 0
},
"total_tokens": 0
}
}
Retrieve batch
batches.retrieve(batch_id) -> Batch
get /batches/{batch_id}
Retrieve batch
Parameters
batch_id: String
Returns
-
class Batch-
id: String -
completion_window: StringThe time frame within which the batch should be processed.
-
created_at: IntegerThe Unix timestamp (in seconds) for when the batch was created.
-
endpoint: StringThe OpenAI API endpoint used by the batch.
-
input_file_id: StringThe ID of the input file for the batch.
-
object: :batchThe object type, which is always
batch.:batch
-
status: :validating | :failed | :in_progress | 5 moreThe current status of the batch.
-
:validating -
:failed -
:in_progress -
:finalizing -
:completed -
:expired -
:cancelling -
:cancelled
-
-
cancelled_at: IntegerThe Unix timestamp (in seconds) for when the batch was cancelled.
-
cancelling_at: IntegerThe Unix timestamp (in seconds) for when the batch started cancelling.
-
completed_at: IntegerThe Unix timestamp (in seconds) for when the batch was completed.
-
error_file_id: StringThe ID of the file containing the outputs of requests with errors.
-
errors: Errors{ data, object}-
data: Array[untyped] -
object: StringThe object type, which is always
list.
-
-
expired_at: IntegerThe Unix timestamp (in seconds) for when the batch expired.
-
expires_at: IntegerThe Unix timestamp (in seconds) for when the batch will expire.
-
failed_at: IntegerThe Unix timestamp (in seconds) for when the batch failed.
-
finalizing_at: IntegerThe Unix timestamp (in seconds) for when the batch started finalizing.
-
in_progress_at: IntegerThe Unix timestamp (in seconds) for when the batch started processing.
-
metadata: MetadataSet of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard.
Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters.
-
model: StringModel ID used to process the batch, like
gpt-5-2025-08-07. OpenAI offers a wide range of models with different capabilities, performance characteristics, and price points. Refer to the model guide to browse and compare available models. -
output_file_id: StringThe ID of the file containing the outputs of successfully executed requests.
-
request_counts: untyped -
usage: BatchUsageRepresents token usage details including input tokens, output tokens, a breakdown of output tokens, and the total tokens used. Only populated on batches created after September 7, 2025.
-
input_tokens: IntegerThe number of input tokens.
-
input_tokens_details: InputTokensDetails{ cached_tokens}A detailed breakdown of the input tokens.
-
cached_tokens: IntegerThe number of tokens that were retrieved from the cache. More on prompt caching.
-
-
output_tokens: IntegerThe number of output tokens.
-
output_tokens_details: OutputTokensDetails{ reasoning_tokens}A detailed breakdown of the output tokens.
-
reasoning_tokens: IntegerThe number of reasoning tokens.
-
-
total_tokens: IntegerThe total number of tokens used.
-
-
Example
require "openai"
openai = OpenAI::Client.new(api_key: "My API Key")
batch = openai.batches.retrieve("batch_id")
puts(batch)
Response
{
"id": "id",
"completion_window": "completion_window",
"created_at": 0,
"endpoint": "endpoint",
"input_file_id": "input_file_id",
"object": "batch",
"status": "validating",
"cancelled_at": 0,
"cancelling_at": 0,
"completed_at": 0,
"error_file_id": "error_file_id",
"errors": {
"data": [
{}
],
"object": "object"
},
"expired_at": 0,
"expires_at": 0,
"failed_at": 0,
"finalizing_at": 0,
"in_progress_at": 0,
"metadata": {
"foo": "string"
},
"model": "model",
"output_file_id": "output_file_id",
"request_counts": {},
"usage": {
"input_tokens": 0,
"input_tokens_details": {
"cached_tokens": 0
},
"output_tokens": 0,
"output_tokens_details": {
"reasoning_tokens": 0
},
"total_tokens": 0
}
}
Cancel batch
batches.cancel(batch_id) -> Batch
post /batches/{batch_id}/cancel
Cancel batch
Parameters
batch_id: String
Returns
-
class Batch-
id: String -
completion_window: StringThe time frame within which the batch should be processed.
-
created_at: IntegerThe Unix timestamp (in seconds) for when the batch was created.
-
endpoint: StringThe OpenAI API endpoint used by the batch.
-
input_file_id: StringThe ID of the input file for the batch.
-
object: :batchThe object type, which is always
batch.:batch
-
status: :validating | :failed | :in_progress | 5 moreThe current status of the batch.
-
:validating -
:failed -
:in_progress -
:finalizing -
:completed -
:expired -
:cancelling -
:cancelled
-
-
cancelled_at: IntegerThe Unix timestamp (in seconds) for when the batch was cancelled.
-
cancelling_at: IntegerThe Unix timestamp (in seconds) for when the batch started cancelling.
-
completed_at: IntegerThe Unix timestamp (in seconds) for when the batch was completed.
-
error_file_id: StringThe ID of the file containing the outputs of requests with errors.
-
errors: Errors{ data, object}-
data: Array[untyped] -
object: StringThe object type, which is always
list.
-
-
expired_at: IntegerThe Unix timestamp (in seconds) for when the batch expired.
-
expires_at: IntegerThe Unix timestamp (in seconds) for when the batch will expire.
-
failed_at: IntegerThe Unix timestamp (in seconds) for when the batch failed.
-
finalizing_at: IntegerThe Unix timestamp (in seconds) for when the batch started finalizing.
-
in_progress_at: IntegerThe Unix timestamp (in seconds) for when the batch started processing.
-
metadata: MetadataSet of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard.
Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters.
-
model: StringModel ID used to process the batch, like
gpt-5-2025-08-07. OpenAI offers a wide range of models with different capabilities, performance characteristics, and price points. Refer to the model guide to browse and compare available models. -
output_file_id: StringThe ID of the file containing the outputs of successfully executed requests.
-
request_counts: untyped -
usage: BatchUsageRepresents token usage details including input tokens, output tokens, a breakdown of output tokens, and the total tokens used. Only populated on batches created after September 7, 2025.
-
input_tokens: IntegerThe number of input tokens.
-
input_tokens_details: InputTokensDetails{ cached_tokens}A detailed breakdown of the input tokens.
-
cached_tokens: IntegerThe number of tokens that were retrieved from the cache. More on prompt caching.
-
-
output_tokens: IntegerThe number of output tokens.
-
output_tokens_details: OutputTokensDetails{ reasoning_tokens}A detailed breakdown of the output tokens.
-
reasoning_tokens: IntegerThe number of reasoning tokens.
-
-
total_tokens: IntegerThe total number of tokens used.
-
-
Example
require "openai"
openai = OpenAI::Client.new(api_key: "My API Key")
batch = openai.batches.cancel("batch_id")
puts(batch)
Response
{
"id": "id",
"completion_window": "completion_window",
"created_at": 0,
"endpoint": "endpoint",
"input_file_id": "input_file_id",
"object": "batch",
"status": "validating",
"cancelled_at": 0,
"cancelling_at": 0,
"completed_at": 0,
"error_file_id": "error_file_id",
"errors": {
"data": [
{}
],
"object": "object"
},
"expired_at": 0,
"expires_at": 0,
"failed_at": 0,
"finalizing_at": 0,
"in_progress_at": 0,
"metadata": {
"foo": "string"
},
"model": "model",
"output_file_id": "output_file_id",
"request_counts": {},
"usage": {
"input_tokens": 0,
"input_tokens_details": {
"cached_tokens": 0
},
"output_tokens": 0,
"output_tokens_details": {
"reasoning_tokens": 0
},
"total_tokens": 0
}
}
List batches
batches.list(**kwargs) -> CursorPage<Batch>
get /batches
List batches
Parameters
-
after: StringA cursor for use in pagination.
afteris an object ID that defines your place in the list. For instance, if you make a list request and receive 100 objects, ending with obj_foo, your subsequent call can include after=obj_foo in order to fetch the next page of the list. -
limit: IntegerA limit on the number of objects to be returned. Limit can range between 1 and 100, and the default is 20.
Returns
-
class Batch-
id: String -
completion_window: StringThe time frame within which the batch should be processed.
-
created_at: IntegerThe Unix timestamp (in seconds) for when the batch was created.
-
endpoint: StringThe OpenAI API endpoint used by the batch.
-
input_file_id: StringThe ID of the input file for the batch.
-
object: :batchThe object type, which is always
batch.:batch
-
status: :validating | :failed | :in_progress | 5 moreThe current status of the batch.
-
:validating -
:failed -
:in_progress -
:finalizing -
:completed -
:expired -
:cancelling -
:cancelled
-
-
cancelled_at: IntegerThe Unix timestamp (in seconds) for when the batch was cancelled.
-
cancelling_at: IntegerThe Unix timestamp (in seconds) for when the batch started cancelling.
-
completed_at: IntegerThe Unix timestamp (in seconds) for when the batch was completed.
-
error_file_id: StringThe ID of the file containing the outputs of requests with errors.
-
errors: Errors{ data, object}-
data: Array[untyped] -
object: StringThe object type, which is always
list.
-
-
expired_at: IntegerThe Unix timestamp (in seconds) for when the batch expired.
-
expires_at: IntegerThe Unix timestamp (in seconds) for when the batch will expire.
-
failed_at: IntegerThe Unix timestamp (in seconds) for when the batch failed.
-
finalizing_at: IntegerThe Unix timestamp (in seconds) for when the batch started finalizing.
-
in_progress_at: IntegerThe Unix timestamp (in seconds) for when the batch started processing.
-
metadata: MetadataSet of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard.
Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters.
-
model: StringModel ID used to process the batch, like
gpt-5-2025-08-07. OpenAI offers a wide range of models with different capabilities, performance characteristics, and price points. Refer to the model guide to browse and compare available models. -
output_file_id: StringThe ID of the file containing the outputs of successfully executed requests.
-
request_counts: untyped -
usage: BatchUsageRepresents token usage details including input tokens, output tokens, a breakdown of output tokens, and the total tokens used. Only populated on batches created after September 7, 2025.
-
input_tokens: IntegerThe number of input tokens.
-
input_tokens_details: InputTokensDetails{ cached_tokens}A detailed breakdown of the input tokens.
-
cached_tokens: IntegerThe number of tokens that were retrieved from the cache. More on prompt caching.
-
-
output_tokens: IntegerThe number of output tokens.
-
output_tokens_details: OutputTokensDetails{ reasoning_tokens}A detailed breakdown of the output tokens.
-
reasoning_tokens: IntegerThe number of reasoning tokens.
-
-
total_tokens: IntegerThe total number of tokens used.
-
-
Example
require "openai"
openai = OpenAI::Client.new(api_key: "My API Key")
page = openai.batches.list
puts(page)
Response
{
"data": [
{
"id": "id",
"completion_window": "completion_window",
"created_at": 0,
"endpoint": "endpoint",
"input_file_id": "input_file_id",
"object": "batch",
"status": "validating",
"cancelled_at": 0,
"cancelling_at": 0,
"completed_at": 0,
"error_file_id": "error_file_id",
"errors": {
"data": [
{}
],
"object": "object"
},
"expired_at": 0,
"expires_at": 0,
"failed_at": 0,
"finalizing_at": 0,
"in_progress_at": 0,
"metadata": {
"foo": "string"
},
"model": "model",
"output_file_id": "output_file_id",
"request_counts": {},
"usage": {
"input_tokens": 0,
"input_tokens_details": {
"cached_tokens": 0
},
"output_tokens": 0,
"output_tokens_details": {
"reasoning_tokens": 0
},
"total_tokens": 0
}
}
],
"has_more": true,
"object": "list",
"first_id": "batch_abc123",
"last_id": "batch_abc456"
}
Domain Types
Batch
-
class Batch-
id: String -
completion_window: StringThe time frame within which the batch should be processed.
-
created_at: IntegerThe Unix timestamp (in seconds) for when the batch was created.
-
endpoint: StringThe OpenAI API endpoint used by the batch.
-
input_file_id: StringThe ID of the input file for the batch.
-
object: :batchThe object type, which is always
batch.:batch
-
status: :validating | :failed | :in_progress | 5 moreThe current status of the batch.
-
:validating -
:failed -
:in_progress -
:finalizing -
:completed -
:expired -
:cancelling -
:cancelled
-
-
cancelled_at: IntegerThe Unix timestamp (in seconds) for when the batch was cancelled.
-
cancelling_at: IntegerThe Unix timestamp (in seconds) for when the batch started cancelling.
-
completed_at: IntegerThe Unix timestamp (in seconds) for when the batch was completed.
-
error_file_id: StringThe ID of the file containing the outputs of requests with errors.
-
errors: Errors{ data, object}-
data: Array[untyped] -
object: StringThe object type, which is always
list.
-
-
expired_at: IntegerThe Unix timestamp (in seconds) for when the batch expired.
-
expires_at: IntegerThe Unix timestamp (in seconds) for when the batch will expire.
-
failed_at: IntegerThe Unix timestamp (in seconds) for when the batch failed.
-
finalizing_at: IntegerThe Unix timestamp (in seconds) for when the batch started finalizing.
-
in_progress_at: IntegerThe Unix timestamp (in seconds) for when the batch started processing.
-
metadata: MetadataSet of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard.
Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters.
-
model: StringModel ID used to process the batch, like
gpt-5-2025-08-07. OpenAI offers a wide range of models with different capabilities, performance characteristics, and price points. Refer to the model guide to browse and compare available models. -
output_file_id: StringThe ID of the file containing the outputs of successfully executed requests.
-
request_counts: untyped -
usage: BatchUsageRepresents token usage details including input tokens, output tokens, a breakdown of output tokens, and the total tokens used. Only populated on batches created after September 7, 2025.
-
input_tokens: IntegerThe number of input tokens.
-
input_tokens_details: InputTokensDetails{ cached_tokens}A detailed breakdown of the input tokens.
-
cached_tokens: IntegerThe number of tokens that were retrieved from the cache. More on prompt caching.
-
-
output_tokens: IntegerThe number of output tokens.
-
output_tokens_details: OutputTokensDetails{ reasoning_tokens}A detailed breakdown of the output tokens.
-
reasoning_tokens: IntegerThe number of reasoning tokens.
-
-
total_tokens: IntegerThe total number of tokens used.
-
-
Batch Error
BatchError = untyped
Batch Request Counts
BatchRequestCounts = untyped
Batch Usage
-
class BatchUsageRepresents token usage details including input tokens, output tokens, a breakdown of output tokens, and the total tokens used. Only populated on batches created after September 7, 2025.
-
input_tokens: IntegerThe number of input tokens.
-
input_tokens_details: InputTokensDetails{ cached_tokens}A detailed breakdown of the input tokens.
-
cached_tokens: IntegerThe number of tokens that were retrieved from the cache. More on prompt caching.
-
-
output_tokens: IntegerThe number of output tokens.
-
output_tokens_details: OutputTokensDetails{ reasoning_tokens}A detailed breakdown of the output tokens.
-
reasoning_tokens: IntegerThe number of reasoning tokens.
-
-
total_tokens: IntegerThe total number of tokens used.
-