OpenAI

OpenAI Provider

Use ArtemisKit with OpenAI’s GPT models.

Setup

1. Get API Key

Get your API key from the OpenAI Dashboard.

2. Set Environment Variable

export OPENAI_API_KEY="sk-..."

3. Configure Scenario

name: my-test
provider: openai
model: gpt-5

cases:
  - id: example
    prompt: "Hello"
    expected:
      type: contains
      values: ["hello"]
      mode: any

Available Models

Model	Description
`gpt-5`	Latest flagship model
`gpt-4o`	Multimodal, versatile
`gpt-4o-mini`	Fast and cost-effective
`gpt-4.1`	Coding specialist, 1M context
`o3`	Advanced reasoning model
`o4-mini`	Fast reasoning model

Config File

Configure OpenAI in your artemis.config.yaml:

provider: openai
model: gpt-5

providers:
  openai:
    apiKey: ${OPENAI_API_KEY}
    organization: ${OPENAI_ORG_ID}  # Optional
    timeout: 60000
    maxRetries: 2

Scenario-Level Options

Override settings in your scenario file:

name: my-test
provider: openai
model: gpt-5
temperature: 0
seed: 42
maxTokens: 1000

cases:
  - id: example
    prompt: "Hello"
    expected:
      type: contains
      values: ["hello"]
      mode: any

Organization ID

If you belong to multiple organizations:

export OPENAI_ORG_ID="org-..."

Or in your config:

providers:
  openai:
    apiKey: ${OPENAI_API_KEY}
    organization: ${OPENAI_ORG_ID}