Skip to content
ArtemisKit ArtemisKit

API Overview

ArtemisKit Core API

Section titled “ArtemisKit Core API”

The ArtemisKit Core library allows you to embed LLM evaluation directly in your code.

Use Cases

Section titled “Use Cases”
  • Test frameworks — Integrate with Jest, Vitest, or Mocha
  • Custom tooling — Build your own evaluation pipelines
  • Programmatic control — Fine-grained configuration

Preview

Section titled “Preview”
import { Evaluator, createProvider } from '@artemiskit/core';


const provider = createProvider('openai', {
  apiKey: process.env.OPENAI_API_KEY,
  model: 'gpt-5',
});


const evaluator = new Evaluator({ provider });


const result = await evaluator.runCase({
  id: 'math-test',
  prompt: 'What is 2+2?',
  expected: {
    type: 'contains',
    values: ['4'],
    mode: 'any',
  },
});


console.log(result.passed); // true

Jest Integration (Preview)

Section titled “Jest Integration (Preview)”
import { createMatcher } from '@artemiskit/jest';


const evaluateLLM = createMatcher({
  provider: 'openai',
  model: 'gpt-5',
});


describe('Chatbot', () => {
  it('answers math questions', async () => {
    const response = await chatbot.ask('What is 2+2?');
    await expect(response).toPassEvaluation({
      type: 'contains',
      values: ['4'],
      mode: 'any',
    });
  });
});

Stay Updated

Section titled “Stay Updated”

Join the waitlist to be notified when the API is released.

See Also

Section titled “See Also”