Invoice Data Extraction

ExtractionDifficulty: MEDIUM11 models comparedTotal cost: $0.002956

Prompt

Extract the following fields as JSON: {vendor, invoice_number, date, total, currency}

INVOICE #INV-2024-0847
From: CloudServe Inc.
Date: March 15, 2024
Items:
  - Compute instances (3x m5.xlarge): $1,247.50
  - Storage (2TB S3): $46.00
  - Data transfer: $89.30
Subtotal: $1,382.80
Tax (8.5%): $117.54
Total: $1,500.34 USD

Expected Output

{"vendor": "CloudServe Inc.", "invoice_number": "INV-2024-0847", "date": "2024-03-15", "total": 1500.34, "currency": "USD"}

Model Responses

Claude Opus 4.6

Unrated

2,929ms211 tokens

```json
{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "March 15, 2024",
  "total": 1500.34,
  "currency": "USD"
}
```

GPT-4.1

Unrated

1,003ms182 tokens

{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "2024-03-15",
  "total": 1500.34,
  "currency": "USD"
}

GPT-4.1 Mini

Unrated

1,822ms187 tokens

```json
{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "March 15, 2024",
  "total": 1500.34,
  "currency": "USD"
}
```

GPT-4.1 Nano

Unrated

728ms187 tokens

```json
{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "March 15, 2024",
  "total": "1500.34",
  "currency": "USD"
}
```

o3

Unrated

2,037ms264 tokens

{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "March 15, 2024",
  "total": 1500.34,
  "currency": "USD"
}

o3 Mini

Unrated

2,568ms387 tokens

{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "March 15, 2024",
  "total": 1500.34,
  "currency": "USD"
}

o4 Mini

Unrated

5,500ms456 tokens

{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "March 15, 2024",
  "total": 1500.34,
  "currency": "USD"
}

GPT-4o Mini

Unrated

2,113ms187 tokens$0.000055

```json
{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "March 15, 2024",
  "total": 1500.34,
  "currency": "USD"
}
```

Claude Haiku 4.5

Unrated

769ms211 tokens$0.000499

```json
{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "March 15, 2024",
  "total": 1500.34,
  "currency": "USD"
}
```

GPT-4o

Unrated

1,960ms188 tokens$0.000920

```json
{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "March 15, 2024",
  "total": "1,500.34",
  "currency": "USD"
}
```

Claude Sonnet 4.6

Unrated

1,282ms210 tokens$0.001482

```json
{
  "vendor": "CloudServe Inc.",
  "invoice_number": "INV-2024-0847",
  "date": "2024-03-15",
  "total": 1500.34,
  "currency": "USD"
}
```

Cost & Performance Comparison

Model	Latency	Tokens	Cost	Verdict
Claude Opus 4.6	2,929ms	211	—	—
GPT-4.1	1,003ms	182	—	—
GPT-4.1 Mini	1,822ms	187	—	—
GPT-4.1 Nano	728ms	187	—	—
o3	2,037ms	264	—	—
o3 Mini	2,568ms	387	—	—
o4 Mini	5,500ms	456	—	—
GPT-4o Mini	2,113ms	187	$0.000055	—
Claude Haiku 4.5	769ms	211	$0.000499	—
GPT-4o	1,960ms	188	$0.000920	—
Claude Sonnet 4.6	1,282ms	210	$0.001482	—