Skip to main content

Detect AI in images and videos with Pangram Image 1.0. Try it out

Case Studies

Can Pangram detect Claude Haiku 5.5?

Nov 2, 2026

Here's a quick summary


Out of 2,372 prompts, Pangram 4.1 achieves an accuracy of 99.66% on Claude Haiku 5.5 outputs on high reasoning, and an accuracy of 99.75% on medium reasoning, for a total accuracy of 99.70% across both settings.

Claude Haiku 5.5 was released by Anthropic on October 7th, 2026, following the earlier release of the other models in this series, Sonnet 5.5 and Opus 5.5. Haiku is a very inexpensive little model, and generally isn’t used for writing tasks, instead being pitched for use generating summaries, classification, database querying, or fast customer support. But we will benchmark it anyway!

Haiku 5.5 is the first Haiku model with varying effort levels, so we tested with both high reasoning and medium reasoning. On 2,372 example prompts, Pangram 4.1 classified 1 Haiku 5.5 output as human, 6 as mixed, and 2,365 as fully AI-generated, achieving an accuracy of 99.70% on Haiku 5.5.

ModelExamplesDetection rate
Claude Haiku 5.5 (high reasoning)1,18399.66%
Claude Haiku 5.5 (medium reasoning)1,18999.75%

To generate the benchmark set, we used 1,200 first-turn prompts from the LMSYS-Chat-1M dataset (Zheng et al., 2023). Then we gave those to Haiku 5.5 on medium and high reasoning and ran the output through Pangram 4.1.

Results by category

Overall, Pangram did very well on Haiku 5.5 on both high reasoning and medium reasoning. There was not a significant difference in detection rate between medium and high reasoning (p=0.73).

High reasoning

When Haiku 5.5 was set to high reasoning, Pangram 4.1 categorized 0 responses as human, 4 as mixed, and 1,179 as fully AI, achieving a recall rate of 99.66%.

CategoryExamplesAIMixedHuman
Arguments707000
Emails / letters606000
Essays / articles13913900
Explanations49549410
Poems and other creative writing10710610
Reviews2200
Stories979700
Code and math101000
Role-play and games606000
Other14314120
Total1,1831,17940

Medium reasoning

On medium reasoning, Pangram 4.1 categorized 1 response as human, 2 as mixed, and 1,186 as fully AI, achieving a recall rate of 99.75%.

CategoryExamplesAIMixedHuman
Arguments707000
Emails / letters606000
Essays / articles13913810
Explanations49649411
Poems and other creative writing10910900
Reviews2200
Stories979700
Code and math101000
Role-play and games616100
Other14514500
Total1,1891,18621

How does Haiku 5.5 write?

Like GPT-6.1 Sol, Haiku 5.5 has a shortlist of names it prefers for fiction. Haiku 5.5 liked Maya, Ruth, and Mara in particular. Unlike GPT-6.1 Sol and Gemini 4 Argon, Haiku 5.5 doesn’t use em dashes, using an em dash only twice across all replies (both times in response to the same prompt, to cut off a line of dialogue). Haiku 5.5 also doesn’t like writing ranges with an en dash — instead of writing “5–10,” Haiku 5.5 almost always writes “5 to 10”.

Earlier benchmarks

Pangram is robust to Haiku 5.5 on natural language prompts, and detects it with an observed accuracy of 99.66% on high reasoning. It detects Haiku 5.5 on medium reasoning with an observed accuracy of 99.75%, for a combined 2,365 out of 2,372 (99.70%) across both settings. Pangram is able to generalize to new models because new model releases tend to inherit much of their predecessors' style and voice, so Pangram doesn't need to be retrained for every new release.

Here's how Haiku 5.5 compares to our benchmarks of other recent frontier models:

ModelDetected as AIAccuracy
GPT-6.1 Sol1,091/1,10598.73%
Gemini 4 Argon1,159/1,17498.72%
Gemini 3.8 Flash998/1,00099.80%
Gemini 3.1 Pro997/1,00099.70%
Claude Sonnet 5.51,019/1,02299.71%
Claude Opus 5.5997/1,00099.70%
GPT-6 Astra982/98699.59%
Fable 5.11,093/1,09799.64%
Claude Opus 51,105/1,10799.82%
GPT-5.63,408/3,42399.56%
Claude Sonnet 51,145/1,14799.83%

If you want to check a specific document, you can try Pangram here.


Annamieka Aerts

Annamieka is a technical writer at Pangram.

More from Annamieka Aerts