Here's a quick summary
Out of 2,341 prompts, Pangram 4.1 achieves an accuracy of 98.72% on Gemini 4 Argon outputs on high reasoning, and an accuracy of 99.31% on medium reasoning, for a total accuracy of 99.02% across both settings.
Gemini 4 Argon is Google’s latest AI model, released October 13, 2026. Google claims that Gemini 4 Argon was built for complex, multistep tasks rather than chat, and that it writes in a straightforward manner and hedges less often than its predecessors.
With these writing style changes, does Pangram still detect it? We tested Pangram 4.1’s performance on 2,341 example prompts and found that Pangram 4.1 classified 16 Gemini 4 Argon outputs as human, 7 as mixed, and 2,318 as fully AI-generated, achieving an accuracy of 99.02% on Gemini 4 Argon.
| Model | Examples | Detection rate |
|---|---|---|
| Gemini 4 Argon (high reasoning) | 1,174 | 98.72% |
| Gemini 4 Argon (medium reasoning) | 1,167 | 99.31% |
To generate the benchmark set, we used 1,200 first-turn prompts from the LMSYS-Chat-1M dataset (Zheng et al., 2023). Then we gave those to Gemini 4 Argon on medium and high reasoning and ran the output through Pangram 4.1.
Results by category
Overall, Gemini 4 Argon had a false negative rate of 1.28% out of 1,174 responses on high reasoning, and a false negative rate of 0.69% out of 1,167 responses on medium reasoning. Overall, there was not a significant difference in detection rate between medium and high reasoning (p=0.21).
High reasoning
When Gemini 4 Argon was set to high reasoning, Pangram 4.1 categorized 11 responses as human, 4 as mixed, and 1,159 as fully AI, achieving a recall rate of 98.72%.
| Category | n | AI | Mixed | Human |
|---|---|---|---|---|
| Arguments | 70 | 70 | 0 | 0 |
| Emails / letters | 60 | 58 | 0 | 2 |
| Essays / articles | 139 | 138 | 0 | 1 |
| Explanations | 495 | 493 | 1 | 1 |
| Poems and other creative writing | 108 | 105 | 0 | 3 |
| Reviews | 2 | 2 | 0 | 0 |
| Stories | 90 | 90 | 0 | 0 |
| Code and math | 9 | 9 | 0 | 0 |
| Role-play and games | 60 | 59 | 0 | 1 |
| Other | 141 | 135 | 3 | 3 |
| Total | 1,174 | 1,159 | 4 | 11 |
Medium reasoning
On medium reasoning, Pangram 4.1 categorized 5 responses as human, 3 as mixed, and 1,159 as fully AI, achieving a recall rate of 99.31%.
| Category | n | AI | Mixed | Human |
|---|---|---|---|---|
| Arguments | 71 | 71 | 0 | 0 |
| Emails / letters | 60 | 60 | 0 | 0 |
| Essays / articles | 138 | 137 | 0 | 1 |
| Explanations | 495 | 492 | 0 | 3 |
| Poems and other creative writing | 108 | 108 | 0 | 0 |
| Reviews | 2 | 2 | 0 | 0 |
| Stories | 84 | 84 | 0 | 0 |
| Code and math | 9 | 9 | 0 | 0 |
| Role-play and games | 60 | 60 | 0 | 0 |
| Other | 140 | 136 | 3 | 1 |
| Total | 1,167 | 1,159 | 3 | 5 |
How does Gemini 4 Argon write?
Google asserts that Gemini 4 Argon hedges less and speaks more directly. For a rough test of this, we look at a set of 101 hedge words sourced from Hyland (2005), and compared the occurrence of those words to the occurrence in Haiku (7.0 per 1,000 words) and GPT-6.1 Sol (7.5 per 1,000 words).
Below is the list of hedge words we used:
about, almost, apparent, apparently, appear, appeared, appears, approximately, argue, argued, argues, around, assume, assumed, broadly, certain amount, certain extent, certain level, claim, claimed, claims, could, couldn't, doubt, doubtful, essentially, estimate, estimated, fairly, feel, feels, felt, frequently, from my perspective, from our perspective, from this perspective, generally, guess, indicate, indicated, indicates, in general, in most cases, in most instances, in my opinion, in my view, in this view, in our opinion, in our view, largely, likely, mainly, may, maybe, might, mostly, often, on the whole, ought, perhaps, plausible, plausibly, possible, possibly, postulate, postulated, postulates, presumable, presumably, probable, probably, quite, rather x, relatively, roughly, seems, should, sometimes, somewhat, suggest, suggested, suggests, suppose, supposed, supposes, suspect, suspects, tend to, tended to, tends to, to my knowledge, typical, typically, uncertain, uncertainly, unclear, unclearly, unlikely, usually, would, wouldn'tGemini 4 Argon used hedges 51% less than Haiku and 54% less than Sol when measured per 1,000 words. Funnily enough, even though models in general tend to use hedge words much more frequently than humans do, this list of words is detected as fully human by Pangram 4.1. For fun, I also asked ChatGPT to rearrange this list in any order it would like, and that list was also detected as fully human.
Gemini 4 Argon had the longest answers of those three models, with a median of 447 words (medium reasoning 418 words, high reasoning 447 words) compared to 371 for Haiku and 313 for Sol. Gemini also refused to answer 31 prompts across all 2,400 requests, plus 3 requests that were blocked by Google’s filter, compared to 35 refusals for Haiku and 23 for Sol.
Earlier benchmarks
Pangram is robust to Gemini 4 Argon on natural language prompts, and detects it with an observed accuracy of 98.72% on high reasoning. It detects Gemini 4 Argon on medium reasoning with an observed accuracy of 99.31%, for a combined 2,318 out of 2,341 (99.02%) across both settings. Pangram is able to generalize to new models because new model releases tend to inherit much of their predecessors' style and voice, so Pangram doesn't need to be retrained for every new release.
Here's how Gemini 4 Argon compares to our benchmarks of other recent frontier models:
| Model | Detected as AI | Accuracy |
|---|---|---|
| Claude Haiku 5.5 (high reasoning) | 1,179/1,183 | 99.66% |
| GPT-6.1 Sol (high reasoning) | 1,091/1,105 | 98.73% |
| Gemini 3.8 Flash | 998/1,000 | 99.80% |
| Gemini 3.1 Pro | 997/1,000 | 99.70% |
| Claude Sonnet 5.5 | 1,019/1,022 | 99.71% |
| Claude Opus 5.5 | 997/1,000 | 99.70% |
| GPT-6 Astra | 982/986 | 99.59% |
| Fable 5.1 | 1,093/1,097 | 99.64% |
| Claude Opus 5 | 1,105/1,107 | 99.82% |
| GPT-5.6 | 3,408/3,423 | 99.56% |
| Claude Sonnet 5 | 1,145/1,147 | 99.83% |
If you want to check a specific document, you can try Pangram here.


Katherine Thai is the Founding AI Research Scientist at Pangram Labs, an AI detection startup. She completed her PhD in Computer Science under the supervision of Mohit Iyyer at the University of Massachusetts Amherst in December 2025, where her work was focused on evaluating LLMs on tasks related to literary analysis.
Related reading

Can Pangram detect GPT-6.1 Sol?

Pangram’s performance on undergraduate and graduate student essays

Which AI Detector Is Most Accurate? 30 Tools Tested (2026)

How to spot AI reviews

How does Pangram compare against GPTZero?
