Pangram 4.1

Model Description

Pangram 4.1 is an AI detection model released by Pangram Labs on October 19, 2026. It is the successor to Pangram 4, with improvements to overall accuracy and performance under uncertainty.

As with Pangram 4, Pangram 4.1 uses technology detailed in the EditLens technical report.

Inputs

No change from Pangram 4.

Outputs

Pangram 4.1 returns one additional output, class_probabilities, which indicates how sure the model is of each possible label prediction.

Like Pangram 4, Pangram 4.1 returns a sequence of variable-length segments partitioning the analyzed text. The model makes token-level predictions, which it then decodes into one of three labels for each segment: Human, AI-Assisted, or AI-Generated.

Segment-Level Outputs

Unchanged from Pangram 4: text, label, ai_assistance_score, start_index / end_index, word_count / token_length, humanizer_score, is_humanized.

New in Pangram 4.1:

Document-Level Outputs

No change from Pangram 4.

Model Resolution

Slightly improved from Pangram 4. You may occasionally see shorter segments in the detection readout.

Supported Languages

Pangram can work effectively on languages outside the official support set due to generalization. Please contact us to request an evaluation on another language.

Model Training

No change from Pangram 4.

Model Inference

No change from Pangram 4.

Evaluations

Methodology

For evaluation we use the prediction_short field. For binary evaluation datasets, a Mixed prediction counts as an error.

Human Datasets — False Positive Rate by Language

Pangram 4.1's English false positive rate is measured on 781,981 FineWeb examples. From this, we exclude pages that are not natural-language writing, such as spam, advertising and machine-generated listings. We evaluate multilingual false positive rates on pre-2022 subsets of FineWeb2.

Overall False Positive Rate

FineWeb2 False Positive Rate by Supported Language

AI Datasets — False Negative Rate by Language + Generator Model

The English evaluation contains generations from 26 frontier open-source and closed-weight AI models.

Overall False Negative Rate

False Negative Rate by Generator Model

3rd Party Benchmarks

Changes from Pangram 4

• +Predictions are more stable under small edits. Across 29,103 paired edits, the incidence of unintended verdict flips decreases from 1.08% in Pangram 4 to 0.15% in Pangram 4.1.
• +Dashboard UI has changed to reflect less certainty for text under 150 words.

Intended Usage and Limitations

Pangram 4.1 is intended for long-form natural-language writing samples of at least 50 words, written primarily in complete sentences.

There are some kinds of text that we consider out of scope at this time, and for which Pangram can produce less reliable results. These include: code, markup, or Markdown text; tables of contents and reference sections; templated or automated writing; AI translations, such as from Google Translate; instructions, recipes and technical manuals; text dominated by mathematical notation; and figure text like axis labels or tabular data.

Raw text and .docx files are recommended over PDFs when available, as PDF parsing can occasionally introduce unintended artifacts.

Ethics & Safety

False accusations of AI usage can lead to serious consequences, including reputational damage, emotional trauma, and other undue harm.

We acknowledge that our model has a non-zero error rate and its errors may result in such harms. We commit to continuing to engage with our users and the academic community to educate others on appropriately contextualizing and communicating the results of AI detection software.

We take reports of false positives extremely seriously and work to mitigate their occurrences to the best of our team's ability.

We commit to training and releasing models with the lowest possible false positive rate, and improving our evaluations to test and monitor future model releases for regressions.