Why does Pangram have a minimum word count?

Pangram’s text model is the most accurate AI detector on the market. However, we require at least 50 words to give a prediction. Why is that?

Let’s take the word delve. Statistics in our datasets show that the word “delve” was used nearly 15 times more often in AI writing than human writing. But on its own, delve could be written by anyone. I, a human (promise) just wrote it there: delve!

Pangram’s model is capable of understanding this difference. In fact, it not only focuses on which words in a given text and more on the context in which words are used.

How this works

For example, I just wrote this sentence that contains the word delve, but Pangram labels human:

"I am actually super excited to read the Great Gatsby! I’ve been told that the Great Gatsby is one of the most popular American books of all time, and for that reason, I'm actually very interested in the opportunity to delve into this novel. My parents, teachers and friends have raved about it, and I trust them a lot!"

Pangram Detected Human

Pangram says it is strongly confident the text is human written.

Next, I asked ChatGPT to write a few sentences about why it’s excited to read the Great Gatsby (and include the word delve). Here’s what it wrote

"I'm excited to read The Great Gatsby because it offers a chance to delve into the glamour and disillusionment of the Roaring Twenties. I'm curious about how Fitzgerald portrays ambition, love, and the American Dream through such iconic characters. I'm especially eager to experience the lyrical writing and uncover the deeper meanings behind Gatsby’s mysterious life."

Pangram Detected AI

Here, Pangram says it is strongly confident the text is AI.

Of course, there are many differences between these texts that are used by Pangram’s model to determine if it’s AI or human. Both of these samples use the common AI word delve, but the context about how and when the word is used is critical. If Pangram only could see the few words around “delve”, we wouldn’t be able to tell. Could you?

“a chance to delve into the”

“opportunity to delve into this”

What we do about it

Because of the need for context, Pangram enforces a minimum length of 50 words. This ensures that the model has enough context to make a prediction that you can trust.

Interested in learning more about our model, accuracy, and performance? Check out this page!