JOURNAL / AI LITERACY & EVALUATION

Can an AI detector
prove who wrote it?

A detector scores a sample of text. It does not inspect the writing process or produce a verified record of authorship.

A person reviews paperwork beside an open laptop while holding a phone.TEXT / DETECTION & EVIDENCE / SYMPLOKA
SCORES HAVE BOUNDARIES

A detector sees a sample. Authorship is a larger question.

Text scoring can identify patterns in a test. Drafts, source history, disclosure, and context answer different questions.

01 / WHAT A DETECTOR MEASURES

A score describes one method applied to one sample.

AI text detectors analyze a passage and classify or rank it against patterns their method was built to recognize. Tools can use different models, features, thresholds, and reference data. Watermark detection is a distinct approach that depends on a compatible mark being present.

The result tells you what the detector estimated for the submitted text. It does not show who typed, edited, or approved it, and it cannot reconstruct the path from a first draft to a final version.

Research also examines watermarking: a generator deliberately changes token selection to embed a detectable signal. That method needs a compatible generator and can be affected by how the text is edited. It is different from a classifier trained to recognize text patterns.

A text detector and a plagiarism checker also answer different questions. Similarity software looks for matching passages in a comparison collection; a detector estimates whether text resembles its tested examples. Neither result alone establishes how a piece of writing was produced.

02 / PERFORMANCE DEPENDS ON THE TEST

A benchmark can show capability without proving universal reliability.

NIST’s 2025 text-to-text pilot evaluated human and generated summaries against source articles across several rounds. Results varied substantially between generator and detector systems: some generators confused most tested detectors, while some detectors distinguished outputs from nearly all tested generators. The systems also improved over the rounds.

That is useful evidence about the measured task. It does not establish the accuracy of every detector on essays, short messages, other languages, edited passages, or future models. The test conditions are part of the result.

Earlier evaluations also found uneven performance and errors when human writing was translated or generated text was edited. Read the peer-reviewed evaluation by Weber-Wulff and colleagues ↗.

03 / FALSE POSITIVES & FAIRNESS

A detector can misread a person’s writing as generated.

A 2023 study tested several GPT detectors on English writing by native and non-native speakers. In the study’s sample, non-native English writing was more often misclassified as AI-generated. The researchers also found that simple changes to prompts could affect detection. These findings describe the detectors and texts they tested; they are a reason to test a system for bias, not a universal performance estimate for every current tool.

When a result may affect a student, applicant, employee, or creator, a false positive carries a real cost. The person should be able to see how the conclusion was reached, provide context, and challenge an automated flag.

Read the study on detector bias ↗

04 / A SCORE IS NOT A PROBABILITY OF AUTHORSHIP

The same detector can mean different things in different settings.

A score is often mistaken for “the chance this person used AI.” But the chance that a flagged passage is generated also depends on how common generated text is in the group being checked, and on how often the detector flags human writing. A test score does not supply those facts by itself.

Consider an illustrative example, not results from any product: if 5% of 1,000 texts were generated, a detector that caught 80% of them would flag 40 generated texts. If it also falsely flagged 5% of the 950 human texts, that would add about 48 false flags. In this example, most flagged texts would be human-written.

The lesson is to ask how the detector was tested, what population its scores describe, and how its threshold trades missed cases against false alarms. A single percentage without that context is easy to overread.

05 / USE EVIDENCE THAT FITS THE QUESTION

For authorship, look for process and provenance.

  1. Define the question. Distinguish “does this sample resemble the detector’s examples?” from “who wrote this?” or “was a rule broken?”
  2. Check the work’s context. Review relevant drafts, source material, edit history, and the rules the writer was given, where those records are available.
  3. Ask the writer. Give the person a fair chance to explain their process and respond to concerns.
  4. Keep detector output in proportion. If a tool is used, treat it as a limited screening signal inside a review process—not as a verdict.
  5. State uncertainty. If the available evidence cannot establish what happened, say so.

For teams evaluating a detector, test it on the languages, genres, lengths, and editing patterns they actually encounter. Measure false positives and false negatives, check subgroup performance, and repeat the evaluation as models and workflows change.

QUICK ANSWERS

What detector scores can—and cannot—settle.

Can an AI detector be accurate?Some can perform well on a defined benchmark. Results depend on the detector, text, population, and test setup.
Can it prove who wrote a text?No. A classification is not a record of authorship, intent, or the writing process.
Can a human be flagged by mistake?Yes. Published studies report false positives and differences across language groups.
What should I check first?Read the method, test population, error rates, and review process behind the score.
RESEARCH & REFERENCESNIST, 2024 GenAI Pilot Study: Text-to-Text Evaluation Overview and Results (2025) ↗Weber-Wulff et al., Testing of detection tools for AI-generated text (2023) ↗Liang et al., GPT detectors are biased against non-native English writers (2023) ↗Sadasivan et al., Can AI-Generated Text be Reliably Detected? ↗Research code: Reliability of AI-text detectors ↗NIST Generative AI evaluation program ↗