Study finds real-world AI identification practices rely on context-dependent norms rather than fixed textual features
Qualitative and computational analysis of Wikipedia editors and students shows AI-likeness judgments are contradictory, dynamic, and tied to sociolinguistic appropriateness.
1 source · cross-referenced
- AI detection practices among Wikipedia editors and students are context-dependent and contradictory, often relying on pragmatic infelicity rather than fixed textual features.
A new arXiv preprint examines how people identify AI-generated writing in real-world settings, analyzing practices among English Wikipedia editors and students. The study combines qualitative coding with computational analysis of lexical change, grounded in linguistic anthropology, to show that AI identifications are not based on consistent textual markers but on perceived mismatches between content and context—what the authors term pragmatic infelicity.
The authors report that judgments of AI-likeness draw on diverse and often contradictory evidentiary types, including discrete textual features, content judgments, circular reasoning, and assumptions about authors’ moral character. These identifications are dynamic and contextually dependent, meaning what counts as "AI-like" shifts with the norms of a given setting.
The paper argues that tools treating AI-likeness as a context-free property risk inheriting and scaling the norms of the contexts they were trained on, potentially enforcing those norms at scale. This raises concerns about how AI detection systems might embed and propagate sociolinguistic biases, shaping not just what is detected as AI-generated but what is deemed appropriate or human in different discourse communities.
- Nov 11, 2026 · The Verge — AI
Google DeepMind unveils AlphaGenome 2 to predict genetic variant effects on cell types
Trust79 - Nov 11, 2026 · Google DeepMind — Blog
Google DeepMind unveils AlphaGenome 2 to predict DNA variant effects in specific cell types
Trust84 - Nov 11, 2026 · arXiv cs.AI
Researchers demonstrate auditable human-agent teams for autonomous synchrotron X-ray experiments
Trust79