arXiv:2611.08704v1 Announce Type: new Abstract: As AI-generated content spreads into nearly every domain of human interaction, practices and discourses of AI detection, both formal and informal, have become an everyday part of how people interact with text and with each other. In this paper, we explore the real-world practices and discourses of AI identification that have emerged in response to a shifting discursive landscape where the human provenance of a text can no longer be taken for granted. We pair qualitative coding with computational analysis of lexical change, grounded in linguistic anthropological perspectives on language and communication, to investigate AI identifications among English Wikipedia editors and students. We find that these identifications draw on a diversity of evidentiary types, from discrete textual features and judgments about content to circular sense-making claims and presumptions about the author's moral character, and that they are contradictory, dynamic, and contextually dependent. In practice, what often motivates an AI identification is not the presence of any specific textual element, but pragmatic infelicity: a perceived mismatch between the elements present and those deemed appropriate within the text's particular context. Consequently, real-world identifications of AI-generated writing do not merely neutrally point out the perceived presence of "AI-like" features, but can be leveraged as a discursive resource to maintain and define sociolinguistic norms: what can be said in a given context, what is appropriate, and, ultimately, what is human. Further, the design and implementation of systems and tools that treat AI-likeness as a context-free property of text may therefore inherit, and enforce at scale, the norms of whichever contexts they were trained on.
Contextuality and Contradictions: Exploring Real-World Identifications of AI-Generated Writing
A paper posted to arXiv (2611.08704v1) by researchers studying English Wikipedia editors and students finds that real-world identifications of AI-generated writing rest less on specific textual features than on "pragmatic infelicity" — a perceived mismatch between what a text contains and what its context deems appropriate. The authors, who paired qualitative coding with computational analysis of lexical change, report that such identifications draw on diverse evidence, including judgments about content and presumptions about an author's moral character, and are contradictory, dynamic and contextually dependent. They warn that detection systems treating AI-likeness as a context-free property of text may inherit and enforce at scale the norms of whichever contexts they were trained on.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.