{"slug": "lab-policy-on-ai-in-writing-and-communication", "title": "Lab Policy on AI in Writing and Communication", "summary": "A university lab has issued a policy requiring all paper first drafts to be written without AI and mandating that lab members be able to answer a first follow-up question about their work without consulting an AI assistant. The policy, which applies to all lab writing and communication, aims to preserve thinking and communication skills and prevent the anchoring effect of AI-generated text.", "body_md": "# Lab Policy on AI in Writing & Communication\n\nWriting and verbal communication are core research skills we need to practice. All paper first drafts must be written without AI. Lab communication must follow the first-follow-up rule: lab members should know enough details about the code, experiments, and presentations they give to answer a reasonable first follow-up question from a labmate without checking with their AI assistant.\n\nThis document contains the expectations for my lab group for the use of AI in writing and communicating about research. I'm writing these policies in part to help guide my students, and in part to discuss some of the underlying issues about thinking. This policy may change in the future as we discuss and adapt as a lab.\n\n## Policy Points\n\nThese expectations have scope over all writing and communication in the lab: writing papers, presentations in lab meetings, weekly 1:1s, slack updates, etc.\n\n[Write the first draft without AI.](#human-first-draft)[Be ready for the first follow-up.](#ready-for-follow-up)[Obey Grice's maxims of Quantity and Quality even when your agents don't.](#maxim-of-quality)[Be in charge of your technical terms.](#control-technical-terms)\n\n## Motivating Context\n\nI use AI agents throughout my work, especially in coding.\nThey allow me to get more done than I'd otherwise be able to.\nHowever, our skills atrophy when they are not used, or worse, we never develop them at all.\nAs such, I'm concerned about getting my own use of AI *right* somehow, and even more concerned about instilling good practices in my students.\nIt's possible that some skills I love—like mucking with tensors and thinking about neural architectures—will be less necessary in the future.\nBut communicating and clear thinking will always be necessary.\n\nI'm increasingly presented with AI-generated writing, especially by potential new lab members, junior students, etc.\nIn technical writing and thinking, it is very easy, and very low-value, to **seem** to know or communicate something.\nIt is very hard, and very high-value, to actually precisely know and communicate something.\n\nI don't expect students to go without AI agent use in general, and especially in coding, I expect them to use agents. However, in writing and communication, for the time being at least I've decided the lab needs somewhat strict standards to empower us to think clearly and communicate well.\n\n## Policies in Detail\n\n### Write the first draft without AI.\n\nFor each piece of writing, from blog posts to papers to tweets to slack messages, the first draft must always be written by a human. 1\nWriting is thinking and helps clarify one's understanding. Further, empirically, the anchoring effect of AI writing is too strong, even if a human provides substantial edits afterward.\n\nThe human first draft is also very helpful for ensuring that students know the math they're presenting. It's often not until I write up math in LaTeX for the first time that I realize some detail I'd been glossing over in my head or as I take scratch notes about the idea. If a model generates the math from the code that was vibecoded, those potentially critical details are just never interrogated. If the lab member writes out the math and then looks at the code and it implements something different, then it's a great find of a potential bug or miscommunication!\n\n### Be ready for the first follow-up.\n\nA lab member must be ready to answer a first follow-up question from a lab member (including me) about the work they're presenting, without referencing their AI assistant.\n\nOf course, there are questions I can't answer about my code or research.\nWhen does garbage collection happen in the Python code that runs my model?\nInteresting question. I have no idea; I've given up on that level of knowledge of my code.\nThis point of policy handles this concern nicely, however—I don't have to be able to answer *any* question about the experiments I've run, just those that my (reasonable, cooperative) labmates are genuinely curious about.\nAs a lab (and, starting with me,) we set the expectations for what kinds of details are critical to our research and what we expect each other to know.\nIt takes time to understand what follow-up questions are; this is part of the process of learning in the lab.\nSo, junior students are given time to figure out these conventions.\n\nWe say *first* follow-up because in the course of an in-depth conversation about an experiment, we may tackle increasingly nuanced questions that we might not have even thought about at first, in which case we may attend back to our code and the agents that helped us generate it.\n\n### Obey Grice's maxims of Quantity and Quality even when your agents don't.\n\nIn cooperative communication, Grice's maxim of Quantity states that a cooperative speaker modulates the amount of information given to what they believe the other speaker needs. (No extra information, and no missing details.)\nCurrent agents conspicuously don't do this.\nThey focus on small details that the user pointed out (*Ok, here's the Properly Weight Decayed Experiment* — using weight decay properly is assumed in our conversation, unless it's been a topic of previous discussion.)\nThey also omit critical aspects, like perhaps what the maximum thinking trace length was (an agent might set a “reasonable maximum” of 500 tokens, but we know for our purposes that we need thousands.)\nModels tend to over-explain, and this costs our collaborators time to go through the mush.\n\nGrice's maxim of Quality roughly states that we try to say true things. When we only have partial oversight of what our agents have done, we are often in a position where we just don't know all details and so we just don't know exactly what's true of what our experiment has actually implemented. It's up to the lab member to not make statements that they don't have sufficient evidence for, by understanding core parts of their code.\n\nFor example, an agent might tell a lab member *I found a bug in the implementation of multi-head latent attention having to do with RoPE. I fixed it. The results are as follows...*\nIn a world where the lab member found and fixed the bug, they would communicate the bug to me.\n*\"oh the bug ended up not being important, here's what happened...\"*.\nThis helps me triage how the bug should affect how I think about previous results.\nIn a world where the agent discovered the bug and the student says the bug wasn't a big deal without truly knowing, I'm stuck.\nIn such a case, it's the student's job to get more information about what the bug was and understand it.\n\nSee this [Stanford Encyclopedia of Philosophy article](https://plato.stanford.edu/entries/grice/) for a discussion of Grice.\n\n### Be in charge of your technical terms.\n\nGood technical writing provides nice intuitions that act as scaffolding for building the reader's understanding.\nThis intuition-building has to be well-separated from statements that are meant to be precise.\nThe introduction, definition, and consistent application of a few technical terms is one way in which strong papers distinguish between intuitions (*residual connections are like a highway for the information to flow...*) and precision (*For a function $f(x): \\mathbb{R}^{d} \\to \\mathbb{R}^{d}$, applying a residual connection to $f$ means constructing a function $g(x) = f(x) + x$*).\nAnother useful way to distinguish the two, of course, is the explicit use of phrases like *Intuitively,* to call out intuition-building.\nIt's surprisingly difficult to set a small, clear number of technical terms in a paper and make sure they're always used consistently.\n\nAI writing makes this much harder.\nHonestly, models come up with really compelling-seeming technical terms—and a lot of them—all throughout writing.\nAI agents discuss *where the leverage is*, the *critical flow*---it's hard to even come up on the spot with examples that match models' technical-seemingness.\nThese are worse than nothing, since they seem technical, but are neither (1) baked into our thinking about the paper, nor usually (2) well-defined and thought out in the context of the argument we're trying to make.\nI expect students to decide on their technical terms, and remove technical-seeming language from models' suggestions or update them to use the agreed upon terms.\n\nOne useful intuition, from Aleks Hołyński, is as follows: if you can remember a time that you didn't know the definition of some term (e.g., every seemingly technical term Claude generates for you,) and you're deciding to still use the term, make sure to (1) know the definition, and (2) communicate that definition to your collaborators clearly.\n\n### Other Useful Resources\n\nThese are not part of our lab policy, but are useful resources when thinking about AI and communication with each other.\nOne is the [Clay AI writing policy](https://www.clay.com/blog/ai-writing-policy) and another is Naomi Saphra's essay, [Life on the Uncanny Precipice](https://nsaphra.net/post/uncanny/).\n\nThanks to Judy Shen and Aleksander Hołyński for helpful discussions as I drafted this policy.\n\n-\nArtefacts in this first draft, like tikz diagrams etc., may be produced with the help of AI.\n\n[↩](#fnref:1)", "url": "https://wpnews.pro/news/lab-policy-on-ai-in-writing-and-communication", "canonical_source": "https://www.cs.columbia.edu/~johnhew/lab/ai-policy.html", "published_at": "2026-09-03 08:33:34+00:00", "updated_at": "2026-09-03 08:52:23.527116+00:00", "lang": "en", "topics": ["ai-policy", "ai-ethics"], "entities": [], "alternates": {"html": "https://wpnews.pro/news/lab-policy-on-ai-in-writing-and-communication", "markdown": "https://wpnews.pro/news/lab-policy-on-ai-in-writing-and-communication.md", "text": "https://wpnews.pro/news/lab-policy-on-ai-in-writing-and-communication.txt", "jsonld": "https://wpnews.pro/news/lab-policy-on-ai-in-writing-and-communication.jsonld"}}