Skip to content

Writing Philosophy for Academic Papers

"A paper is a short, rigorous, evidence-based technical story with a takeaway readers care about." — Neel Nanda

Table of Contents

The Narrative Principle

(Neel Nanda, Google DeepMind)

Your paper is NOT a collection of experiments — it's a story with ONE clear contribution.

Three Pillars (must be crystal clear by end of introduction):

PillarDescriptionExample
The What1-3 specific novel claims within cohesive theme"We prove that X achieves Y under condition Z"
The WhyRigorous empirical evidence supporting claimsStrong baselines, experiments distinguishing hypotheses
The So WhatWhy readers should careConnection to recognized community problems

If you cannot state your contribution in one sentence, you don't yet have a paper.

5-Sentence Abstract Formula

(Sebastian Farquhar, DeepMind)

  1. What you achieved: "We introduce...", "We prove...", "We demonstrate..."
  2. Why this is hard and important
  3. How you do it (with specialist keywords for discoverability)
  4. What evidence you have
  5. Your most remarkable number/result

Delete generic openings like "Large language models have achieved remarkable success..."

Gopen-Swan 7 Principles

(Based on "The Science of Scientific Writing")

#PrincipleRuleExample
1Subject-verb proximityKeep subject and verb close❌ "The model, which was trained on..., achieves" → ✅ "The model achieves... after training on..."
2Stress positionPlace emphasis at sentence ends❌ "Accuracy improves by 15% when using attention" → ✅ "When using attention, accuracy improves by 15%"
3Topic positionPut context first, new info after✅ "Given these constraints, we propose..."
4Old before newFamiliar info → unfamiliar infoLink backward, then introduce new
5One unit, one functionEach paragraph makes one pointSplit multi-point paragraphs
6Action in verbUse verbs, not nominalizations❌ "We performed an analysis" → ✅ "We analyzed"
7Context before newSet stage before presentingExplain before showing equation

Word Choice

(Zachary Lipton)

Be Specific

  • ❌ "performance" → ✅ "accuracy" or "latency" (say what you mean)
  • ❌ "significant" → ✅ "statistically significant (p < 0.05)" or remove

Eliminate Hedging

Drop "may" and "can" unless genuinely uncertain.

  • ❌ "This may improve performance" → ✅ "This improves accuracy by 3.2%"

Avoid Incremental Vocabulary

  • ❌ "combine," "modify," "expand" → ✅ "develop," "propose," "introduce"

Delete Intensifiers

  • ❌ "provides very tight approximation" → ✅ "provides tight approximation"

Precision Over Brevity

(Jacob Steinhardt, UC Berkeley)

  • Consistent terminology: Different terms for same concept creates confusion. Pick one and stick with it.
  • State assumptions formally: Before theorems, list all assumptions explicitly
  • Intuition + rigor: Provide intuitive explanations alongside formal proofs
  • Define before use: Every symbol and term defined before first use

Micro-Level Tips

(Ethan Perez, Anthropic)

  • [ ] Minimize pronouns: ❌ "This shows..." → ✅ "This result shows..."
  • [ ] Verbs early: Position verbs near sentence start
  • [ ] Unfold apostrophes: ❌ "X's Y" → ✅ "The Y of X" (when awkward)
  • [ ] Delete filler words: "actually," "a bit," "very," "really," "basically," "quite," "essentially"
  • [ ] Avoid vague "this": Always attach a noun after "this"
  • [ ] Active voice: ❌ "The method was applied" → ✅ "We applied the method"

Section-by-Section Guide

SectionLengthKey Requirements
Abstract150-250 words5-sentence formula; delete generic openings
Introduction1-1.5 pages max2-4 bullet contribution list; methods should start by page 2-3
MethodsAs neededEnable reimplementation; all hyperparameters listed
ExperimentsMain bodyState claim before each experiment; error bars mandatory
Related Work1-1.5 pagesOrganize methodologically; each cited work needs individual discussion; max 2 clustered citations
Limitations0.5-1 pageRequired by all major venues; pre-empt reviewer criticisms

Introduction Must Include:

  • Clear problem statement
  • 2-4 bullet contribution list (max 1-2 lines each)
  • Brief approach overview
  • Citation integration: Each cited work must be accompanied by a brief description of its contribution, method, or limitation — max 2 clustered citations without discussion (see style-guide.md Anti-Citation-Stacking Rules)

Experiments Must Include:

  • What claim each experiment supports
  • Error bars with methodology (std dev vs std error)
  • Hyperparameter search ranges
  • Compute infrastructure (GPU type, total hours)

Time Allocation

(Neel Nanda)

Spend approximately equal time on each of:

  1. The abstract
  2. The introduction
  3. The figures
  4. Everything else combined

Why? Most reviewers form judgments before reaching your methods.

Reader encounter order: title → abstract → introduction → figures → maybe the rest.

Sources

SourceKey ContributionLink
Neel Nanda (Google DeepMind)The Narrative PrincipleHow to Write ML Papers
Sebastian Farquhar (DeepMind)5-sentence abstract formulaHow to Write ML Papers
Gopen & Swan7 principles of reader expectationsScience of Scientific Writing
Zachary LiptonWord choice, eliminating hedgingHeuristics for Scientific Writing
Jacob Steinhardt (UC Berkeley)Precision, consistent terminologyWriting Tips
Ethan Perez (Anthropic)Micro-level clarity tipsEasy Paper Writing Tips
Andrej KarpathySingle contribution focusVarious lectures

Released under the MIT License.