Week 08
Paper Draft Complete
Month 2 deepens the science: full baselines, ablations, mechanism analysis (semantic anchoring / drift), and the first complete paper draft.
Place in the arc
Month 2 deepens the science: full baselines, ablations, mechanism analysis (semantic anchoring / drift), and the first complete paper draft.
Objectives
These objectives define what success looked like for Week 8. Meeting them either unlocked the next experiment, closed a risk, or produced evidence for the thesis claim that diffusion expansion is domain-dependent.
- [ ] Complete full paper draft
- [ ] Create all figures and tables
- [ ] Prepare code repository structure
- [ ] Begin code documentation
What we built and measured
Below is the detailed record for the week - methods, implementation notes, and experimental setup - expanded from the team log so a reader can follow the technical path without the repository open.
1. Paper Draft Complete
All sections written:
Introduction (1.5 pages):
- Query-document asymmetry problem framed
- HyDE critique (hallucination in specialized domains)
- QUID as "semantic anchoring" positioned
- Contributions clearly stated
Related Work (1.5 pages):
- Query expansion: Rocchio → RM3 → doc2query → HyDE
- Dense retrieval: DPR → Contriever → BGE
- Text diffusion: D3PM → MDLM → LLaDA
- Gap identified: no diffusion for retrieval
Method (1.5 pages):
- Problem formulation with equations
- QUID algorithm pseudocode
- Retrieval pipeline description
Experiments (3 pages):
- Datasets and baselines (Table 1)
- Main results (Table 2)
- Ablations (Table 3)
- Analysis with figures
Conclusion (0.5 pages):
- Contributions summarized
- Limitations acknowledged
- Future work suggested
2. Figures Created
- Figure 1: QUID architecture diagram
- Figure 2: Bar chart - nDCG@10 across methods/datasets
- Figure 3: Scatter plot - semantic drift vs. improvement
- Figure 4: Quality vs. latency tradeoff curve
3. Tables Finalized
- Table 1: Dataset statistics
- Table 2: Main results (7 methods × 4 datasets)
- Table 3: Ablation summary
4. Code Repository Structure
QUID/
├── README.md # Installation, usage, citation
├── requirements.txt # Dependencies
├── LICENSE # MIT License
├── src/
│ ├── quid.py # Main QUID class
│ ├── diffusion.py # LLaDA generation
│ ├── retrieval.py # BGE-M3 retrieval
│ └── evaluation.py # BEIR evaluation
├── experiments/
│ ├── run_beir.py # Reproduce main results
│ ├── ablations.py # Reproduce ablations
│ └── analysis.py # Mechanism analysis
└── configs/
└── default.yaml # HyperparametersNumbers and what they mean
Metrics are only useful with interpretation. Where tables appear, read the deltas as claims about when QUID helps (vocabulary gap) versus when HyDE or vanilla wins (knowledge / claim gap). Agentic weeks emphasize tool-call policies over blind expansion.
1. Paper Draft Complete
All sections written:
Introduction (1.5 pages):
- Query-document asymmetry problem framed
- HyDE critique (hallucination in specialized domains)
- QUID as "semantic anchoring" positioned
- Contributions clearly stated
Related Work (1.5 pages):
- Query expansion: Rocchio → RM3 → doc2query → HyDE
- Dense retrieval: DPR → Contriever → BGE
- Text diffusion: D3PM → MDLM → LLaDA
- Gap identified: no diffusion for retrieval
Method (1.5 pages):
- Problem formulation with equations
- QUID algorithm pseudocode
- Retrieval pipeline description
Experiments (3 pages):
- Datasets and baselines (Table 1)
- Main results (Table 2)
- Ablations (Table 3)
- Analysis with figures
Conclusion (0.5 pages):
- Contributions summarized
- Limitations acknowledged
- Future work suggested
2. Figures Created
- Figure 1: QUID architecture diagram
- Figure 2: Bar chart - nDCG@10 across methods/datasets
- Figure 3: Scatter plot - semantic drift vs. improvement
- Figure 4: Quality vs. latency tradeoff curve
3. Tables Finalized
- Table 1: Dataset statistics
- Table 2: Main results (7 methods × 4 datasets)
- Table 3: Ablation summary
4. Code Repository Structure
QUID/
├── README.md # Installation, usage, citation
├── requirements.txt # Dependencies
├── LICENSE # MIT License
├── src/
│ ├── quid.py # Main QUID class
│ ├── diffusion.py # LLaDA generation
│ ├── retrieval.py # BGE-M3 retrieval
│ └── evaluation.py # BEIR evaluation
├── experiments/
│ ├── run_beir.py # Reproduce main results
│ ├── ablations.py # Reproduce ablations
│ └── analysis.py # Mechanism analysis
└── configs/
└── default.yaml # HyperparametersChallenges
- Page limit pressure: Had to move some analysis to appendix.
- Figure sizing: Balanced readability vs. space with 2-column figures.
Key learnings
- Complete draft is crucial milestone for iteration
- Algorithm pseudocode makes method reproducible
- Code release preparation takes significant effort
Plan for next week
- Revise paper based on self-review
- Complete code documentation
- Verify reproducibility
Hours logged
| Activity | Hours |
|---|---|
| Paper writing | 16 |
| Figures/tables | 8 |
| Code organization | 6 |
| Documentation | 4 |
| Total | 34 |