Advancing the science of data annotation

Our research team publishes at top venues on active learning, annotation quality, and human-AI collaboration.

Scaling Human Feedback for LLM Alignment

A framework for efficiently collecting preference data at scale while maintaining annotator agreement above 95%. Published at NeurIPS 2026.

  • NeurIPS 2026
  • Wang, Chen, Patel et al.
Read paper →

Active Learning with Noisy Oracles

Novel active learning strategies that account for annotator noise and disagreement, reducing labeling costs by 40% on standard benchmarks.

  • ICML 2026
  • Kim, Rivera, Wang et al.
Read paper →

Consensus Without Compromise

A new approach to multi-annotator aggregation that preserves minority viewpoints while achieving robust consensus for subjective tasks.

  • ACL 2026
  • Patel, Johnson, Kim et al.
Read paper →

Automated Quality Estimation for Annotation Pipelines

Predicting annotation quality without gold standards using learned embeddings of annotator behavior patterns.

  • CVPR 2026
  • Chen, Wang et al.
Read paper →

Cross-Modal Transfer for Annotation Efficiency

Leveraging annotations from one modality to bootstrap labeling in another, with applications to video and 3D point clouds.

  • ICCV 2026
  • Rivera, Patel, Chen et al.
Read paper →

Fair Compensation Models for Crowd Annotation

Designing payment structures that incentivize quality while ensuring fair wages across global annotator populations.

  • FAccT 2026
  • Johnson, Kim et al.
Read paper →

Interested in collaborating?

We partner with universities and research labs on annotation science. Reach out to discuss opportunities.