Unjournal Tools & Interfaces

Tools and resources for evaluators and staff at The Unjournal

Evaluation, Assessment & Meta-Research Tools

Evaluation Forms

Academic and applied-stream evaluation forms with guided metrics, credible intervals, calibration practice, and export formats.

Claim Highlighter

Systematically highlight and categorize claims in research papers using GiveWell-style assessment methodology. Export as HTML, CSV, or JSON.

Issue Annotation UI

Compare human expert critiques with LLM-generated issue assessments. Score matches and export annotations for analysis.

Evaluation Tools Guide

Suggested AI and analysis tools for evaluators, including RegCheck, RoastMyPost, NotebookLM, Elicit, and COS TOP Guidelines. Includes Unjournal AI policy.

Research Discovery, Questions & Cruxes

Research Prioritization Dashboard
  • Find social-science and policy research with global-impact potential.
  • Suggest and rate research for evaluation priority.
  • Combine human-prioritized and AI-curated candidate discovery.
  • Support regular updates, feedback, and learning.
Legal Scholarship Prioritization

Exploratory dashboard and overview for high-impact legal scholarship, including AI-assisted candidate triage and a public planning page for possible evaluation pilots.

Cruxes & Pivotal Questions Explorer

Searchable database of explicit disagreements, uncertainties, and "what would change my mind" statements from EA Forum and LessWrong posts, to inform research prioritization.

Guides & Resources

LLM Guides

Guides for using AI tools (NotebookLM, ChatGPT Pro, Elicit) to assist with research evaluation while maintaining critical judgment.

Workshop Materials

Training materials for evaluation workshops, including exercises, calibration games, and instructional content.

Operations Tools

Meeting Scheduler

Internal meeting availability collection, shared response views, and best-time ranking for field specialist, management, advisory, and related meetings.

Analysis Tools (Python/CLI)

Citation Analysis

OpenAlex-based citation network analysis for tracking papers that cite Unjournal-evaluated works and identifying research influence patterns.

Paper Change Analysis

Analyze whether authors updated their papers after receiving Unjournal evaluations. Compares before/after versions and evaluator suggestions.

Issue Matching (Backend)

Python scripts for automated issue matching using sentence embeddings and GPT API. Generates data for the Issue Annotation UI.

Ongoing Outputs & Dashboards

Continuously updated public outputs rather than standalone tools.

Public Evaluations Dashboard

Interactive dashboard of The Unjournal's completed evaluations and ratings — explore evaluator scores, credible intervals, and summary metrics across all papers.

Pivotal Questions Workshops

Hub for The Unjournal's Pivotal Questions workshops (wellbeing, cultured meat, plant-based substitution), including scheduling and beliefs-elicitation forms.

Related Projects

Adjacent projects from The Unjournal's orbit — related, but not core to the evaluation mission.

Impact Directory

Searchable directory of organizations and products with documented, verified impact claims — a related spinoff project, not a core Unjournal evaluation tool.