Null Hypothesis Reporter

Publication bias means that negative and null results rarely get published, even though they are scientifically valuable. Researchers waste time and resources repeating experiments that others have already tried without success. AcaTrove's Null Hypothesis Reporter provides a structured way to document, share, and search null results within your workspace and beyond.

Why Null Results Matter

When an experiment fails to reject the null hypothesis, that outcome is information. It tells other researchers that a particular approach, under specific conditions, did not produce the expected effect. Without a place to record these results, they are lost -- buried in lab notebooks or forgotten entirely.

The Null Hypothesis Reporter addresses this by creating a searchable archive of null and negative results tied to the experimental conditions, methods, and context that produced them.

Creating a Null Result Report

1. Navigate to /research/null-hypothesis-reporter and click + New Report.
2. Fill in the report form:
   • Title -- A descriptive title summarizing the experiment and outcome.
   • Hypothesis -- The hypothesis you were testing.
   • Method Summary -- A concise description of the experimental approach, including key parameters.
   • Results -- What you observed, including statistical outcomes (p-values, effect sizes, confidence intervals).
   • Conditions -- Environmental or procedural conditions that may have influenced the outcome (sample size, equipment, reagent lots, timing).
   • Interpretation -- Why you believe the null result occurred and what it implies.
   • Project -- Link the report to a project for context.
   • Tags -- Add keywords for searchability.
3. Optionally attach supporting data files, figures, or raw data.
4. Click Submit.

Null hypothesis report form with fields for hypothesis, method, and results

Browsing Null Results

The Null Hypothesis Reporter main page lists all reports in your workspace, sorted by recency. Use search and filters to find reports by topic, project, date, or author.

List of null result reports with search and filter options

Visibility and Sharing

By default, null result reports are visible to all members of your workspace. You can adjust visibility:

• Workspace -- Visible to all workspace members.
• Lab only -- Visible only to members of your lab.
• Private -- Visible only to you.

Workspace administrators can enable cross-workspace sharing for reports, making them discoverable by researchers in other AcaTrove workspaces at the same institution.

Searching Null Results

The search functionality uses the same semantic search engine as the rest of AcaTrove. You can search null results by meaning, not just keywords. For example, searching "CRISPR delivery to primary T cells" will surface null result reports about failed transfection attempts, even if they use different terminology.

Linking to Publications

If you eventually publish a paper that references or builds on a null result, link the report to the publication. This creates a bidirectional reference: the null result report shows the publication it informed, and the publication's entry shows the null results it built upon.

Tips

• Document null results as soon as possible after the experiment, while details are fresh.
• Include enough methodological detail that another researcher could understand the conditions without repeating the experiment.
• Search the Null Hypothesis Reporter before starting a new experiment to check whether similar approaches have already been tried.