Turn a paper into an understandable account of what researchers tested, what changed and how certain the comparison is. A worked example shows why improvement within a group is different from an effect compared with a control. [1] [2]
What you will learn
- Reconstruct a study’s material, population, comparator, outcome and follow-up.
- Distinguish a within-group change from the difference between groups.
- Interpret an uncertain estimate without turning it into proof of benefit or proof of no effect.
Begin with the question the experiment can answer
Before reading a conclusion, identify who or what was studied and what the investigators did. A paper might examine a defined peptide in cultured cells, an injured animal or a group of people with a particular condition. Record the material as the authors describe it, including a fragment, modification, complex or formulation when specified. A broad family name can conceal a change that matters to the experiment. [1] [2]
Then translate the outcome into an event you could describe aloud. Did cells move across a gap, did a repaired tendon withstand more pulling force, or did participants report less pain? The technical name belongs beside that explanation. An endpoint is the specific outcome used to evaluate the question; learning its name is useful after you understand what was measured. [3]
Find the group that makes the result interpretable
An improvement after an intervention can have several explanations. A condition may improve with time, other care may help, and a measurement may vary. A comparison group helps investigators estimate how outcomes would differ under another specified condition. Read what that group actually received: a placebo, an active treatment, usual care or no intervention can each answer a different question. [2]
A vehicle control uses the preparation without the active study substance. Its ingredients still matter. If the accessible source does not identify them, keep that detail unknown; do not replace “vehicle” with “saline” because saline sounds familiar. Similarly, blinding means that specified people did not know the group assignment. Check who was blinded and how the report says this was achieved. [1]
Read the size of the difference before its statistical label
The estimated effect describes how far apart the groups were on the outcome. A confidence interval expresses uncertainty around that estimate under the analysis assumptions. A wide interval can leave several substantially different effects compatible with the data. Ask whether the result is precise enough to answer the scientific question, including the possibility of meaningful harm as well as benefit. [2]
A P value addresses compatibility between the data and a specified statistical model. It does not give the probability that a treatment works, measure the size of a benefit or determine whether the outcome matters to people. A result above a chosen significance threshold can still be too uncertain to exclude a meaningful effect. “No difference established” and “the treatments are equivalent” require different evidence. [4]
Finish with the details that could change the answer
Check how many independent animals or participants contributed to the analysis, how long follow-up lasted and what happened to missing observations. Ten images from one animal do not automatically give ten independent animals. Counts should describe the experimental units as well as the measurements; otherwise, an apparently large data set may contain less independent information than it first appears to. [5]
Read how adverse events were collected and reported. A statement that an abstract mentions no harms is weaker than a report describing systematic monitoring and the events observed in each group. Keep a final note in ordinary language: the observed result, its comparison, its uncertainty and the most consequential missing detail. [2]
Worked example: improvement is not the same as an effect
The following numbers are invented for learning; they do not describe a real peptide or trial. Assume 40 people with knee pain are randomly assigned to a hypothetical intervention or placebo, 20 per group. Both groups start with an average pain score of 6 on a 0–10 scale. After four weeks, the intervention group averages 3 and the placebo group averages 4. Assume all participants completed follow-up. [2]
The intervention group improved by 3 points, but the placebo group improved by 2. The observed difference in improvement is therefore 1 point in favor of the intervention. That between-group difference is the relevant estimate for this comparison. Reporting only the 3-point improvement would hide what happened in the placebo group. [2]
Suppose the assumed 95% confidence interval for the between-group difference runs from a 0.5-point disadvantage to a 2.5-point advantage. The observed average favored the intervention, while the estimate remains compatible with several effects, including no difference. This example does not establish equivalence. You would also need the trial’s methods, harms and an explanation of what size of pain change matters to participants. [2] [4]
Check your understanding
Why is “pain fell by 3 points” an incomplete account of the example?
Show explanation
Pain also fell by 2 points with placebo. The observed difference in improvement was 1 point, so the intervention group’s change alone does not isolate its effect relative to the assigned comparison. [2]
Key points
- State the exact material, studied system, comparator, measured outcome and follow-up.
- Compare the groups before attributing an improvement to the intervention.
- Keep the observed direction and uncertainty together, including meaningful effects the data do not exclude.
Sources and further reading
- Percie du Sert N et al. Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0. PLoS Biol. 2020;18(7):e3000411.
- CONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials. BMJ. 2025;389:e081124.
- FDA. Surrogate Endpoint Resources for Drug and Biologic Development.
- Wasserstein RL, Lazar NA. The ASA Statement on p-Values: Context, Process, and Purpose. The American Statistician. 2016;70(2):129–133. doi:10.1080/00031305.2016.1154108.
- NC3Rs Experimental Design Assistant. Experimental unit.