Milnubes / Curiosity, with sourcesBotany · Culture · Science
The observatory

A small sample can open a question, not settle it

You ask five people their favourite colour and four choose green. It looks like a landslide victory until you remember whom you asked. Something similar happens with studies: a result can be interesting and still leave considerable uncertainty. Sample size helps us understand that gap.

Printed reports with charts and data tables on a desk.
Behind every chart is a number of cases: with small samples, uncertainty carries more weight.

A few observations can offer an initial clue

A small study can explore a question, check whether a procedure is feasible or detect a signal worth investigating. Its value depends on that objective. The problem comes when an exploration is presented as a definitive answer for a much broader population.

In the colour example, perhaps you interviewed people attending a botanical exhibition. Even if there were many of them, selection would still matter. Size and representativeness are related but different questions. Increasing the number does not automatically correct every bias in how the data was obtained.

The central figure has company

A result is often expressed as an estimate together with some measure of uncertainty. Looking only at the central figure can conceal the fact that the data is compatible with very different possibilities. Intervals help explain precision; they are not statistical decoration to be removed because they complicate a headline.

The Cochrane handbook discussion of certainty of evidence includes imprecision among the aspects assessed. It also considers other domains, such as bias and inconsistency. This reminds us that confidence in a result is not determined by counting participants in isolation.

“No difference was found” needs context

A study may fail to detect a difference because it is genuinely small or absent, but also because the data is insufficient to distinguish it. An inconclusive result should not automatically be translated into evidence of equivalence. The design and the precision of the estimate need to be examined.

Imagine two photographs taken at different resolutions. You cannot distinguish a detail in one; that does not establish that the detail does not exist. The analogy has limits, but it helps remind us that the ability to detect something is part of the interpretation. In science, that ability is examined formally, not through a visual impression.

Small studies do not need inflated claims

An explanatory article can describe why a pilot study is interesting without assigning it certainty it does not have. Explain the question it opens, the obstacles it identifies and the research that could move things forward. Readers get a more honest discovery story than a promise followed by a warning at the end.

When you find a CBD study involving few people, do not celebrate or dismiss it on the number alone. Review its objective, selection, comparison, follow-up and uncertainty. The final question is not “Is it small?” but “What can these data teach us?” That wording leaves room to recognise both a valuable contribution and its limits.

Take this with you

A small sample can provide a useful clue. The conclusion should retain the uncertainty and the study’s actual purpose.

Sources you can open

The source may be in its original language. English publication does not change the jurisdiction or date discussed.

  1. Cochrane — Certainty of evidence, Chapter 14

Follow the thread

Open the cannabinoid encyclopedia

Check the identity, research, uncertainties and documented forms of each compound.