THE TEST1600 HANDBOOK

Evaluating statistical claims

A statistical claim can go beyond what a study supports. Before accepting it, identify who was observed, how they were selected, and whether the study merely measured a relationship or assigned a treatment.

3 min guide Worked examples No signup to try
14 questions in the practice library
YOUR TURNSAT Math

Start with one question.

Make your choice. See the reasoning. Keep going.

Question 1 of 3 · Guide warm-up

A survey of a school's chess club finds that most respondents enjoy strategy games. What limits a claim about all students at the school?

Choose an answer for question 1

See answer and explanation

Correct answer: B

Membership in the chess club can be related to enjoying strategy games. That selected group may differ from the school's full population. A broader claim requires a sampling process that can represent the intended population, not just a finding within one interested subgroup.

A quick warm-up. Sign in to save progress in full practice.

Match the conclusion to the evidence collected

A random sample supports inference to its target population. Random assignment supports comparing treatments causally. Neither phrase is interchangeable with simply having many participants or seeing a large difference.

  • Mean is sensitive to extreme values.
  • Median is the middle value after ordering.
  • Probability is favorable outcomes divided by total possible outcomes.
  • A sample must be representative before generalizing.
  • Correlation does not prove causation.

A large survey with a narrow audience

WORKED EXAMPLE

An online fitness forum surveys 5,000 members and finds that 72% exercise daily. Can researchers conclude that 72% of all adults exercise daily?

No. The participants came from a fitness forum rather than a representative sample of all adults. A large response count reduces some random fluctuation within that audience but does not make the audience representative of the wider population.

Keep the setup accurate

  • Using the wrong denominator in probability.
  • Confusing median with mean.
  • Assuming a trend line passes through every point.
Got the idea? Give it a go.

Use the method while it is fresh.

Try it now

What conclusion is safer?

Describe the surveyed respondents or the population justified by the actual sampling process. Avoid widening a conclusion from an interested subgroup to all adults without evidence that the selection supports that step.

Connect this idea to your next skill

UNDERSTAND IT. THEN OWN IT.

Your next step starts here.

Practice evaluating statistical claims at a level that fits you.

Create an account or sign in to continue. Your chosen skill and level carry over.

Test1600 uses cookies in order to offer the best experience of our website. Please review our Cookie policy for more information.