Hacker News Reader

Comment by pjc50 | Hacker News Reader

https://www.mccallum-layton.co.uk/tools/statistic-calculator...

  Sample Size: 1000
  Observed Proportion: 15.64%
  Confidence Level: 95%
  Confidence Interval: ±2.25
  Range for the true population proportion: 13.39% to 17.89%

It's noise.

View on HN

Hmm, I tried playing around with this tool.

When I enter 250000 in sample size I get ranges that don't overlap. Does that mean I would need that many samples to answer this?

Yes. The bigger your sample size, the bigger your ability to see small effects. A test with 1000 elements can only tell apart big effects; a test with 250000 can tell apart much smaller ones. This is the idea of https://en.wikipedia.org/wiki/Statistical_power

Reply on news.ycombinator.com