0Quick Answer

1What Is Convenience Sampling?

Convenience sampling, sometimes called accidental or availability sampling, selects units simply because they are easy to reach. Students in the researcher's own class, shoppers outside one supermarket on a Tuesday morning, patients in one clinic waiting room, plots beside the access road, respondents who happened to see a social media post. No random mechanism is involved and no sampling frame is required.

That makes it a non probability design. In a probability design every unit has a known, non zero chance of selection, and that known chance is what licenses a confidence interval. In convenience sampling the chance is unknown and certainly unequal: a person who never visits that supermarket had a selection probability of exactly zero. Because the probabilities are unknown, the standard error formula has nothing to describe, and a margin of error computed from the data is a statement about your spreadsheet rather than about the population.

The honest response is not to abandon the method, because sometimes it is the only method available, but to treat the recruitment route as the object of study. Write down exactly who could and could not have entered your sample, score that risk, measure how far your achieved composition sits from the true population, correct what weighting can correct, and report the rest as a limitation. That sequence is what this tool automates.

Figure 1.1 A convenience sample can only ever describe the reachable part of the population, however large it grows.

2Setup: Describe Your Sample and Score the Bias

Bias risk scorecard

Answer honestly. Each answer scores 0 for low risk, 1 for moderate and 2 for high. The total is scaled to 0 to 100, where higher means more bias risk.

Subgroups: one card per group

Enter each subgroup you can identify in your sample, its known share of the real population as a percentage, and its measurement values. Population shares should sum to about 100. Group names are editable.

3Results

4Interpretation of Results in Detail

How to read each number

The bias risk score. This is the sum of your eight scorecard answers, each scored 0, 1 or 2, rescaled to a 0 to 100 index. It is not a statistical quantity and it does not correct anything. It is a structured way of writing down what you already know about how the sample was gathered, so that the limitation section of your paper is specific rather than vague. A score below 30 means the recruitment route was reasonably broad; 30 to 60 means several known weaknesses; above 60 means the sample describes a narrow slice of the population and should not be presented as anything else.

The participation rate. If you recorded how many units you approached, this is the share that agreed. A low rate is not automatically fatal, but it multiplies every other risk, because the people who declined almost never resemble the people who accepted. A rate you cannot report at all is itself a finding, and reviewers increasingly ask for it.

The sample share against the population share. For every subgroup the tool prints your achieved share, the true population share you supplied, and the gap between them in percentage points. This is the single most informative table in the whole output, because it converts an abstract worry about representativeness into a specific list of who you over reached and who you missed.

The dissimilarity index. This is half the sum of the absolute gaps, a standard measure that ranges from 0 to 100. It answers one question: what percentage of your sample would have to be swapped into different subgroups to make the composition match the population exactly. Below 5 is a close match, 5 to 15 is a moderate departure, and above 15 means the sample composition is substantially different from the population.

The post stratification weights. Each weight is the population share divided by the sample share. A subgroup you under reached gets a weight above 1 so its answers count for more; one you over reached gets a weight below 1. Weights far from 1, say above 3 or below 0.33, are a warning sign: they mean a handful of respondents are carrying a large share of the estimate, and a single unusual person can swing the result.

The weighted mean against the unweighted mean. The gap between these two numbers is the part of the bias that weighting was able to remove. If they are almost identical, composition was not your problem, which does not mean you have no problem. If they differ substantially, your raw mean was misleading and the weighted figure is the one to report, with the caveat that weighting only fixes the subgroups you knew to measure.

The Kish effective sample size. Unequal weights cost you precision. The design effect 1 + CV squared of the weights tells you how much, and the effective sample size is your real n divided by that factor. If you collected 200 responses and the effective size is 120, your weighted estimate has the stability of 120 observations, not 200. Report the effective size, not the raw count, whenever you present a weighted figure.

The nominal interval. The tool prints a t based interval so you can see the arithmetic spread, but it is labelled nominal throughout for a reason. It assumes random selection, which did not happen. Present it as a descriptive range if you present it at all, and never write the words confidence interval next to a convenience sample without a qualifying sentence.

The tipping point. If you set a decision threshold, the tool reports how far the true value would have to sit from your estimate before your conclusion reverses, expressed both in raw units and as a percentage of your estimate. This is the most persuasive sensitivity statement available to a non probability study: rather than claiming your number is right, you show how wrong it would have to be to matter. A conclusion that survives a large hypothetical bias is worth reporting even from a convenience sample; one that flips under a small bias is not.

What the numbers cannot tell you. Post stratification fixes composition only. If the shoppers you interviewed differ from other shoppers in the same demographic group, in motivation, attitude or availability, no weight will detect or repair it. That residual within group bias is invisible to every statistic on this page, and it is usually the larger problem.

5How to Write Your Results in Research

Use the templates below. Each one declares the design as non probability up front, which is what reviewers and editors look for first in a convenience sample.

Rules that make a results paragraph pass review

1. Use the words non probability in the first sentence. Do not write "a sample of 200 students was taken" and leave the reader to guess. Naming it protects you.
2. Describe the recruitment route concretely. Where, when, by whom and for how long. That paragraph is what lets a reader judge who was excluded.
3. Report the participation rate, or say it was not recorded. Silence reads as concealment.
4. Give the composition table. Sample share against population share for every subgroup you can benchmark. This is the strongest evidence you can offer.
5. Say whether you weighted, and how. Name the benchmark source for the population shares and give the range of the weights.
6. Report the effective sample size alongside the raw n whenever you present a weighted estimate.
7. Never call it a confidence interval without qualification. Write "nominal interval, presented descriptively" or drop it entirely.
8. Do not generalise in the abstract. Write "among the students surveyed", not "among students".
9. Include a sensitivity or tipping point statement. Showing how much bias your conclusion could absorb is far more persuasive than asserting there is none.
10. Put the design in the limitations and in the methods. One mention is easy to miss; two is transparent.

Common wording mistakes and the fix

6Formulas Used

7How to Use This Tool

1. Type your study name and, in one line, exactly how units were recruited. That line goes into every export.
2. Enter how many units you approached if you recorded it, so the tool can compute the participation rate.
3. Work through the eight scorecard questions honestly. Guessing low here only misleads you.
4. Pick a preset to see a worked example, or go straight to your own subgroups.
5. On each subgroup card, type the group name, its true population share as a percentage, and its measurement values.
6. Get the population shares from a census, a registry, an enrolment list or an official statistics release, and cite that source in your paper.
7. If you cannot break the sample into subgroups, switch to Single group mode and use the scorecard alone.
8. Set a tipping point threshold if your study leads to a yes or no decision, so the sensitivity analysis runs.
9. Click Score Bias and Calculate, then read the risk card and the representativeness table before anything else.
10. Copy the limitations paragraph straight into your manuscript and download the bias report for your supervisor.

8Detailed Reference Tables

Table 8.1 The eight bias dimensions and what they mean

Table 8.2 Interpreting the dissimilarity index

Table 8.3 Post stratification weights and what they signal

Table 8.4 When convenience sampling is and is not acceptable

9Example Results (8 Worked Cards)

10How to Collect Raw Data in the Field

10a. The 18 point field protocol for convenience sampling

Plan

1. Write down who you are trying to describe before you recruit anyone. The target population must be stated even though you cannot sample it randomly, because every bias claim later is measured against it.
2. List who cannot possibly reach you. Night shift workers, people without smartphones, units off the access track. This list is your coverage limitation, written in advance rather than excused afterwards.
3. Use more than one site and more than one time slot. This is the single cheapest improvement available to a convenience design and it moves the bias score more than anything else.
4. Find your benchmark shares before fieldwork, not after. A census table, enrolment register or membership list gives you the population percentages you will need for weighting.
5. Decide the approach rule and write it down, for example every third person passing the door, so that even without randomisation the selection is systematic rather than arbitrary.

Figure 10.1 Spreading recruitment across sites and times means the exclusions no longer all point the same way.

Kit

6. Carry a recruitment log, not just a data sheet. The log records everyone you approached, including those who refused, which is what produces the participation rate.
7. Carry the benchmark table showing the population share of each subgroup, so you can watch your composition in real time and redirect effort.
8. Carry a tally counter for the approach rule, so every third person really is every third person.
9. Carry two pencils and a waterproof sheet cover. Ink runs in rain and a lost sheet is a lost field day.

Recruit

10. Apply the approach rule mechanically, and never skip someone because they look busy, unfriendly or unlikely to fit. That single habit is what turns a weak design into a worthless one.
11. Log every refusal with a one word reason and any visible characteristics you can record ethically, such as apparent age band. Refusals are data.
12. Watch the running composition against the benchmark and, if one subgroup is filling up, move site or time rather than continuing to collect from the same pool.

Figure 10.2 The recruitment log is what separates a documented convenience sample from an undocumented one.

Collect

13. Record the subgroup label on every row, because the whole weighting correction depends on being able to classify each respondent later.
14. Record a true zero as 0, never as a blank. A blank means not measured; a zero means measured and none present.
15. Record the site and time slot on every row, so you can test afterwards whether answers differed by where and when you collected.

Figure 10.3 Comparing composition against the benchmark during fieldwork lets you redirect effort while it still matters.

Figure 10.4 Three different records; only the third one changes your participation rate.

Check

16. At the end of each session, compute the participation rate for that session and compare it with the others. A slot with a much lower rate collected a different kind of person.
17. Recompute the composition against the benchmark before you stop collecting, because after fieldwork ends the only remaining fix is weighting.
18. Photograph every sheet the same evening, keep the recruitment log with the data sheets, and enter both within 48 hours.

Figure 10.5 A session with a very different participation rate is a warning that it sampled a different group.

10b. Datasheet column specification

Zero rule: write 0 for measured and none present; leave blank only for an unanswered item. Refusal rule: refusals never appear on the data sheet, only on the recruitment log, but they must be counted, because they are what your participation rate is made of.

10c. Filled worked datasheet

What this sheet shows:

• The approach number runs across everyone, so rows 3, 5 and 6 exist even though they contribute no measurement.
• Seven completions from ten approaches gives a session participation rate of 70 percent, computable only because refusals were logged.
• Row 4 is a true zero written as 0, so it counts in the mean; row 10 has an unanswered item, which is different.
• Row 6 is ineligible rather than refused, and ineligibles are excluded from the participation rate denominator.
• Rows 8 to 10 show a deliberate move to a second site and an evening slot once part time students were seen to be under reached.

10d. Blank print ready datasheet

Download the blank sheet as a .csv file, open it in Excel, Google Sheets or LibreOffice, then print it. The Approach, Outcome and Refusal reason columns are the ones that make a convenience sample defensible, so they are pre-labelled here even though most templates omit them.

11Which Sampling Method Should You Use?

Decision tree. Answer these in order and stop at the first yes.

1. Do you have a list of every unit in the population? Use simple random, systematic or stratified sampling instead; convenience sampling is not needed.
2. Is your aim a population estimate, prevalence figure or official statistic? You need a probability design. No amount of weighting makes convenience sampling adequate here.
3. Is the population hidden, stigmatised or has no frame, such as people who inject drugs or undocumented workers? Use respondent driven sampling, which has estimable selection probabilities.
4. Do you want a specific type of case chosen for a reason, such as extreme or typical cases? That is purposive sampling, and naming it correctly is better than calling it convenience.
5. Do you need known quantities of each subgroup and can you fill them deliberately? Use quota sampling, which at least controls composition.
6. Are you piloting an instrument, testing feasibility or generating hypotheses? Convenience sampling is appropriate, provided you say so.
7. Are you running an experiment where the treatment is randomised even though recruitment was convenient? Convenience recruitment is acceptable; internal validity comes from the randomised treatment.
8. Is convenience truly the only option because of cost, access or time? Use it, then use this tool to document, quantify and partly correct the bias.

12Troubleshooting and Common Sampling Errors

13Assumptions, Bias and Limitations

• No known selection probabilities. This is the defining limitation. Every inferential statistic on this page is descriptive by necessity, not by choice.
• Coverage bias. Units that could never have reached your recruitment point had a selection probability of zero, and no statistical procedure can recover them.
• Self selection bias. People who agree to take part differ systematically from those who decline, usually in interest, availability and opinion strength.
• Weighting corrects composition only. Post stratification aligns the proportions of the subgroups you measured. It cannot touch differences inside those subgroups.
• Benchmark quality assumption. The weights are only as good as the population shares you supplied. A stale or wrong benchmark makes the weighted estimate worse than the raw one.
• Unmeasured subgroups. You can only weight on variables you recorded and can benchmark. The variable that matters most is often not one of them.
• The bias score is not a statistic. It is a structured self assessment. It carries no sampling theory and should never be reported as though it quantifies error.
• Variance inflation. Weighting reduces bias but raises variance, so the corrected estimate is less stable than the raw one even while being closer to the truth.

14Conclusion

What convenience sampling gives you

Convenience sampling gives you data you would not otherwise have, quickly and cheaply, from populations that no frame exists for. For pilot work, instrument testing, feasibility checks, hypothesis generation and much qualitative research it is not a compromise but the correct choice, because the aim in those settings is to learn whether something is worth studying properly rather than to estimate a population quantity. It is also frequently the only ethical or practical route to hidden and vulnerable groups, where insisting on a probability frame would mean collecting nothing at all.

What it costs you

You give up inference. Because the selection probabilities are unknown, there is no valid margin of error, no honest confidence interval and no defensible generalisation to a population. Increasing the sample size does not help; a larger convenience sample describes the reachable group more precisely while remaining exactly as far from the population as before. That is the trap. The famous polling failures of the twentieth century were not small samples, they were enormous ones drawn from the wrong pool.

What to check before you publish

Confirm five things: the design is named as non probability in the methods and again in the limitations, the recruitment route is described concretely enough for a reader to work out who was excluded, the participation rate is reported or its absence is acknowledged, sample composition is benchmarked against a cited population source, and any interval you print carries the word nominal or descriptive next to it. If you weighted, add the weight range, the benchmark source and the effective sample size.

What to do next

The cheapest improvement available to you is more recruitment sites and more time slots, which costs organisation rather than money and moves the bias score further than anything else. The second cheapest is a recruitment log, which converts an unquantifiable design into one with a reportable participation rate. If your study will inform a real decision, add a tipping point statement showing how large a bias would have to be to reverse your conclusion; a finding that survives an implausibly large bias is genuinely useful even from a convenience sample, and one that flips under a small bias should not be acted on regardless of how many responses you collected.

15Test Yourself

16Frequently Asked Questions

17Cite This Tool

18Related Tools

• Simple Random Sampling Calculator for a seeded, duplicate free probability draw.
• Systematic Sampling Calculator for interval k with a random start and a periodicity check.
• Stratified Random Sampling Calculator for proportional, equal, Neyman and cost allocation.
• Proportionate Stratified Sampling Calculator with a self weighting check.
• Sample Size Calculator using Cochran, Yamane and Krejcie-Morgan.

19Glossary of Terms

20References

1. Baker, R., et al. (2013). Summary report of the AAPOR task force on non probability sampling. Journal of Survey Statistics and Methodology, 1(2), 90-143. https://doi.org/10.1093/jssam/smt008
2. Meng, X. L. (2018). Statistical paradises and paradoxes in big data: law of large populations, big data paradox, and the 2016 US presidential election. Annals of Applied Statistics, 12(2), 685-726. https://doi.org/10.1214/18-AOAS1161SF
3. Bradley, V. C., et al. (2021). Unrepresentative big surveys significantly overestimated US vaccine uptake. Nature, 600, 695-700. https://doi.org/10.1038/s41586-021-04198-4
4. Squire, P. (1988). Why the 1936 Literary Digest poll failed. Public Opinion Quarterly, 52(1), 125-133. https://doi.org/10.1086/269085
5. Kish, L. (1965). Survey Sampling. Wiley. Archive record
6. Kish, L. (1992). Weighting for unequal Pi. Journal of Official Statistics, 8(2), 183-200. Journal of Official Statistics
7. Holt, D., & Smith, T. M. F. (1979). Post stratification. Journal of the Royal Statistical Society Series A, 142(1), 33-46. https://doi.org/10.2307/2344652
8. Little, R. J. A. (1993). Post-stratification: a modeler's perspective. Journal of the American Statistical Association, 88(423), 1001-1012. https://doi.org/10.1080/01621459.1993.10476368
9. Elliott, M. R., & Valliant, R. (2017). Inference for nonprobability samples. Statistical Science, 32(2), 249-264. https://doi.org/10.1214/16-STS598
10. Cornesse, C., et al. (2020). A review of conceptual approaches and empirical evidence on probability and nonprobability sample survey research. Journal of Survey Statistics and Methodology, 8(1), 4-36. https://doi.org/10.1093/jssam/smz041
11. Groves, R. M., & Peytcheva, E. (2008). The impact of nonresponse rates on nonresponse bias. Public Opinion Quarterly, 72(2), 167-189. https://doi.org/10.1093/poq/nfn011
12. Heckman, J. J. (1979). Sample selection bias as a specification error. Econometrica, 47(1), 153-161. https://doi.org/10.2307/1912352
13. Etikan, I., Musa, S. A., & Alkassim, R. S. (2016). Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics, 5(1), 1-4. https://doi.org/10.11648/j.ajtas.20160501.11
14. Jager, J., Putnick, D. L., & Bornstein, M. H. (2017). More than just convenient: the scientific merits of homogeneous convenience samples. Monographs of the Society for Research in Child Development, 82(2), 13-30. https://doi.org/10.1111/mono.12296
15. Henrich, J., Heine, S. J., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33(2-3), 61-83. https://doi.org/10.1017/S0140525X0999152X
16. Heckathorn, D. D. (1997). Respondent driven sampling: a new approach to the study of hidden populations. Social Problems, 44(2), 174-199. https://doi.org/10.2307/3096941
17. Lohr, S. L. (2021). Sampling: Design and Analysis (3rd ed.). CRC Press. https://doi.org/10.1201/9780429298899
18. Groves, R. M., et al. (2009). Survey Methodology (2nd ed.). Wiley. Publisher page
19. Valliant, R., Dever, J. A., & Kreuter, F. (2018). Practical Tools for Designing and Weighting Survey Samples (2nd ed.). Springer. https://doi.org/10.1007/978-3-319-93632-1
20. Rosenbaum, P. R. (2010). Design of Observational Studies. Springer. https://doi.org/10.1007/978-1-4419-1213-8