RESEARCHING THE REAL WORLD



MAIN MENU

Basics

Orientation Observation In-depth interviews Document analysis and semiology Conversation and discourse analysis Secondary Data Surveys Experiments Ethics Research outcomes
Conclusion

References

Activities

Social Research Glossary

About Researching the Real World

Search

Contact

© Lee Harvey 2012–2024

Page updated 8 January, 2024

Citation reference: Harvey, L., 2012–2024, Researching the Real World, available at qualityresearchinternational.com/methodology
All rights belong to author.


 

A Guide to Methodology

8. Surveys

8.1 Introduction to surveys
8.2 Methodological approaches
8.3 Doing survey research
8.4 Statistical Analysis

8.4.1 Descriptive statistics
8.4.2 Exploring relationships
8.4.3 Analysing samples

8.4.3.1 Generalising from samples
8.4.3.2 Dealing with sampling error
8.4.3.3 Confidence limits
8.4.3.4 Statistical significance
8.4.3.5 Hypothesis testing
8.4.3.6 Significance tests

8.4.3.6.1 Parametric tests of significance

8.4.3.6.1.1 z tests of means and proportions
8.4.3.6.1.2 t tests of means
8.4.3.6.1.3 F test of variances
8.4.3.6.1.4 Parametric tests of differences in means of matched pairs
8.4.3.6.1.5 Analysis of variance

8.4.3.6.2 Non-parametric tests of significance

8.4.3.7 Summary of significance testing and association: an example

8.4.4 Report writing

8.5 Summary and conclusion

8.4.3.6.1 Parametric tests of significance

A sample is only a sub-group of a much larger set about which we are trying to gather information. We are not interested in the information about the sample for its own sake but what the sample may tell us about the population, of which it is representative.

Because, at best, a sample can only be assumed to be representative of, and not identical to, the population, researchers test the validity of assertions made on the basis of sampling, before applying them to the populations from which the samples are taken. If for some reason the sample is of interest in itself (rather than as an indicator of a population) or if the 'sample' is in fact the entire population, then there is no need for significance testing.

Parametric tests, as the name suggests, use sample parameters for the text rather than comparing the whole sample (which non-parametric tests do).

There are three basic types of parametric tests, z test, t test, F Test. These are named after the sampling distri­butions.

This Section thus examines the following situations:
1.  Test of claimed population mean on the basis of a large sample (one sample z test of means).

2.  Test of claimed population mean on the basis of a small sample (one sample t test of means).

3.  Test of claimed population proportion (one sample z test of proportions).

4.  Test of two independent large sample means (z test of two sample means).

5.  Test of two independent small sample means (t test of two sample means).

6. Test of two independent sample proportions (z test of two proportions).

7. Test of more than two sample means of any size sample (Analysis of Variance).

8. Test of means of two related samples (t test of the difference in sample means).

9. Test of two sample variances (F test).

The Section considers the tests of one or two independent samples first in the following order, z, t, and F. Then it addresses the the related sample situation. Finally, the Section considers the multi-sample case of Analysis of Variance, which utilises the F-distribution, and tests both independent and related samples.

Each test will be presented in the following way:

  1. Name of test
  2. When to use test. This depends upon the null hypothesis being tested and the presentation of the sample data.
  3. Hypotheses. The null and alternative hypotheses that are applicable to the test.
  4. What information is required to understake the test. This is information derived from the sample.
  5. Statement of the sampling distribution. What shape the sampling distribution has and where it derives from.
  6. Assumptions. Assumptions made about the sampling distribution and the population when using the test.
  7. Testing statistic. What the relevant formulae for the testing statistic are for all applica­tions of the test.
  8. Critical Values. How to find the critical values and consequent decision rules.
  9. Worked examples for all applications of the test. These are provided to show what is going on when undertaking the test. Most researchers will use computer programs to analyse the data and generate test statistics. However, it is important to know what the statistics mean, which ones are appropriate for any given circumstance, and how their signifcance has been computed, including the assumptions that underlie the statistical analysis.
  10. Activities (unworked examples)

Next 8.4.3.6.1.1 z tests of means and proportions

Top