Statistical conclusion validity refers to the appropriate use of statistics

Statistics

Statistics is the study of the collection, organization, analysis, and interpretation of data. It deals with all aspects of this, including the planning of data collection in terms of the design of surveys and experiments....

 to infer whether the presumed independent and dependent variables covary (Cook & Campbell, 1979). It concerns two related statistical inferences: (1) whether the presumed cause and effect covary and (2) how strongly they covary.

The most common threats to statistical conclusion validity are:

• Low Statistical Power
• Violated assumptions of the test statistics
• Fishing and the error rate problem
• Unreliability of measures
• Restriction of range
• Unreliability of treatment implementation
• Extraneous variance in the experimental setting
• Heterogeneity of the units under study
• Inaccurate effect size estimation