Rejection of a null hypothesis that is true is a Type I Error.
Acceptance of a null hypothesis that is false is a Type II Error.
In testing a hypothesis, the maximum probability with which
one is willing to risk a Type I Error is called the Level Of
Significance of the test.
Levels Of Significance of 0.05 or 0.01 are most common.
Choosing a 0.01 Significance Level to create a hypothesis
test translates to there being 1 chance out of 100 that a true
hypothesis will be rejected (Type I Error). In other words,
for a true Null Hypothesis, there is 99% confidence that
the right decision would be made. It is then said that the
probability of rejection of a true Null Hypothesis at the
0.01 Significance Level is equal to 0.01.
Analyze this claim at Level Of Significance α = 0.01:
p1 = Male Cat Owners or 80 out of 100 Men Sampled;
p2 = Female Cat Owners or 150 out of 200 Women Sampled.
Write the null and alternative hypotheses:
H0 is p1 − p2 ≤ 0;
H1 is p1 − p2 > 0.
A one-tailed test on the right side of the distribution with α = 0.01
has a critical z-score of zc = 2.33. Rejection of H0 (or p1 − p2 ≤ 0)
demands that z(p-bar1 − p-bar2) be greater than 2.33.
Determine the sample proportions and the estimated overall proportion:
p-bar1 = x1/n1 or 80/100 or 0.80;
p-bar2 = x2/n2 or 150/200 or 0.75;
p-cap = (x1+ x2)/(n1 + n2) or (80 + 150)/(100 + 200) or 23/30.
Estimated standard error of the difference between the two proportions is
σ-cap(p-bar1 − p-bar2) equal to [(p-cap)(1 − p-cap)(1/n1 + 1/n2)]0.5 which here
comes to [(23/30)(1 − 23/30)(1/100 + 1/200)]0.5 or 0.0518009009.
Now take z(p-bar1 − p-bar2) as [(p-bar1 − p-bar2) − (p1 − p2)*] divided by σ-cap(p-bar1 − p-bar2),
equal here to [(0.80 − 0.75) − (0)*] ÷ 0.0518009009 which reduces to 0.965234178.
0.965234178 is the statistic to be tested against zc = 2.33. Since 0.965234178 is less than 2.33,
H0 is not rejected. There is not enough evidence to support the alternative hypothesis that the proportion
of Male Cat Owners is larger than the proportion of Female Cat Owners at the 0.01 Significance Level.
--------------------------------------------------------------------------------------------------------------------------------------------------
*Note that (p1 − p2) in this set of circumstances is set equal to zero. Predicting that 1 proportion is
bigger by a specific amount means that (p1 − p2) is that specific amount. Merely predicting
that 1 proportion is bigger (or that p1 ≠ p2) sets (p1 − p2) to 0 here.