Math 151 , Day 34, Monday, April 22, 2002Hit reload to get current versionAfter Class

Quiz   If you got 7 or below you can repeat it (same quiz) for a max of 8 points,  after class today or by appointment.

Significance testing: "an outcome that would "rarely" happen if a claim were true--is good evidence that the claim is NOT true."  Introduction Day31

H₀: "Null hypothesis" A claim or statement about the population we would like to show is NOT true.
H_a: "Alternative hypothesis" A claim or statement about the population we are trying to find evidence FOR.
 P-value: We measure the probability of seeing something (again) as extreme as the observed value (or more so).
    One sided test:  Tail further out than observed value.
    Two-sided test: you need to measure the P-value symmetrically both directions from the observed value--so the P value is double what it would be for a one-sided test.

HW questions:  #6.35, p. 333 Engine crankshafts:
Meaning of "significance"  (note--"High" significance means small alpha or P-value.)
Question: How do we know that .05 is "significant?" (.05 is 1 in 20 chance of seeing the result by "dumb luck" if the null hypothesis is true.)  Read sec. 6.3, pp. 343-345
>>Significance levels vary by field of study; different fields have different "customarily acceptable" levels.
      In reality, no sharp border between "significance" and "not significant"
>>How small a P is "convincing evidence" against H₀?  In practice...
        How plausible is H₀?  H_a?  Strong evidence needed to reject "conventional wisdom."
        How expensive (mentally, economically) will abandoning H₀ be?
>>"Statistically Significant" doesn't always mean "Important."  Big enough sample sizes will allow you to distinguish even small differences.
- - - - - - - - -
What if you don't have the Z-table but only have the t-table (Table C)?
What if you have a demanded level of significance, alpha?
    Table C gives a limited list of probabilities  across the top row: Right tail values for the bell distribution.
        The value in the bottom (z*) row under p is the corresponding standard normal value.
            "z* is the upper p critical value of the standard normal distribution."
  Do this: Find your z from the data. Make a sketch of the normal curve and mark z on it.  Mark the direction(s) of H_a.
    (If your z is in the direction of H_a , continue.  Otherwise the results are hopelessly not significant: you can quit.)
Find the z*'s in Table C that bracket your z (ignore minus sign).  Find the corresponding p's.
p      .02     .01
z*   2.054 \/ 2.326
       z = 2.111

So the P-value for your z is: between those 2 p's (one sided test)
                                           between double those 2 p's (two sided test)
    Test is significant at the bigger bracketing probability; not sig. at the smaller.
One sided: P-value is less than .02 and greater than .01
    Significant at the .02 level, not at the .01 level
Two sided: P-value is less than .04 and greater than .02
    Significant at the .04 level, not at the .02 level
If you have a specific demanded significance level, compare it with these levels.
            If  a test is significant at level b, then it is significant at every level bigger than b.
            If a test is Not significant at level d, then it is Not significant at every level smaller than d.
    "Significant at a":  probability of getting my results (again) by chance (if H₀ is true) is less than (or =) a.
          Significant at   Not significant at
p bigger   .10      .05   _  .01      .005     .001 smaller
                         /\
                        P-value
                        z-value (one-sided)
z* smaller 1.282   1.645_ | 2.326    2.576    3.091 bigger
  You can compare z directly to z* for your desired alpha. The 2-sided is a bit tricky.
          (2-sided: Split the alpha in 2, then find the z*.  Don't halve or double z's--it doesn't work!)
= = = = = = = = = = = = = = = = = = = = = =
"Significance testing" vs. "Hypothesis testing"--gathering evidence vs. making decisions.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
PreClass assignment Day 34 for  Day 35

Questions on exam material. Significance Tests:   Activstats: Still in Ch 19, see previous days.  Next, Ch. 18 and Ch. 20.   Moore  Rest of  6.3 next.  We'll skip 6.4.  Next  7.1

HW Day34  ReRead (finish) 6.2 (pp337-8 optional), and read 6.3, especially pp. 343-345 for today.  Skip or skim Sec. 6.4. (Ch. 7 next.)
If you see "statistically significant" without a level, it often means "at the .05 level".
I suggest this for each problem that you find a P-value or sig. level for: sketch the curve representing the sampling distribution of x-bar, or of the z you calculate from x-bar, and mark your observational result on it (like fig. 6.10, 6.11, 6.13)

Hand in from Moore Table C:  p.341, 6.48 CEO pay again (what you would do if you didn't have Table A) p. 341, 6.46, 6.49 general z statistic, significance,Turn the page--6.49 continues.  p. 342 6.50 patent protection; another z. = = = = = = = = = =  Fixed significance levels: if you only have table C, what can you say?  p. 337, 6.37 testing number generator 6.38 nicotine content = = = = = = = = = =  p. 342, 6.52 1% vs 5%    6.53 define stat. signif. p. 343, 6.54  knife edge .05 p. 345, 6.55 and 56 effect of n

Read,  to discuss

Optional  (more practice)