MATH 251, Probability and Statistics I, Fall 2005, Fri. Nov. 11, Day 33After class

Reading:  Finish 6.3. Ahead:  Skim 6.4 for the words and concepts.  Start 7.1 Work on exam!
Hand in: Sec. 6.3, pp. 428ff. Reorganized:
6.77 12 subjects, P = .052
6.81 managerial trainees
6.88 tornado damage

Postpone the rest of these from sec. 6.3, 6.4, 7.1
6.74  1000 tests
6.87 Bonferroni 
Note on Bonferroni procedure, #6.86, 87  If you do multiple tests as a fishing expedition, individual items that come up significant at (e.g.) .05 could have happened by chance, or could indicate "real" differences from their null hypotheses.  Then you would need to make a new study, collect new data, to check on these.  If you have no possibility of this, and need conclusions from this  set of data, you can use this procedure.  It is analogous to dividing the alpha (here .05)  between two tails for a two sided test--here we divide the alpha evenly among all the separate tests--anything that still comes up significant when it is that far out can legitimately be deemed significant at the .05 level overall.   What do we lose?  Power!  The chances of confirming any real difference from the null hypothesis go down, by demanding to be farther out in the tail. 
- - - - - - - - - - - - - 
Sec. 6.4, p. 441
6.99 diagnostics and error types
A.  Use the Applet:  Power of a test to get a feel for these issues: see below  for details.
- - - - - - - - - - 
Sec. 7.1, practice with t-table.
B.  Assume T has the t(21) distribution. Use table D, df = 21.
a) Find t* such that P(T > t*) = .01.
b) Find t* such that P(T > |t*|) = .01 (further out than t* , symmetrically on both sides of 0)
c) Find t* such that P(T < t*) = .99.
d) Find  t* such that P(-t* < T < t*) = .99 (Hint: use the Confidence Level row)
e) t = 2.132.  Find bracketing probabilities, so that __  _  < P(T >2.132) <  _____..

Read, 
discuss
- - - - - 
I forgot to copy these postponed problems
from Day 32!   You can/should do them now!
 6.72, 73 P,  sig. 
 6.78 P = .95 

6.82 n and P: answers are .3821, .1711, .0013. 

6.84 P, alpha 
Answers are z=1.64 (P=.0505) and
 z=1.65 (P=.0495) 
                                                  
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 

Optional
A.  Use the Applet:  Power of a test. to get a feel for these issues:
Take the shoeboxes situation:  Ho : µ = 20; sigma = 4.  Ha : µ > 20
1) (Changeµ) Start with n = 4 (our situation).  Set alpha = .10.  Watch the lower distribution move, and Find the power of the test for µ = 21, 22, 23, 24, 25, 26, 27. (Hit Update if needed between different values)  (Hint. Power = .761 for µ =24).
Graph your results (by hand is fine), with µ on the horizontal axis and power on the vertical, and connect the dots smoothly.  You've constructed a "Power curve".

2) Assume µ =24, really!  (same setup as before, n = 4, sigma = 4 ).  If alpha = .10, Power = .761.  Change alpha up and down (smaller and larger than .10).  Notice that smaller alpha means smaller power to detect the alternative,  and vice versa--we're just moving the cutoff line in both pictures.  (Nothing to write down)

3) Assume µ =24, really!  (same setup as before). Set  alpha = .10. If n = 4, Power = .761, about a 3/4 chance of detecting that the mean is really >20.  Suitable for my class example, where I wanted some people to NOT detect it. Not so good for real work.
Find the power for n = 8, 12, 16, 20.  Graph n (4 to 20) on the horizontal axis and power on the vertical axis; connect the dots smoothly.  From your graph, what sample size should I use if I want 95% power (approximately)
- - - - -  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
Exam 2: Open book takehome.  Available today (pink folder outside my door).
Due by 1 pm Monday  Nov. 21 (Day 37)  Covers Chapter 3 through 6.3. Start it now, since there's little HW tonight!

Quiz Monday: Wednesday! to write down these definitions (memorize them):  I want the general definitions, not just formulas for the tests of µ.
>>"A Level C confidence interval for a parameter is...._ __ __ __ __ __ __"
>>P-value for a test.
>>"A test is significant at level alpha = .05 if the P-value__________________"

Homework questions, 6.2? Day 32
Sec. 6.3, odds and ends about significance testing. Notes Day 32
Monday: finish Day 32 (6.3: multiple tests), then the brief look at 6.4 below, then 7.1.
Sec. 6.4
[New York Times, Nov. 13, 01--report on the finding of the first anthrax case in New York City:  The test that was first used was new; they hadn't had time to confirm the results by the usual method of growing a culture.] 
Dr. Koplan, director of the Centers for Disease Control and Prevention, on the phone with Mayor Giuliani: 
    "Are you sure it's anthrax?" the mayor asked. 
    "Well, we have a high degree of probability," Dr. Koplan replied. 
    "No, no, no, don't give me that [stuff]," was the mayor's rejoinder. "Is it anthrax or is it not?' 
    "Yes," Dr. Koplan said. 
    "Fine, that's all I needed to hear," Mr. Giuliani said.

"Significance testing" vs. "Hypothesis testing"-- two different approaches that blur... (Sec.6.4)
Both start with null and alternative hypotheses.  You want to show the alternative is true.

Significance testing:  Calculate P-value (or closest alpha), describe how unusual your result is if H0 is true.
Let the audience for your work decide if they believe in the alternative hypothesis or not.  (Scientist's approach.)
   Language: "strong evidence for Ha, against H0 or not strong...

Hypothesis testing:  Make a decision  between H0 and Ha (often associated with predetermined fixed alpha level)
We need to do something.  (Business, government?)
    Language:  "Accept Ha, reject H0" if P-value smaller than alpha.
        What if we can't reject H0?  Do we accept H0? Safer: "fail to reject H0"
    H0 "Innocent"                 "Guilty" Ha
                  \ "Not Proven" /         but defendant goes free...

If we make a decision we run the risk of error:
Type I error Accepting alternative Ha when null H0 is true (probability = alpha)  Test designed to focus on this one.
Type II error, Accepting null H0 when alternative  Ha is true (probability = beta, depends on what exact parameter value in  Ha is true)  Can't make this one if we refuse to commit, but
A small Type II error means the "power" of the test to detect  that the alternative hypothesis is true,  when it really is true-- is high.
the truth
Ho is true Ha is true (some particular value)
my Reject Ho Type I error (Prob. = alpha) OK (Prob. = Power) 
decision Accept Ho OK Type II error (Prob. = beta)
                       Each column's probabilities are conditional on its "truth".  Probabilities in each column add to 1.
Power = 1 - P(type II error).  Varies with what actual parameter value is true.  The farther from H0 the real parameter value is, the higher the power of any test to detect it (Sec. 6.4, skim it, takes this further)

Larger sample size gives stronger power to detect a true alternative.
Applet:  Power of a test.
(Pure decision theory:  neither hypothesis or error type is "privileged" as alpha is here)
- - - - - - - - - - - - - - - - - - - - -
7.1 Inference for the mean (sigma unknown)
Need a new probability model--"Student's t" (Table D), which will compensate for not knowing sigma; then all the processes the same.
t- family:  like standard normal only slightly fatter in the tails.  Mean = 0. Symmetrical around 0.
    "Degrees of freedom" df tell which member of the t family.
      t(k) is the t distribution with k degrees of freedom.  (k is not sample size, but close.)
 Comparison with normal (Excel file)
    Lower d.f.--fatter tails.  Higher d.f.--more like standard normal.
    Table D back flyleaf: "One tail probability" (upper tail):  probability <--> "critical" t-value.


Sievers home  Math251-Fall05/DayP33.htm  11am   11/11/05
This page belongs to Sally Sievers who is solely responsible for its content. Please see our statement of responsibility.