Example Quiz Items

1. The level of measurement which only classifies (categorizes) data is:
          a. Nominal
          b. Ordinal
          c. Interval
          d. Ratio

2. The statistical index reflecting the relevance of the items on a test is:
          a. Reliability
          b. Validity
          c. Practicality
          d. Difficulty

3. This method measures the consistency of the examinee?s scores between two 
   administration of tests.
          a. Split Half Method
          b. Test-Retest Method
          c. Internal Analysis Method
          d. Equivalent Forms

4. Which of the following is a measure of central tendency in a set of scores:
          a. Mean
          b. Median
          c. Mode
          d. All of the above

5. Which of the following is a measure of the association between two sets of 
   test scores:
          a. Mean
          b. Standard deviation
          c. Correlation
          d. Skewness

6. Which of the following research methods is usually considered 
   "theory testing"
          a. Qualitative
          b. Quantitative
          c. Ethnographic
          d. Descriptive

7. Which of the following classes of statistical procedures is usually 
   considered most appropriate for testing data gathered from 
   small (< 30) samples?
          a. Parametric
          b. Non-parametric
          c. Fractal
          d. Stochastic

8. A statistical index which is useful for meta-analysis because I provides a 
   standard way of looking at results across studies is:
          a. Effect size
          b. Sample size
          c. Regression coefficient
          d. Mean differences

9. Which of the following error types consists of falsely rejecting the null 
          a. Type I
          b. Type II
          c. Type III
          d. None of the above
10. Which of the following error types has a probability qual to the alpha level 
   (alpha) of the statistical test ?
          a. Type I
          b. Type II
          c. Type III
          d. None of the above

(Short Essay)
11. Briefly contract a ?within? factor versus a ?between? factor in an 
    experimental or quasi-experimental research design.

12. List and discuss two major requirements for a true (versus quasi) 
    experimental design.  In particular, what potential problems can arise if 
    these two requirements are not met.

13. Describe a simple experimental design (a la Campbell and Stanley) to 
    determine if multiple choice test items are better than essay items.  
    Discuss factors jeopardizing internal and external validity (if any) in your 

14. Discuss the current state of knowledge and the probable direction of true 
    effect for one of the following topics: 1) gender and computing, or 2) 
    relationship between Myers-Briggs Personality types and attitudes toward 
    information technology and/or research.  Use the articles discussed in class 
    to justify your position on the topic chosen.