Final exam

The purpose of this exam is to give you the opportunity to formulate research questions, run the analyses, and interpret the results of the statistics covered in this class. The final exam is due by midnight on the due date, Tuesday, December 8, 2015, as a single Microsoft Word document placed in the dropbox. The document must be in APA format.

Please read through the entire exam first.

The exam consists of three sections

I. The research scenario—to provide the context for the data. Please note that the data are “content-neutral,” i.e., they do not refer to a specific discipline or field.

II. The codebook—this identifies the variables (names, labels, and measurement scale) in the database.

III. The exam instructions—for completing the exam. Be sure to read each question carefully and answer each question completely.

I. Research Scenario:

An organization wants to know if participants with varying levels of expertise (professionals, paraprofessionals, and nonprofessionals) improve their knowledge after completing a training program.

The organization collected demographic information: gender, age, type of training (professional, paraprofessional, or nonprofessional), location of the worksite (on-site or off-site) and years of experience.

A pre-training test of knowledge, a training program, and post-training test of knowledge was developed. Participants were tested, then participated in the three-week training program, and then were tested again.

The dataset also includes (1) a measure of participant confidence in knowledge and (2) a certification exam score.

The data are discipline-neutral. Therefore, part of your final project is to create a context for the research that is associated with your discipline or area of interest (e.g., training to assess mental health status; training to work with special education children; training to become a technician or consultant).

II. Codebook

Variable Information

III. Exam Instructions

Overview Your task is to review the dataset, formulate a context, and then use your knowledge of statistics to answer the research questions and test hypotheses that will help the organization evaluate the effectiveness of the program.

Part I. Create your context.

Using the research scenario and variables identified in the codebook, create a “story” that describes the purpose and focus of the study. In a few paragraphs describe the intent of your investigation in the form of a problem background and purpose statement.

Part II. Describe your sample.

Generate frequency tables and bar charts for the nominal variables. Generate and interpret descriptive statistics of central tendency, variability, skewness, and kurtosis for the continuous (scale) variables. Generate frequency tables and histograms with the normal curve superimposed for each scale variable. Label your tables and graphs according to APA format. Conclude with a paragraph summarizing the demographic characteristics of this sample.

1. Gender (nominal)

2. Age (scale)

3. Qualification (nominal)

4. Worksite (nominal)

5. Knowledge1 (scale)

6. Knowledge2 (scale)

7. Years (scale)

8. Confidence (scale)

9. Exam (scale)

Part III. Describe relationships among the variables.

Select the variables that are measured on interval or ratio scales. Create a correlation matrix.  Label the table according to APA format. Identify and discuss the strongest and weakest correlations.

Part IV. Answer any FOUR of the nine following research questions. Clearly identify which question(s) you have selected to answer by writing the number associated with the question (1-9) before each answer. Make sure to select four questions that must be answered by 4 DIFFERENT tests. For example. One t-test, one ANOVA, one regression and one chi-square; NOT a single sample t-test, independent sample t-test and paired sample t-test as these all fall under t-test.

Based on the research scenario and the data, restate the research question, identify the Independent and Dependent Variable(s), formulate the hypothesis, conduct an analysis, and interpret the results for each of the following. Please use the 7 step hypothesis testing model for each analysis, including an APA-style conclusion statement summarizing the findings, interpreting the results and answering the research question.

1. Is there a significant difference in knowledge between on-site and off-site workers  before  they take the training?

2. Is there a significant increase in knowledge as a result of the training?

3. Do participants of different classifications (professional, paraprofessional, and nonprofessional) perform differently on the certification exam? Which group performs best?

4. What are the effects of gender and worksite location (on- or off-site) on level of confidence? In other words:

d. Is there a gender difference in confidence?

d. Does type of worksite experience affect confidence?

d. Is there an interaction between gender and worksite in their effect on confidence?

1. After controlling for prior knowledge, is there a difference between professionals, paraprofessionals, and non-professionals in knowledge after the training?

1. Does age predict performance on the certification exam?

1. In addition to age, does confidence improve the ability to predict performance on the certification exam?

1. Does the distribution of the classifications of participants (professional, paraprofessional, and nonprofessional) differ than what one would expect by chance?

1. Does the distribution of the classifications (professional, paraprofessional, and nonprofessional) differ from the State data reported as 15%, 25% and 60%?

Part V. Summarize your findings.

Synthesize the results of your five analyses. Include a brief summary of the sample characteristics and the major findings. Interpret the findings so that the organization’s leaders will have an understanding of the similarities and differences in knowledge, and how effective the training program is in improving knowledge.

Appendix 13.2 Obtaining Project Performance Information from MS Project The objective of this appendix is to illustrate how one can obtain the performance information discussed in Chapter 13 from MS Project 2007. One of the great strengths of MS Project is its flexibility. The software provides numerous options for entering, calculating, and presenting project information. Flexibility is also the software’s greatest weakness in that there are so many options that working with the software can be frustrating and confusing. The intent here is to keep it simple and present basic steps for obtaining performance information. Students with more ambitious agendas are advised to work with the software tutorial or consult one of many instructional books on the market. For purposes of this exercise we will use the Digital Camera project, which was introduced in Chapter 13. In this scenario the project started as planned on March 1 and today’s date is March 7. We have received the following information on the work completed to date: Design Spec.s took 2 days to complete at a total cost of $20. Shell & Power took 3 days to complete at a total cost of $25. Memory/Software is in progress with 4 days completed and two days remaining. Cost to date is $100. Zoom System took 2 days to complete at a cost of $25. All tasks started on time. STEP 1 ENTERING PROGRESS INFORMATION We enter this progress information in the TRACKING TABLE from the GANTT CHART VIEW c TABLE c TRACKING: Period SPI CPI PCIB 1 —— —— —— 2 —— —— —— 3 —— —— —— 4 —— —— —— 5 —— —— —— TABLE A13.2A Tracking Table ID Task Name Act. Start Act. Finish % Comp . Act. Dur. Rem. Dur. Act. Cost Act. Work 1 Digital Camera Prototype 3/1 NA 61% 6.72 days 4.28 days $170.00 272 hrs 2 Design Spec.s 3/1 3/2 100% 2 days 0 days $20.00 32 hrs 3 Shell & Power 3/3 3/7 100% 3 days 0 days $25.00 40 hrs 4 Memory/Software 3/3 NA 67% 4 days 2 days $100.00 160 hrs 5 Zoom System 3/3 3/4 100% 2 days 0 days $25.00 40 hrs 6 Assemble NA NA 0% 0 days 3 days $0.00 0 hrs 7 Test NA NA 0% 0 days 2 days $0.00 0 hrs Lar03342_ch13_452-503.indd Page 501 2/1/10 4:53:59 PM user-f498 /Users/user-f498/Desktop/01:02_evening/MHBR165:Larson:208 502 Chapter 13 Progress and Performance Measurement and Evaluation When you scale this table to 80 percent you can obtain all the basic CV, SV and VAC information on one convenient page. Note: Older versions of MS Project use the old acronyms: BCWS 5 PV BCWP 5 EV ACWP 5 AC and the EAC is calculated using the CPI and is what the text refers to as EACf . STEP 3 ACCESSING CPI INFORMATION To obtain additional cost information such as CPI and TCPI click from the GANTT CHART view click TABLE c MORE TABLES c EARNED VALUE COST INDICATORS, which will display the following information: TABLE A13.2B Earned Value Table ID Task Name PV EV AC SV CV EAC BAC VAC 2 Design Spec.s $20.00 $20.00 $20.00 $0.00 $0.00 $20.00 $20.00 $0.00 3 Shell & Power $15.00 $15.00 $25.00 $0.00 ($10.00) $25.00 $15.00 ($10.00) 4 Memory/Software $100.00 $70.00 $100.00 ($30.00) ($30.00) $153.85 $100.00 ($53.85) 5 Zoom System $35.00 $35.00 $25.00 $0.00 $10.00 $25.00 $35.00 $10.00 6 Assemble $0.00 $0.00 $0.00 $0.00 $0.00 $120.00 $120.00 $0.00 7 Test $0.00 $0.00 $0.00 $0.00 $0.00 $30.00 $30.00 $0.00 $170.00 $140.00 $170.00 ($30.00) ($30.00) $373.85 $320.00 ($53.85) Note that the software automatically calculates the percent complete and actual finish, cost, and work. In some cases you will have to override these calculations if they are inconsistent with what actually happened. Be sure to check to make sure the information in this table is displayed the way you want it to be. The final step is to enter the current status date (March 7). You do so by clicking PROJECT c PROJECT INFORMATION and inserting the date into the status date window. STEP 2 ACCESSING PROGRESS INFORMATION MS Project provides a number of different options for obtaining progress information. The most basic information can be obtained from REPORT c REPORTS c COSTS c EARNED VALUE. TABLE A13.2C Earned Value Cost Indicators Table ID Task Name PV EV CV CV% CPI BAC EAC VAC TCPI 1 Digital Camera Prototype $170.00 $140.00 ($30.00) 221% 0.82 $320.00 $373.85 ($53.85) 1.2 2 Design Spec.s $20.00 $20.00 $0.00 0% 1 $20.00 $20.00 $0.00 3 Shell & Power $15.00 $15.00 ($10.00) 266% 0.6 $15.00 $25.00 ($10.00) 4 Memory/Software $100.00 $70.00 ($30.00) 242% 0.7 $100.00 $153.85 ($53.85) 5 Zoom System $35.00 $35.00 $10.00 28% 1.4 $35.00 $25.00 $10.00 6 Assemble $0.00 $0.00 $0.00 0% 0 $120.00 $120.00 $0.00 7 Test $0.00 $0.00 $0.00 0% 0 $30.00 $30.00 $0.00 Lar03342_ch13_452-503.indd Page 502 2/9/10 10:15:02 AM user-f498 /Users/user-f498/Desktop/TEMPWORK/February 2010/09:02/MHBR165:Larson:208 Chapter 13 Progress and Performance Measurement and Evaluation 503 TABLE A13.2D Earned Value Schedule Indicators Table ID Task Name PV EV SV SV% SPI 1 Digital Camera Prototype $170.00 $140.00 ($30.00) 218% 0.82 2 Design Spec.s $20.00 $20.00 $0.00 0% 1 3 Shell & Power $15.00 $15.00 $0.00 0% 1 4 Memory/Software $100.00 $70.00 ($30.00) 230% 0.7 5 Zoom System $35.00 $35.00 $0.00 0% 1 6 Assemble $0.00 $0.00 $0.00 0% 0 7 Test $0.00 $0.00 $0.00 0% 0 STEP 4 ACCESSING SPI INFORMATION To obtain additional schedule information such as SPI from the GANTT CHART view, click TABLE c MORE TABLES c EARNED VALUE SCHEDULE INDICATORS, which will display the following information: STEP 5 CREATING A TRACKING GANTT CHART You can create a Tracking Gantt Chart like the one presented on page 456 by simply clicking VIEW c TRACKING GANTT Tracking Gantt Chart Digital Camera Project ID Task Name March 6 March 13 1 Digital Camera Prototype Design Spec.s MTWT FSSMTWT FSSM W T 0% 0%