General instructions:
Please complete the following assignment corresponding to Parts 1 & 2 of Instrument Validation by no later than Monday, [Date] at 11pm SAST/12am EAT.
At the end of the assignment we ask you to please note 1) approximately how much time you spent on the homework and how much time you spent reviewing the materials (videos and learning checks) , 2) what questions, if any, you have from the videos and/or any places you might have gotten stuck in the assignment, and 3) provide your feedback on the this week’s content and materials. Thank you once again for your assistance in completing these additional questions!
Quiz Summary
0 of 17 Questions completed
Questions:
Information
You have already completed the quiz before. Hence you can not start it again.
Quiz is loading…
You must sign in or sign up to start the quiz.
You must first complete the following:
Results
Results
0 of 17 Questions answered correctly
Your time:
Time has elapsed
You have reached 0 of 0 point(s), (0)
Earned Point(s): 0 of 0, (0)
0 Essay(s) Pending (Possible Point(s): 0)
Categories
- Not categorized 0%
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- Current
- Review
- Answered
- Correct
- Incorrect
-
Question 1 of 17
1. Question
1. Tests that are highly reliable are likely to have standard error of measurements that are __________ than in similar tests with low reliability.
CorrectIncorrect -
Question 2 of 17
2. Question
Answer Q2-4 based on the following information. The first 60 new patients, ages 20-69, seen after July 1, 2003 at a large psychiatric outpatient clinic were examined independently by two staff psychiatrists who diagnosed each patient as schizophrenia or non-schizophrenia (either having other psychotic disorder or non-psychotic). The table below shows the number of patients cross-classified by the diagnoses of both psychiatrists.
2. What percentage of the time did the two psychiatrists agree in their diagnosis of schizophrenia vs non-schizophrenia?
-
This response will be reviewed and graded after submission.
Grading can be reviewed and adjusted.Grading can be reviewed and adjusted. -
-
Question 3 of 17
3. Question
3. Given the overall frequency with which the two psychiatrists diagnosed the patient as schizophrenia vs non-schizophrenia, how much agreement would one expect just by chance?
-
This response will be reviewed and graded after submission.
Grading can be reviewed and adjusted.Grading can be reviewed and adjusted. -
-
Question 4 of 17
4. Question
4. Calculate kappa by hand. You are encouraged to use either R or STATA to verify your result. How good is this level of concordance after correcting for chance agreement?
-
This response will be reviewed and graded after submission.
Grading can be reviewed and adjusted.Grading can be reviewed and adjusted. -
-
Question 5 of 17
5. Question
5. You develop a new survey measure of depression based on a pilot sample that consists of roughly 50% depressed and 50% non-depressed. The table below shows the number of patients cross-classified by two different psychiatrists. Based on the table, calculate kappa by hand, and interpret your results.
-
This response will be reviewed and graded after submission.
Grading can be reviewed and adjusted.Grading can be reviewed and adjusted. -
-
Question 6 of 17
6. Question
6. Emboldened by your findings, you find funding and administer your survey to a nationally representative sample, among which the prevalence of depression is around 10%. The table below shows the number of patients cross-classified by two different psychiatrists. Based on the table, calculate kappa by hand, and interpret your results.
-
This response will be reviewed and graded after submission.
Grading can be reviewed and adjusted.Grading can be reviewed and adjusted. -
-
Question 7 of 17
7. Question
7. How is your kappa in Q6 compared to that in the pilot sample? What might explain the change in reliability?
-
This response will be reviewed and graded after submission.
Grading can be reviewed and adjusted.Grading can be reviewed and adjusted. -
-
Question 8 of 17
8. Question
Read the following paper. Answer Q8-Q9.
8. What measures of reliability were assessed in this study? What did the author conclude about the reliability based on their results?
-
This response will be reviewed and graded after submission.
Grading can be reviewed and adjusted.Grading can be reviewed and adjusted. -
-
Question 9 of 17
9. Question
9. Given what you found in Q7, do you have any concerns with the reliability results from this study? If so, what would you do to improve the study?
-
This response will be reviewed and graded after submission.
Grading can be reviewed and adjusted.Grading can be reviewed and adjusted. -
-
Question 10 of 17
10. Question
How much time did you spend on this homework?
-
This response will be reviewed and graded after submission.
Grading can be reviewed and adjusted.Grading can be reviewed and adjusted. -
-
Question 11 of 17
11. Question
Please include here any questions from the recorded lectures or homework that you would like to be addressed during the lab session.
-
This response will be reviewed and graded after submission.
Grading can be reviewed and adjusted.Grading can be reviewed and adjusted. -
-
Question 12 of 17
12. Question
Your feedback is important to us. So that we can adequately adjust the lecture materials, please answer the questions below relating to each of this week’s topics:
Part 1: Overview
Was the amount of information presented too little, just right, or too much?
CorrectIncorrect -
Question 13 of 17
13. Question
The lecture’s contents were clearly explained.
CorrectIncorrect -
Question 14 of 17
14. Question
How was the pace of the lecture?
CorrectIncorrect -
Question 15 of 17
15. Question
Part 2: Measures of Reliability
Was the amount of information presented too little, just right, or too much?
CorrectIncorrect -
Question 16 of 17
16. Question
The lecture’s contents were clearly explained.
CorrectIncorrect -
Question 17 of 17
17. Question
How was the pace of the lecture?
CorrectIncorrect