This week, you’ll take major steps toward completing the draft of your final research proposal. You can utilize the thinking, research, and writing about instrumentation last week as well as the helpful comments of your colleagues to help you craft the first part of this submission. You can also utilize the work you do to prepare for this week’s Discussion Forum about data collection methods to help inform the second part of the submission. You may have less feedback from colleagues by the time you write your submission, but this part of the paper is a little more intuitive than some of the other parts likely have been. The third part of the paper requires that you consider the limitations that all the methodological decisions you’ve made thus far impose. A table is included below to help guide your thinking about this issue.
Research Summary and Recommendations Paper, Part 2 – Total 100 points
1) Describe your instrument / instruments.
a. Would you use quantitative methods, qualitative methods, or both? Why?
b. If using quantitative instruments, explain whether you would make your own instruments or use existing instruments? If you propose to make your own, describe how you would do this and how you would assure the reliability and validity of the instruments. If you propose using existing instruments, identify the instruments and justify their reliability / validity.
c. If using qualitative instruments (note: qualitative instruments are not usually used in the absence of quantitative instruments for evaluation research), describe how you would develop these questions and what you would do to ensure that the findings you derive on the basis of these instruments are trustworthy (a qualitative analogue of measurement validity and reliability)
2) Discuss data collection methods.
a. How will you actually utilize the instruments with your sample to collect data? Will you use an electronic survey? If so, how will it be delivered? Will you use an in-person survey or interview? Will you use observational data or administrative data? Explain in detail and justify the feasibility of your data collection methods choices. Identify the strengths and weaknesses of the strategies you described.
3) Methodological limitations – identify the major limitations of the methods you selected. These are usually related to design (if the design is not a true experiment), sample (if the sample was not randomly selected or does not represent the entire population to which you would like to generalize your findings), and instruments (if reliability and validity of instruments is not known or is limited). A quick table for reference is below.
Table 1
Examination of Methodological Limitations
Topic |
Type of validity |
Most valid methods |
Methods that impose limitations |
Research Design |
Internal validity |
True experiment: random assignment to groups with pre- and post-testing |
Quasi-experimental and pre-experimental methods |
Sampling |
External validity |
Probability sampling (generally random sampling) |
Non-probability sampling: convenience / availability, quota, purposive / judgmental, and snowball samples |
Instrumentation |
Measurement validity and reliability |
Scales / standardized instruments that have been tested for validity and reliability |
Self-developed questionnaires |
The rubric for this assignment is available in the Assignment Descriptions document at the top of your Moodle page.