Year 2015, Volume 2, Issue 1, Pages 3 - 21 2016-07-11

Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation

Kelly D. Bradley [1] , Michael Peabody [2] , Shannon O. Sampson [3]

141 485

This study utilized the Rasch model to assess the quality of a survey instrument designed to measure attitudes of administrators and teachers concerning a differentiated teacher compensation program piloted in Kentucky. Researchers addressing potentially contentious issues should ensure their methods stand up to rigorous criticism. The results indicate that the rating scale does not function as expected, with items being too easy to endorse. Future iterations of this survey should be revised prior to release. Recommendations for improvement are provided.
Rasch measurement, Survey design, Rating Scale, Teacher Compensation
  • Andrich D., (1978). A Rating Formulation for Ordered Response Categories. Psychometrika, 43(4), 561-573.
  • Becker G., (2001). Controlling Decremental and Inflationary Effects in Reliability Estimation Resulting from Violations of Assumptions. Psychological Reports, 89(2), 403-424. doi: 10.2466/pr0.2001.89.2.403
  • Bond T.G. & Fox C.M., (2001). Applying the Rasch Model: Fundamental Measurement in the Human Sciences. Mahwah, NJ: Lawrence Erlbaum.
  • Bradley K.D. & Sampson S.O., (2005). A case for using Rasch Rating Scale analysis to assess the quality of measurement in survey research. The Respondent, 12-13.
  • Fisher W., (1992). Reliability, Separation, Strata Statistics. Rasch Measurement Transactions, 6(3), 238.
  • Guttman L., (1944). A Basis for Scaling Qualitative Data. American Sociological Review, 9(2), 139-150.
  • Hambleton R.K., Swaminathan, H., & Rogers, H.J., (1991). Fundamentals of Item Response Theory. New York: Sage Publications.
  • Linacre J.M., (2002a). Optimizing Rating Scale Category Effectiveness. Journal of Applied Measurement, 3(1), 85-106.
  • Linacre J.M., (2002b). What do Infit and Outfit, Mean-square and Standardized mean? Rasch Measurement Transactions, 16(2), 878.
  • Linacre J.M., (2004). Winsteps Rasch Measurement computer program (Version 3.51). Beaverton, OR: Winsteps.com.
  • Rasch G., (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark.: Danish Institute for Educational Research.
  • Wright B.D. (1996). Reliability and Separation. Rasch Measurement Transactions, 9(4), 472.
  • Wright B.D., (1997). Fundamental Measurement for Outcome Evaluation. Physical Medicine and Rehabilitation: State of the Art Reviews, 11(2), 261-288.
  • Wright B.D. & Masters G.N., (1982). Rating scale analysis. Chicago: MESA Press.
  • Wright B.D. & Stone M.H., (1979). Best Test Design. Chicago: MESA Press.
Subjects
Other ID JA43AF62AF
Journal Section Articles
Authors

Author: Kelly D. Bradley

Author: Michael Peabody

Author: Shannon O. Sampson

Bibtex @ { ijate239565, journal = {International Journal of Assessment Tools in Education}, issn = {}, eissn = {2148-7456}, address = {İzzet KARA}, year = {2016}, volume = {2}, pages = {3 - 21}, doi = {10.21449/ijate.239565}, title = {Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation}, key = {cite}, author = {Bradley, Kelly D. and Peabody, Michael and Sampson, Shannon O.} }
APA Bradley, K , Peabody, M , Sampson, S . (2016). Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation. International Journal of Assessment Tools in Education, 2 (1), 3-21. DOI: 10.21449/ijate.239565
MLA Bradley, K , Peabody, M , Sampson, S . "Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation". International Journal of Assessment Tools in Education 2 (2016): 3-21 <http://submit.ijate.net/issue/22373/239565>
Chicago Bradley, K , Peabody, M , Sampson, S . "Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation". International Journal of Assessment Tools in Education 2 (2016): 3-21
RIS TY - JOUR T1 - Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation AU - Kelly D. Bradley , Michael Peabody , Shannon O. Sampson Y1 - 2016 PY - 2016 N1 - doi: 10.21449/ijate.239565 DO - 10.21449/ijate.239565 T2 - International Journal of Assessment Tools in Education JF - Journal JO - JOR SP - 3 EP - 21 VL - 2 IS - 1 SN - -2148-7456 M3 - doi: 10.21449/ijate.239565 UR - https://doi.org/10.21449/ijate.239565 Y2 - 2019 ER -
EndNote %0 International Journal of Assessment Tools in Education Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation %A Kelly D. Bradley , Michael Peabody , Shannon O. Sampson %T Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation %D 2016 %J International Journal of Assessment Tools in Education %P -2148-7456 %V 2 %N 1 %R doi: 10.21449/ijate.239565 %U 10.21449/ijate.239565
ISNAD Bradley, Kelly D. , Peabody, Michael , Sampson, Shannon O. . "Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation". International Journal of Assessment Tools in Education 2 / 1 (July 2016): 3-21. https://doi.org/10.21449/ijate.239565