Developing and validating an instrument

Development of a valid and reliable questionnaire is a must to reduce measurement error.Groves (1987) defines measurement error as the "discrepancy between respondents' attributes and their survey responses" (p. Development of a valid and reliable questionnaire involves several steps taking considerable time.Based on the literature review and the examination of English reading readiness instruments, an Arabic instrument (The Egyptian Reading Readiness Screening Profile, ERRSP) was developed and used in the present study.The ERRSP included the following sub-tests: print awareness, rapid letter naming, letter sound association, phonological awareness and orthographic processing.Many of the instruments to measure information and system quality were developed in the context of mainframe and PC-based technologies of yesteryears.With the proliferation of the Internet and World Wide Web applications, users are increasingly interfacing and interacting with web-based applications.Within the two-stage cycle, the formative and summative stages, this study first built arguments for the use of assessment and score interpretations, and verified inferences made from those arguments.

From conceptualization through design, data collection, analysis, and interpretation, critical concerns are identified and grounded in the increasingly sophisticated psychometric literature.The 25-item instrument measures four dimensions of web quality: specific content, content quality, appearance and technical adequacy.While improvements are possible, the instrument exhibits excellent psychometric properties.The final version of the assessment was administered to 2,056 students in 39 higher education institutions across the United States.For the data obtained from this large-scale assessment, a unidimensional model in confirmatory factor analysis and the Graded Response Model in item response theory were employed to examine the arguments regarding the internal structure and item properties.

Leave a Reply