Why Research Instrument Descriptions Are Often Inadequate
The description of research instruments in a Malaysian postgraduate thesis methodology chapter is frequently inadequate in ways that have real consequences for the thesis’s credibility. Students describe their survey instruments in one or two sentences without specifying the number of items, the scaling approach, the dimensions measured, or the validity and reliability evidence. They describe their interview protocol as “semi-structured” without specifying the number of questions, the themes addressed, or how the protocol was developed and piloted. These thin descriptions leave examiners unable to evaluate whether the instruments were appropriate for the research questions and whether the data they generated can support the claims made in the findings chapter.
Writing about research instruments clearly in your methodology chapter means providing enough detail that a competent researcher in your field could evaluate the appropriateness of the instrument and, ideally, replicate its use — the replicability standard that applies to methodology writing generally.
What Survey Instrument Descriptions Must Include
A complete survey instrument description in a methodology chapter addresses several specific elements. First, the source and adaptation of the instrument — was it a published, validated instrument used without modification, a validated instrument adapted for the Malaysian context, or an instrument developed specifically for this study? Each of these has different implications for the level of validity evidence required. Second, the structure of the instrument — how many sections, how many items in total, what constructs each section measures, and what response scale was used (Likert scale with how many points? Semantic differential? Dichotomous yes/no?).
Third, the validity and reliability evidence — the Cronbach’s alpha values for each subscale, the factor analysis results if relevant, and any cross-validation evidence from prior use of the instrument in comparable populations. Fourth, any modifications made to the original instrument and the rationale for those modifications. Fifth, the piloting process — how many participants were in the pilot, what the pilot revealed, and what changes were made as a result. Each of these elements contributes to the examiner’s ability to evaluate the quality of the data the instrument produced.
What Interview Protocol Descriptions Must Include
Interview protocol descriptions in Malaysian qualitative and mixed-methods theses are typically less detailed than they should be. A complete description addresses: the overall structure of the interview (how many main questions, whether probe questions were used, estimated duration), the themes addressed in the protocol and how they connect to the research questions, the process by which the protocol was developed (from the literature? from a pilot study? from theoretical framework constructs?), the language of administration (English, Bahasa Malaysia, or bilingual?), and the piloting process including what the pilot revealed about question clarity and timing.
Include the full interview protocol in an appendix and reference it explicitly in the methodology chapter. “The full interview protocol is provided in Appendix B” with a summary of its structure in the methodology text gives examiners both the overview they need for evaluation and access to the full instrument for detailed scrutiny if they choose to consult it.
Connecting Instrument Design to Research Questions
The most analytically sophisticated instrument descriptions in Malaysian methodology chapters explicitly connect instrument design decisions to research questions. “The survey instrument was structured in three sections, corresponding to the three research objectives. Section A measured intrinsic motivation using the Academic Motivation Scale, which was selected for its theoretical grounding in self-determination theory — the framework adopted in this study. Section B measured completion intention using a scale developed specifically for this study because no existing validated instrument captured the specific dimensions of completion intention relevant to the Malaysian part-time doctoral context.” This description tells the examiner not just what the instrument contains but why it was constructed that way, which is the methodological transparency that rigorous research reporting requires. Writing about research instruments clearly in your methodology chapter, with this level of specificity and justification, transforms a potentially weak chapter section into one of the strongest demonstrations of your research competence in the entire thesis.
