Why Pilot Study Questions Come Up in the Viva
Examiners in Malaysian postgraduate vivas frequently ask about pilot studies because they reveal whether a researcher’s data collection was genuinely rigorous or whether the instruments and procedures were used without adequate preliminary testing. A well-described pilot study shows that you anticipated potential problems with your instruments, tested them in conditions similar to the actual study, made adjustments based on what you learned, and then deployed improved instruments in the main data collection. This progression demonstrates research maturity. Being prepared to discuss your pilot study in the viva — or to honestly explain why one was not conducted — requires specific preparation.
What to Describe When Discussing Your Pilot Study
When discussing your pilot study in the viva, prepare to address four specific elements. First, who participated in the pilot — how many participants, how they were selected, and why they were appropriate for testing the instrument (similar enough to the target population but not part of the main study sample). Second, what the pilot tested — the clarity of instrument language, the appropriateness of the response format, the estimated completion time, and any technical issues with online platforms or recording equipment. Third, what the pilot revealed — which items were unclear, which response options were confusing, which questions were too sensitive to answer directly, and how long data collection actually took compared to estimates. Fourth, what changes were made as a result — the specific revisions to the instrument, the protocol, or the procedure that improved the main study.
This four-element account demonstrates that the pilot was a genuine iterative improvement process rather than a perfunctory trial run conducted to satisfy a methodological requirement without actually using what was learned.
If Your Pilot Study Was Minimal or Absent
Sometimes resource constraints, access limitations, or timeline pressures mean the pilot study was briefer than ideal, or in some cases did not occur. If an examiner asks about your pilot study and the honest answer is that it was minimal, be transparent about this rather than overstating what was done. “Due to access constraints, my pilot was limited to cognitive interviews with three participants who reviewed the instrument for clarity rather than a full field trial” is an honest and defensible answer. It acknowledges the limitation, describes what was done within the constraint, and implies an awareness of what a more thorough pilot would have involved.
If no pilot was conducted at all, explain why and acknowledge the limitation: “A full pilot was not conducted due to [specific constraint]. I addressed this by [specific compensatory measure — using a validated published instrument, conducting member checking, using a staged analysis process]. In retrospect, a pilot would have been valuable for [specific aspect of the study that turned out to be more difficult than anticipated].” This honest, reflective response is more credible than pretending a pilot occurred or dismissing the question as irrelevant to your study design.
