Skip to main content

Questionnaires

Overview

Questionnaires can be employed alongside the primary evaluation method to capture additional attitudinal or cognitive dimensions beyond the main quality criterion. This is an optional component that supplements the mandatory test method.

QExE includes two questionnaires that have been used and validated in the course of the tool's development and associated lab research:

  • NASA Task Load Index (NASA-TLX)
  • Simulator Sickness Questionnaire (SSQ)

Questionnaire integration is controlled by two entries in the configuration file: questionnaireType and questionnaireIntegration.

  • questionnaireType specifies which questionnaire to use.
  • questionnaireIntegration controls when it is presented.
"questionnaireType": "NASA-TLX",
"questionnaireIntegration": "Lace" // Inserted between each scene
"questionnaireIntegration": "End" // Presented after the final scene
"questionnaireIntegration": "None" // Questionnaire disabled

Questionnaires

questionnaireType : NASA-TLX

UI of the NASA-TLX interface

NASA Task Load Index

The interface features a continuous scale from 0–100, with verbal labels Bad, Poor, Fair, Good, and Excellent. No reference button is present, making all ratings relative to one another. As with MUSHRA, conditions can be selected with buttons A, B, C, etc.

DimensionDescription
Mental DemandHow much mental and perceptual activity was required (e.g., thinking, deciding, calculating, remembering, etc.)?
Physical DemandHow much physical activity was required (e.g., pushing, pulling, turning, controlling, activating, etc.)?
Temporal DemandHow much time pressure did you feel due to the rate or pace at which the tasks or task elements occurred?
PerformanceHow successful do you think you were in accomplishing the goals of the tasks set by the experimenter?
EffortHow hard did you have to work (mentally and physically) to accomplish your level of performance?
Frustration LevelHow insecure, discourages, irritated, stressed, and annoyed vs. secure, gratified, content, and relaxed did you feel during the task?

questionnaireType : SSQ

UI of the simulator sickness questionnaire interface

Simulator Sickness Questionnaire

The Simulator Sickness Questionnaire (SSQ) is widely used in VR research to quantify the adverse effects of virtual reality systems on user comfort. Sixteen symptom items contribute to three subscale scores, which are combined into a Total Severity score.

SubscaleDescription
NauseaSymptoms related to gastrointestinal discomfort and general physical unease
Oculomotor DisturbanceSymptoms related to visual fatigue, eyestrain, and difficulty maintaining focus
DisorientationSymptoms related to spatial disorientation, dizziness, and balance disturbance