Use enough questions to assess competence. ...
Have a consistent environment for participants. ...
Ensure participants are familiar with the assessment user interface. ...
If using human raters, train them well. ...
Measure reliability. ...
Conduct regular item analysis to weed out ambiguous or poor performing questions.