...
Search committee members should perform reference checks of each finalist, asking the same questions to each reference about each candidate.
Example reference check questions
...
How well and in what capacity do you know the candidate?
Can you give me an example of a time the candidate [demonstrated skill/aptitude at a required or preferred function of the job]?
What are the candidate's strengths and challenges?
For new scholars: What can you tell me about the candidate's potential for continued success as a scholar?
...