Once a candidate has completed your Screen session, you'll use their Candidate Report to review their score. Reading these reports correctly is really important to ensure you're identifying which candidates you want to move forward with first.
MORE DETAILS:
You have several tabs you can switch between: Summary (overall summary of the session), Review (check review results done by your internal Reviewer), Details (candidate and session details), Timeline (time used and user notes) and Codelive Rooms (associated Interview sessions).
In the header you also have buttons that will allow you to export the report in PDF format as well as cancel, reopen, or share the test session.
OVERALL TEST SCORE:
The first thing you'll see is the candidate's overall test score, made up of the combined total points achieved on each task. It factors in both the code's correctness and performance, and also includes the similarity check indicator so you can easily tell if the candidate's work is their own. You can stack rank candidates by this overall score, and then dig deeper to see how they reached this total, task by task.
INDIVIDUAL TASK SCORE:
Every task is scored for correctness, and where possible, also performance.
PERFORMANCE SCORE:
"Performance" corresponds to how their solution performs with large data-sets in terms of running time complexity. To produce scalable code, a candidate requires good algorithmic knowledge and developed programming skills. In other words, for a candidate’s solution to be scalable, it must be suitably efficient and practical when applied to large data-sets.
CORRECTNESS SCORE:
"Correctness" is the program’s ability to produce correct results for inputs of moderate sizes, including various corner cases. For a programmer to produce code that runs correctly requires care, attention to detail and a good understanding of both the problem and the programming language. Where performance cannot be assessed, correctness is the only contributor towards the total score. If a candidate passes all the test cases, he or she gets the maximum score. If the answer is wrong the details of what was expected and what the actual output was is provided.
TASK TIMELINE:
- Dark blue line: Actively present in the IDE
- Light blue line: Out of focus
- Pink Arrow: Text pasted into the editor
- White Arrow: Verification attempt
- Blue Arrow: Final code of your candidate
You can use the timeline to get a play-by-play of what the candidate was doing over the course of their given task. The arrows help highlight key points in their coding session so you can look at what they were attempting to verify and what they imported from an external source.
We like to emphasize that just because something was pasted into the editor, it doesn't mean that the candidate cheated. A lot of candidates like to use their own IDE for writing the bulk of the code, and then fine-tune it inside our editor as they run verifications.
If you have any additional questions about candidate test report or would like to leave your feedback, please reach out to your Customer Success Manager or contact us at support@codility.com.