Great screening begins with a relevant and well-made CodeCheck Test. This will impact both the experience for the candidate and the quality of the insights you get. 



STEP 1: 

If you're making a test for a specific role, make sure you have your job description handy so you can quickly revise and reference what skills and knowledge are the most important for this role. 

STEP 2: 

Browse the Codility library, create custom tasks of your own, or use a test template to build the basics of your test. It will be made up of one or more tasks (skill-based problems to solve) and/or questions (subjective or knowledge based question sets) at varying difficulty levels (we have 4) depending on the role and experience level of the candidates you have coming through. 

STEP 3: 

Check that the test is going to work well for the role you're looking at either by asking a colleague to take it (and provide a benchmark score) or test driving it yourself. 


Contact our support team at any time for advice on improving or fine tuning your test.


STICK TO EASY AND MEDIUM DIFFICULTY TASKS: Within our Hard tasks level, we've included a couple of tasks which have intimidatingly low success rates, great for CodeLive sessions, but not for CodeCheck.
Most tests should stick to easy or medium level tasks, since including hard tasks has a negative impact on the candidate's confidence, experience, and therefore results. Always test drive a hard task before selecting it, and refer to the average scores per recommended time to see what you might expect from your candidates. Our hard tasks are truly hard, and for screening you'll want to minimize the chances of false negatives. If you really want to use them, use them in coordination with an easy task at the start, or use them during the interview stage with CodeLive.

USE 2-3 TASKS: Codility allows you to add up to 6 tasks or questions into a test, however we strongly recommend limiting your tests to just 2-3 tasks. 

While having lots of tasks seems like it'd give you better insights into your candidate, in most circumstances, including more than 3 tasks starts to have a negative impact on the candidate's performance due to time and focus. We design tasks to give you enough insights into the specific skill for you to make a decision on whether to take the candidate to the next stage of your process.

Entering a timed screening space can be intimidating, so beginning your test with an elementary task is a great way to get your candidate accustomed to the Codility IDE, and also in a problem-solving mindset.

If you're recruiting, avoid including training tasks in your tests as they are not plagiarism protected to the same level as other tasks. In most cases, each training task has a similar substitute in the recruiting suite. 

Making your test shorter, and easier is a good way to balance Junior candidate experience with useful skills-based screening, and allows you to quickly identify top performers. 

  1. Use easy and medium tasks - this will provide you with a better distribution of scores and a simple way to see whether the candidate has the fundamental skill you're looking for, and whether they're able to apply that skill to something a little more complex.
  2. Set the time limit to recommended - the recommended time is based off the performance of other candidates attempting the tasks you've selected in the test. Making the time limit shorter will place unnecessary stress, and making it too relaxed will make it less obvious to spot high performers. 
  3. Leaving the language options as open as possible - you're looking for skill, not necessarily knowledge of a specific domain. Most hiring managers would rather hire a smart dev who is able to learn quickly (who they can teach a specific language to), so allowing the candidate to use the language they're most fluent in, will give you the most accurate insights to their skills. 
  4. Use knowledge questions - if you do want to hone in on their knowledge in a specific domain, use a multiple choice question set alongside some skills-based tasks. 

Making your test more relaxed, more challenging and include industry-relevant tasks, letting them show off their problem-solving abilities. 

  1. Use medium and hard tasks - following an easier warm-up task, medium and hard tasks will let you see stretch in your senior candidates to separate out the good from the great.
  2. Make the time limit more relaxed - and communicate to your candidates that the test should only take them (the recommended time limit). Senior devs are often working or have families, and giving them more time allows them to account for unplanned distractions during the CodeCheck session. 
  3. Leaving all language options is always preferred - but if you are looking for a particular language then let the candidate know it's preferred. 
  4. Use industry-skills questions - tied to the specific framework or job role that you're screening them for. You can also create your own custom tasks to make hyper-relevant tests. 
  5. Consider using CodeLive for an interview  -  in place of screening in CodeCheck, use CodeLive for a virtual interview session as it'll increase engagement and move the candidate into the interview stage faster. 


If in doubt, contact us and we'll help you create or improve your existing tests!

Did this answer your question?