We have a process for evaluating how candidates score at each task to be sure their difficulty level fits into the right category.
Each task we release we analyze further based on how candidates score at it. If we see that, for example, candidates fail too often on a task marked as easy we change its difficulty to medium.
Right now we're changing the difficulty level of 9 tasks:
- Initials to elementary
- Captcha Multiplication to elementary
- Sorting Shirts to easy
- Crop The Message to easy
- Array Successors to easy
- Erase One Letter to medium
- Opposite Numbers to medium
- Board Recovery to hard
- String Misspelling Var to hard
This change affects mostly customers who are going to create new tests.
If you were using one of those tasks, that doesn't necessarily mean you need to change anything - signal you're getting is going to remain the same so in most cases, you don't need to adjust your current tests.
If you have questions about our task library or need help with your tests, reach out to us at firstname.lastname@example.org