We have a process for evaluating how candidates score at each task to be sure their difficulty level fits into the right category.
Each task we release we analyze further based on how candidates score at it. If we see that, for example, candidates fail too often on a task marked as easy we change its difficulty to medium once we have enough data.
Right now we're changing the difficulty level of 37 tasks:
- AlternatingTrees to medium
- AppleOrchard to very-hard
- ArrayFilterVarJade to easy
- BugfixingKthWord to easy
- BugfixingReverseNumber to easy
- ConsecutiveDecomposition to easy
- DayOfWeek to elementary
- DifferentNeighboursLetters to easy
- DistributedDistinct to hard
- EqualFractions to medium
- EraseOneLetter to easy
- EvenWord to easy
- FairSplits to hard
- ForbiddenTrios to elementary
- ForbiddenTriosSwaps to easy
- IntegerDecimalOccurrence to elementary
- JsComments to medium
- LessThanThreeDigits to elementary
- LongestEvenPath to hard
- MaxMagicSquare to easy
- OppositeNumbers to easy
- PhoneNumberCheck to elementary
- Pow11 to easy
- SelectedIcon to easy
- SemiAlternatingSubstring to easy
- ShellAbsSum to easy
- ShellFindFunction to medium
- SkylinePaint to medium
- SmallestSameDigits to elementary
- SqlAssignTaskDifficulty to easy
- SqlCars to elementary
- SqlTheater to easy
- SumTo1 to hard
- TheWidestPath to easy
- TransactionalStack to very-hard
- UpsideDown to elementary
- ZerolessDecomposition to elementary
This change affects mostly customers who are going to create new tests.
If you were using one of those tasks, that doesn't necessarily mean you need to change anything - signal you're getting is going to remain the same so in most cases, you don't need to adjust your current tests.
If you have questions about our task library or need help with your tests, reach out to us at support@codility.com