Reviewing
Reviewing a Challenge
This article is meant to explain how to ensure a challenge is high quality before it leaves the BETA state, and after it's accepted.
In different ways, each participant can show support and help in improving the challenge. Some of the challenges are made by the DojoCode admins, but some of them are made by users. Everybody can create a challenge and more importantly, every user can express their opinions about the challenges through the platform.
Going through the process of solving a DOJO Challenge is one of the first steps in seeing its quality. In order for the user to have a broader picture of the quality of the materials, they should start by reading the description of the challenge and trying to understand what the challenge is about, continuing with solving the challenge, in this way, the user can have a bigger picture of the material.
Every DojoCode user has the right to express his opinion about each challenge. The user can choose between: “I don't understand the task”, “Code execution is slow”, “Autocomplete doesn't work”, “The tests are not working correctly”, “There's a feature missing” or “Something else”. They also have the option of writing their feedback through the intended box.
After a challenge is solved and uploaded to the platform, users can still provide feedback about the quality of the challenge by answering the question "How do you rate this challenge?". The answer to this question is a preset one, on 5 levels, starting from "very poor", "poor", "average", and "good" and ending with "excellent". Users can give feedback on each challenge in part.
Reviewing a Solution
For solution reviewing, there is an option to write comments, in this way people can express themself by writing their thoughts about the solutions of the participants. On the Solution page in addition to the comments part, there is also the option to leave appreciation for users' solutions by giving them likes on the solution.
Satisfaction Vote
Every time a user uploads a solution, a feedback pop-up will appear and it will allow choosing between 5 stages**, from excellent to very poor.
Difficulty Rating Vote
Depending on how difficult a challenge is, users can give a difficulty rating vote. The difficulty levels will be from beginner to intermediate and expert, so each challenge can be cataloged with a certain label.
Reward for Reviewers
The first 3 users who solve a challenge and vote on its difficulty will receive 40 bonus points. 20 points for solving a challenge without difficulty rates and 20 points for offering a rate. Therefore, it is in the interest of every DojoCode user to solve and give feedback about the challenges in "Publish Mode", not only because in this way we can help our community but also to increase in level through the points received.
Reward for Curators
After a challenge has received it's diffculty vote, the author of the challenge will receive XP points and Dojo Coins as reward.
| Difficulty | XP Points | Dojo Coins |
|---|---|---|
| Beginner | 50 | 50 |
| Intermediate | 200 | 100 |
| Expert | 500 | 200 |
Approved State
After the number of votes is sufficient from the community, all issues are fixed and the users reach a consensus on its ranking, it’s ready for the final step to come out of "Publish Mode". At this point, sufficiently privileged users can enter the DojoCode editor and release it as an official Challenge onto the site!
Challenge Close State
After a challenge gets retired, will be removed from our pool of published challenges and the user will not be able to complete it or approve it anymore. All users who completed it will be able to keep their points, but the challenge itself is not gonna be listed anymore and can be accessed only by direct link.
Feedback
Users can give their feedback through our Feedback Section. Each user can choose between the standard feedback messages such as:
- I don’t understand the task
- The tests are not working correctly
- Code execution is slow
- There’s a feature missing
- Autocomplete doesn’t work
- Something else
If the user is not happy with the standard messages and wants to give a different opinion or suggestion, they can write in the description box their message.