How is my submission scored?

After your response is judged correct, you will receive a score based on the number of tokens used in your response (incorrect responses receive a score of 0). Successful submissions receive a "base" score, often 10,000 points. Then, we subtract the number of tokens used in your user messages from this base score to arrive at your final score for this challenge.

Depending on the specific challenge, the scoring may be slightly different. For example, each challenge within a track might have a different base score. Or, each challenge might use a different tokenizer, or even just count characters! Make sure to read the track-specific and challenge-specific instructions for more details.

To get your "final score" for a track, we take the sum of your scores for all of the challenges within that track. This final score is the one that shows up on the track leaderboard. You can continue improving your final score throughout the duration of the track by resolving challenges by using fewer tokens.