py-failing-suite-01core-12pythonDifficulty tier 1/5
Fix the off by one in an inclusive date range
off-by-onedatesentry-level
Task parameters
- Reference steps
- 6
- Step ceiling
- 25
- Runs
- 15
- Solved
- 12 of 15
- Models
- 5
What is broken, and what fixed means
A small date utility library has one off by one error in the function that expands a start and end date into a list of dates. The library documents the range as inclusive of both ends, and three of its tests fail because the implementation excludes the end date. Everything needed to diagnose this is visible in the workspace, including a test suite that reproduces the failure.
Results by model
One group per model. The solve rate carries its spread across seeds, and every run below it links to the full step by step replay.
stub:hasty
0.0%+/- 0.0% over 3 seeds
3 runs, seeds 0, 1, 2
- seed 0not solved 4/8 hidden testscompleteddockerpremature finishF03replay
- steps
- 4 of 25
- partial credit
- 50%
- step efficiency
- n/a
- recovery
- 100%
- cost
- $0.00
- wall clock
- 940 ms
- started
- 16 Sep 2026, 18:45 UTC
- seed 1not solved 4/8 hidden testscompleteddockerpremature finishF03replay
- steps
- 3 of 25
- partial credit
- 50%
- step efficiency
- n/a
- recovery
- 100%
- cost
- $0.00
- wall clock
- 920 ms
- started
- 16 Sep 2026, 18:45 UTC
- seed 2not solved 4/8 hidden testscompleteddockerpremature finishF03replay
- steps
- 4 of 25
- partial credit
- 50%
- step efficiency
- n/a
- recovery
- 100%
- cost
- $0.00
- wall clock
- 942 ms
- started
- 16 Sep 2026, 18:45 UTC
stub:methodical
100.0%+/- 0.0% over 3 seeds
3 runs, seeds 0, 1, 2
- seed 0solved 8/8 hidden testscompleteddockerreplay
- steps
- 6 of 25
- partial credit
- 100%
- step efficiency
- 1.000
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.18 s
- started
- 16 Sep 2026, 18:43 UTC
- seed 1solved 8/8 hidden testscompleteddockerreplay
- steps
- 6 of 25
- partial credit
- 100%
- step efficiency
- 1.000
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.17 s
- started
- 16 Sep 2026, 18:43 UTC
- seed 2solved 8/8 hidden testscompleteddockerreplay
- steps
- 6 of 25
- partial credit
- 100%
- step efficiency
- 1.000
- recovery
- 100%
- cost
- $0.00
- wall clock
- 2.13 s
- started
- 16 Sep 2026, 18:43 UTC
stub:reckless
100.0%+/- 0.0% over 3 seeds
3 runs, seeds 0, 1, 2
- seed 0solved 8/8 hidden testscompleteddockerF08F09replay
- steps
- 9 of 25
- partial credit
- 100%
- step efficiency
- 0.667
- recovery
- 100%
- cost
- $0.00
- wall clock
- 2.25 s
- started
- 16 Sep 2026, 18:51 UTC
- seed 1solved 8/8 hidden testscompleteddockerF08F09replay
- steps
- 9 of 25
- partial credit
- 100%
- step efficiency
- 0.667
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.18 s
- started
- 16 Sep 2026, 18:51 UTC
- seed 2solved 8/8 hidden testscompleteddockerF08F09replay
- steps
- 9 of 25
- partial credit
- 100%
- step efficiency
- 0.667
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.21 s
- started
- 16 Sep 2026, 18:51 UTC
stub:sloppy
100.0%+/- 0.0% over 3 seeds
3 runs, seeds 0, 1, 2
- seed 0solved 8/8 hidden testscompleteddockerF01F02F05replay
- steps
- 9 of 25
- partial credit
- 100%
- step efficiency
- 0.667
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.17 s
- started
- 16 Sep 2026, 18:49 UTC
- seed 1solved 8/8 hidden testscompleteddockerF01F02F05replay
- steps
- 9 of 25
- partial credit
- 100%
- step efficiency
- 0.667
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.16 s
- started
- 16 Sep 2026, 18:49 UTC
- seed 2solved 8/8 hidden testscompleteddockerF01F02F05replay
- steps
- 9 of 25
- partial credit
- 100%
- step efficiency
- 0.667
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.20 s
- started
- 16 Sep 2026, 18:49 UTC
stub:thrasher
100.0%+/- 0.0% over 3 seeds
3 runs, seeds 0, 1, 2
- seed 0solved 8/8 hidden testscompleteddockerF04replay
- steps
- 11 of 25
- partial credit
- 100%
- step efficiency
- 0.545
- recovery
- 50%
- cost
- $0.00
- wall clock
- 2.19 s
- started
- 16 Sep 2026, 18:47 UTC
- seed 1solved 8/8 hidden testscompleteddockerF04replay
- steps
- 11 of 25
- partial credit
- 100%
- step efficiency
- 0.545
- recovery
- 50%
- cost
- $0.00
- wall clock
- 1.86 s
- started
- 16 Sep 2026, 18:47 UTC
- seed 2solved 8/8 hidden testscompleteddockerF04replay
- steps
- 11 of 25
- partial credit
- 100%
- step efficiency
- 0.545
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.68 s
- started
- 16 Sep 2026, 18:47 UTC