log-forensics-01core-12anyDifficulty tier 2/5
Find the root cause of an outage in 40,000 lines of logs
log-analysisforensicsroot-causedata-extraction
Task parameters
- Reference steps
- 11
- Step ceiling
- 40
- Runs
- 15
- Solved
- 12 of 15
- Models
- 5
What is broken, and what fixed means
A 95 minute window of logs from five services covers a customer facing outage. One configuration change shrank a connection pool from 40 to 4, which exhausted the pool in the inventory service and cascaded into timeouts in checkout and 503s at the gateway. The log also contains three plausible distractions: a certificate expiry warning that fires throughout, a burst of scanner 404s twenty minutes before the incident, and an operator restarting an unrelated service in the middle of it. The deliverable is a findings file in a specified schema, so the answer is checked field by field rather than by eye.
Results by model
One group per model. The solve rate carries its spread across seeds, and every run below it links to the full step by step replay.
stub:hasty
0.0%+/- 0.0% over 3 seeds
3 runs, seeds 0, 1, 2
- seed 0not solved 1/9 hidden testscompleteddockerpremature finishF03replay
- steps
- 8 of 40
- partial credit
- 11%
- step efficiency
- n/a
- recovery
- n/a
- cost
- $0.00
- wall clock
- 1.05 s
- started
- 16 Sep 2026, 18:45 UTC
- seed 1not solved 1/9 hidden testscompleteddockerpremature finishF03replay
- steps
- 6 of 40
- partial credit
- 11%
- step efficiency
- n/a
- recovery
- n/a
- cost
- $0.00
- wall clock
- 1.01 s
- started
- 16 Sep 2026, 18:45 UTC
- seed 2not solved 1/9 hidden testscompleteddockerpremature finishF03replay
- steps
- 8 of 40
- partial credit
- 11%
- step efficiency
- n/a
- recovery
- n/a
- cost
- $0.00
- wall clock
- 1.17 s
- started
- 16 Sep 2026, 18:45 UTC
stub:methodical
100.0%+/- 0.0% over 3 seeds
3 runs, seeds 0, 1, 2
- seed 0solved 9/9 hidden testscompleteddockerreplay
- steps
- 11 of 40
- partial credit
- 100%
- step efficiency
- 1.000
- recovery
- n/a
- cost
- $0.00
- wall clock
- 1.24 s
- started
- 16 Sep 2026, 18:43 UTC
- seed 1solved 9/9 hidden testscompleteddockerreplay
- steps
- 11 of 40
- partial credit
- 100%
- step efficiency
- 1.000
- recovery
- n/a
- cost
- $0.00
- wall clock
- 1.23 s
- started
- 16 Sep 2026, 18:43 UTC
- seed 2solved 9/9 hidden testscompleteddockerreplay
- steps
- 11 of 40
- partial credit
- 100%
- step efficiency
- 1.000
- recovery
- n/a
- cost
- $0.00
- wall clock
- 1.17 s
- started
- 16 Sep 2026, 18:43 UTC
stub:reckless
100.0%+/- 0.0% over 3 seeds
3 runs, seeds 0, 1, 2
- seed 0solved 9/9 hidden testscompleteddockerF08F09replay
- steps
- 14 of 40
- partial credit
- 100%
- step efficiency
- 0.786
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.17 s
- started
- 16 Sep 2026, 18:51 UTC
- seed 1solved 9/9 hidden testscompleteddockerF08F09replay
- steps
- 14 of 40
- partial credit
- 100%
- step efficiency
- 0.786
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.28 s
- started
- 16 Sep 2026, 18:51 UTC
- seed 2solved 9/9 hidden testscompleteddockerF08F09replay
- steps
- 14 of 40
- partial credit
- 100%
- step efficiency
- 0.786
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.21 s
- started
- 16 Sep 2026, 18:51 UTC
stub:sloppy
100.0%+/- 0.0% over 3 seeds
3 runs, seeds 0, 1, 2
- seed 0solved 9/9 hidden testscompleteddockerF01F02F05replay
- steps
- 14 of 40
- partial credit
- 100%
- step efficiency
- 0.786
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.25 s
- started
- 16 Sep 2026, 18:49 UTC
- seed 1solved 9/9 hidden testscompleteddockerF01F02F05replay
- steps
- 14 of 40
- partial credit
- 100%
- step efficiency
- 0.786
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.23 s
- started
- 16 Sep 2026, 18:49 UTC
- seed 2solved 9/9 hidden testscompleteddockerF01F02F05replay
- steps
- 14 of 40
- partial credit
- 100%
- step efficiency
- 0.786
- recovery
- 100%
- cost
- $0.00
- wall clock
- 1.19 s
- started
- 16 Sep 2026, 18:49 UTC
stub:thrasher
100.0%+/- 0.0% over 3 seeds
3 runs, seeds 0, 1, 2
- seed 0solved 9/9 hidden testscompleteddockerF04replay
- steps
- 16 of 40
- partial credit
- 100%
- step efficiency
- 0.688
- recovery
- n/a
- cost
- $0.00
- wall clock
- 1.63 s
- started
- 16 Sep 2026, 18:46 UTC
- seed 1solved 9/9 hidden testscompleteddockerF04replay
- steps
- 16 of 40
- partial credit
- 100%
- step efficiency
- 0.688
- recovery
- n/a
- cost
- $0.00
- wall clock
- 1.48 s
- started
- 16 Sep 2026, 18:47 UTC
- seed 2solved 9/9 hidden testscompleteddockerF04replay
- steps
- 16 of 40
- partial credit
- 100%
- step efficiency
- 0.688
- recovery
- n/a
- cost
- $0.00
- wall clock
- 1.52 s
- started
- 16 Sep 2026, 18:47 UTC