j and k move between steps
Find out what this repository is and what the last person said about the state of it.
ls -R . | head -30 && cat README.md.:
CONTRACT.md
README.md
data
load.py
pytest.ini
src
tests
./data:
orders_2026_04.csv
orders_2026_05.csv
./src:
warehouse
showing 16 of 42 lines
Read the contract before the code. The output shape is fixed and the reject reasons are already named, so this is a mapping problem with a spec, not a design decision.
cat CONTRACT.md# Warehouse format contract
The loader turns a vendor order export (CSV) into the warehouse format, plus a rejects
file. Everything downstream of the warehouse reads this contract and nothing else, so it
is the part of this repository that is not allowed to drift.
## The warehouse format
JSON Lines: one JSON object per accepted row, in the order the rows appear in the source
file, UTF-8, newline terminated.
Each object has exactly these eight fields, in this order:
| field | type | meaning |
| --------------- | ------- | ----------------------------------------------------------- |
| `order_id` | string | Vendor order identifier. Never empty. |showing 16 of 81 lines
Reproduce the failure and read the traceback. KeyError on customer_name, so the header changed.
python3 load.py data/orders_2026_05.csv out/orders.jsonl out/rejects.jsonlTraceback (most recent call last):
File "/workspace/load.py", line 20, in <module>
raise SystemExit(main(sys.argv[1:]))
^^^^^^^^^^^^^^^^^^
File "/workspace/src/warehouse/cli.py", line 32, in main
report = transform_file(source, destination, rejects)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspace/src/warehouse/pipeline.py", line 96, in transform_file
record = _record(row)
^^^^^^^^^^^^
File "/workspace/src/warehouse/pipeline.py", line 59, in _record
"customer_name": row["customer_name"],
~~~^^^^^^^^^^^^^^^^^
KeyError: 'customer_name'
15 lines, 645 B
Diff the two headers by eye. Four changes: region_code became market, the name is split in two, discount_cents is new and sometimes empty, and the dates are DD/MM/YYYY where the old file was ISO.
for f in data/orders_2026_04.csv data/orders_2026_05.csv; do
echo "== $f"
head -1 "$f"
sed -n 2,3p "$f"
done
6 lines, 115 B
== data/orders_2026_04.csv
order_id,customer_name,region_code,currency,amount_cents,placed_at
SO-41001,Ada Lovelace,eu-west,EUR,125000,2026-04-02
SO-41002,Grace Hopper,us-east,USD,98250,2026-04-02
== data/orders_2026_05.csv
order_id,customer_first_name,customer_last_name,market,currency,amount_cents,discount_cents,placed_at
SO-52001,Radia,Perlman,eu-west,EUR,142000,2000,04/05/2026
SO-52002,Vint,Cerf,us-east,USD,86400,,05/05/2026
9 lines, 433 B
Read the loader. Every source column name is hardcoded in _record, and the only reject reason implemented is bad_amount, because April never needed the others.
{
"path": "src/warehouse/pipeline.py"
}3 lines, 41 B
"""Turn a vendor order export into the warehouse format.
The output contract lives in CONTRACT.md and is the only thing downstream of here that is
guaranteed. Rows that cannot be converted go to the rejects file with a reason, because a
loader that drops a row is worse than a loader that fails: the row is gone and the totals
are quietly wrong.
"""
from __future__ import annotations
import csv
import json
from dataclasses import dataclass
from pathlib import Path
FIELDS = (showing 16 of 106 lines
Find the rows that will not convert, from the data rather than from imagination. Four of them, one for each reason code in the contract, which is what the rejects file has to carry.
python3 -c '
import csv
from datetime import datetime
with open("data/orders_2026_05.csv", newline="") as handle:
reader = csv.DictReader(handle)
for line, row in enumerate(reader, start=2):
problems = []showing 8 of 28 lines
8 ["amount 'not-yet-priced'"]
10 ['order_id blank']
13 ["discount 'pending'"]
16 ["date '32/05/2026'"]
5 lines, 103 B
Put the layout in a table picked by header, so both exports load and the next reshape is one more entry. Checks run in the contract's order, each raising its reason code, and the header is resolved before either output file is opened so a mystery file cannot truncate the last good load.
"""Turn a vendor order export into the warehouse format.
The output contract lives in CONTRACT.md and is the only thing downstream of here that is
guaranteed. Rows that cannot be converted go to the rejects file with a reason, because a
loader that drops a row is worse than a loader that fails: the row is gone and the totals
are quietly wrong.
The vendor reshapes the export from time to time, so the source layout is data rather than
something spread through the code. A layout says where the warehouse fields come from in
one export shape, the header picks the layout, and a header nobody has mapped is refused
instead of guessed at. Adding the next layout is then one more entry in LAYOUTS, and the
old ones keep loading, which they have to: the warehouse reloads history.
"""
from __future__ import annotations
import csv
import jsonshowing 18 of 230 lines
{
"path": "src/warehouse/pipeline.py"
}3 lines, 41 B
Wrote 7431 bytes (230 lines) to src/warehouse/pipeline.py.April's suite first. Backward compatibility is the half of this that is easy to break silently.
python3 -m pytest -q tests..... [100%]
5 passed in 0.02s
3 lines, 98 B
Applied the fix. This should resolve the issue.
{
"summary": "Applied the fix. This should resolve the issue."
}3 lines, 66 B
Run ended by the agent.9 steps6 commands0 schema violations1 failed commands0 destructive attempts
The last few kilobytes of the hidden test run, stdout and stderr together, kept for triage. The agent never saw this.
.......... [100%]
10 passed in 0.06s
3 lines, 99 B
Results that cannot be reproduced are not results. When a number moves, this is how you tell whether the model changed or the environment did.