2 commits

Author	SHA1	Message	Date
david kiania	e5b0e192d8	chore(repo): reorganize tree into migrations/ data/ legacy/ docs/ ... Group root-level files (accreted from incremental changes) by purpose without moving any deployment entrypoint or breaking imports: - migrations/ : numbered SQL 02-10 - data/ : source CSVs - legacy/ : superseded pre-_rev scripts + old pipeline notes (not deployed) - docs/{manuals,reference,reports}/ : loose manuals, references, reports - strip stray ** / *** prefixes from 5 doc filenames - delete empty documents.txt / push_webhook.md Reference updates so nothing breaks: - run_migrations.py -> /app/migrations/<file> - run_migrations.sh -> $SCRIPT_DIR/migrations - import_drivers_csv.py -> data/<csv> - docker-compose.yaml -> runbook path comment - CLAUDE.md -> codebase map + inline doc references Deployed Python (3 services + ts_shared_rev + run_migrations) and the documented ops one-shots stay at root, preserving the flat-import layout and all documented commands. Verified: py_compile clean across all modules, every MIGRATIONS entry resolves under migrations/, CI-referenced paths (tests/, mypy targets, db_audit) and the grafana build context intact. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>	2026-06-01 02:27:30 +03:00
David Kiania	898fd25a5a	feat(analytics): Phase 0 — analytics-config migration and CSV importer rewrite ... Phase 0 of the three-stakeholder analytics redesign: - 08_analytics_config.sql: ops.cost_rates + ops.kpi_targets with seed fuel rates (KES 195/L NBO+MBA, UGX 5200/L KLA) and 6 seed KPI targets (utilisation_pct, idle_pct global+osp-patrol, fuel_kes_per_100km, mttr_hours, alarms_per_100km). Granted SELECT to grafana_ro. Wired into run_migrations.py MIGRATIONS. - import_drivers_csv.py: full rewrite for the new Mitieng CSV (20260427_FSG_Vehicles_mitieng.csv). Snake_case columns, drops _infer_city() plate-prefix logic in favour of reading assigned_city directly. Adds cost_centre, assigned_route, vehicle_category, vehicle_brand, fuel_100km, depot_address. Treats the literal "NULL" string as missing. Reuses clean(), clean_num(), clean_ts(), get_conn(), get_logger() from ts_shared_rev. Special-cases numeric and timestamptz columns in the UPDATE clause. - audit_device_reconciliation.py: read-only audit comparing the CSV against tracksolid.devices. Reports per-account row counts, IMEIs on one side only, and devices on both sides whose metadata is still NULL. - 260427_device_reconciliation.md + 260427_audit_output.txt: Phase 0.2 reconciliation record. First run: DB has 172 devices, CSV has 162, delta +10 (10 IMEIs in DB-only, mostly fireside-account auto-syncs). Importer run with --only-null --apply filled 154 rows; coverage now assigned_city 152/172, cost_centre 150/172. Applied to stage on 2026-04-27 23:35 UTC. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>	2026-04-27 23:42:37 +03:00