tracksolid_timescale_grafana_prod

kianiadee/tracksolid_timescale_grafana_prod

Fork 0

Commit graph

Author	SHA1	Message	Date
david kiania	e5b0e192d8	chore(repo): reorganize tree into migrations/ data/ legacy/ docs/ Group root-level files (accreted from incremental changes) by purpose without moving any deployment entrypoint or breaking imports: - migrations/ : numbered SQL 02-10 - data/ : source CSVs - legacy/ : superseded pre-_rev scripts + old pipeline notes (not deployed) - docs/{manuals,reference,reports}/ : loose manuals, references, reports - strip stray / * prefixes from 5 doc filenames - delete empty documents.txt / push_webhook.md Reference updates so nothing breaks: - run_migrations.py -> /app/migrations/<file> - run_migrations.sh -> $SCRIPT_DIR/migrations - import_drivers_csv.py -> data/<csv> - docker-compose.yaml -> runbook path comment - CLAUDE.md -> codebase map + inline doc references Deployed Python (3 services + ts_shared_rev + run_migrations) and the documented ops one-shots stay at root, preserving the flat-import layout and all documented commands. Verified: py_compile clean across all modules, every MIGRATIONS entry resolves under migrations/, CI-referenced paths (tests/, mypy targets, db_audit) and the grafana build context intact. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>	2026-06-01 02:27:30 +03:00
David Kiania	c05b47abe2	Fix alarm field mapping, distance unit bug, parking params; add schema migrations BUG-01 [FIX-E06]: jimi.device.alarm.list poll response uses alertTypeId/ alarmTypeName/alertTime, not the webhook field names. All 1,054 stored alarm records had null alarm_type/alarm_name as a result. Corrected field mapping in ingest_events_rev.py; also added alarm_name and source columns to INSERT. BUG-02 [FIX-M11/M12]: trips.distance_m was storing millimetres due to an erroneous * 1000 on an already-km API value. Removed the multiplication in poll_trips() and push_trip_report(). Column renamed to distance_km in migration 04 (historical rows divided by 1,000,000 to correct to km). All SQL in both ingestion files updated to reference distance_km. POLL-02 [FIX-M13]: parking poll returned 0 rows because the required account and acc_type=0 parameters were missing. Also fixed response field mapping: durSecond was incorrectly read as 'seconds'. Migration 04: corrects and renames distance_m → distance_km. Migration 05: adds normalized OBD columns, alarm/device enrichment columns, new tables (device_events, fuel_readings, temperature_readings, lbs_readings, geofences), expands dwh_gold fact table, and adds refresh_daily_metrics() ETL. tracksolid_DB_manual.md updated to reflect column rename and mark fixed issues. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-04-10 22:18:30 +03:00

Author

SHA1

Message

Date

david kiania

e5b0e192d8

chore(repo): reorganize tree into migrations/ data/ legacy/ docs/

Group root-level files (accreted from incremental changes) by purpose
without moving any deployment entrypoint or breaking imports:

- migrations/  : numbered SQL 02-10
- data/        : source CSVs
- legacy/      : superseded pre-_rev scripts + old pipeline notes (not deployed)
- docs/{manuals,reference,reports}/ : loose manuals, references, reports
- strip stray ** / *** prefixes from 5 doc filenames
- delete empty documents.txt / push_webhook.md

Reference updates so nothing breaks:
- run_migrations.py  -> /app/migrations/<file>
- run_migrations.sh  -> $SCRIPT_DIR/migrations
- import_drivers_csv.py -> data/<csv>
- docker-compose.yaml -> runbook path comment
- CLAUDE.md -> codebase map + inline doc references

Deployed Python (3 services + ts_shared_rev + run_migrations) and the
documented ops one-shots stay at root, preserving the flat-import layout
and all documented commands. Verified: py_compile clean across all modules,
every MIGRATIONS entry resolves under migrations/, CI-referenced paths
(tests/, mypy targets, db_audit) and the grafana build context intact.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-06-01 02:27:30 +03:00

David Kiania

c05b47abe2

Fix alarm field mapping, distance unit bug, parking params; add schema migrations

BUG-01 [FIX-E06]: jimi.device.alarm.list poll response uses alertTypeId/
alarmTypeName/alertTime, not the webhook field names. All 1,054 stored alarm
records had null alarm_type/alarm_name as a result. Corrected field mapping
in ingest_events_rev.py; also added alarm_name and source columns to INSERT.

BUG-02 [FIX-M11/M12]: trips.distance_m was storing millimetres due to an
erroneous * 1000 on an already-km API value. Removed the multiplication in
poll_trips() and push_trip_report(). Column renamed to distance_km in
migration 04 (historical rows divided by 1,000,000 to correct to km).
All SQL in both ingestion files updated to reference distance_km.

POLL-02 [FIX-M13]: parking poll returned 0 rows because the required
account and acc_type=0 parameters were missing. Also fixed response field
mapping: durSecond was incorrectly read as 'seconds'.

Migration 04: corrects and renames distance_m → distance_km.
Migration 05: adds normalized OBD columns, alarm/device enrichment columns,
new tables (device_events, fuel_readings, temperature_readings, lbs_readings,
geofences), expands dwh_gold fact table, and adds refresh_daily_metrics() ETL.

tracksolid_DB_manual.md updated to reflect column rename and mark fixed issues.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-04-10 22:18:30 +03:00

2 commits