David Kiania
|
34f5fa1b9c
|
feat(dwh): bronze pipeline migrations, runbook, and execution manual
DWH pipeline (new):
- dwh/261001_dwh_control.sql — watermarks + per-run audit log schema
- dwh/261002_bronze_constraints_audit.sql — ON CONFLICT key assertion
- dwh/261003_dwh_roles.sql — dwh_owner / grafana_ro contract assertion
- dwh/261004_dwh_observability_views.sql — v_table_freshness,
v_recent_failures, v_watermark_lag (readable by grafana_ro)
- docs/DWH_PIPELINE.md — operations runbook (setup, troubleshooting,
manual re-run, back-fill, rotation)
- DWH_Execution_Manual.md — reusable playbook for future data
projects (extract → blob → load pattern, 7 design principles,
snapshot-vs-incremental matrix, verification gates)
- docs/superpowers/{specs,plans}/2026-04-24-n8n-dwh-bronze-pipeline-*
— design spec + 27-task implementation plan
Security:
- dwh/260423_dwh_ddl_v1.sql — redacted plaintext role passwords to
'CHANGE_ME_BEFORE_APPLY' placeholders; added SECURITY header
documenting generation + rotation flow
Docs:
- CLAUDE.md — §3 adds tracksolid_dwh@31.97.44.246:5888 target,
§4 adds dwh/ + docs/DWH_PIPELINE.md to codebase map, §5 adds
bronze + dwh_control schema roll-up, §10 adds deploy task +
password rotation follow-up
Also includes miscellaneous in-progress files accumulated on this
branch (workspace, analytics notes, vehicle CSVs, extract helpers,
renamed markdown archives).
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
|
2026-04-25 01:07:53 +03:00 |
|
David Kiania
|
1f11a65b0b
|
Add 02_tracksolid_docker_commands.md — remote DB command reference
Comprehensive reference for SSH + docker exec psql access to the
TimescaleDB instance on rahamafresh.com. Covers:
- How it works (SSH → docker exec → psql layers explained)
- tsdb() shell function setup for the server
- Mac one-liners for single queries, interactive sessions, piping SQL files
- Fleet & live positions queries (active vehicles, silent devices, anomalies)
- Trips & movement (today's KPIs, speeding, after-hours, utilisation rate)
- Alarms (summary, unacknowledged, acknowledge)
- Parking & idle time
- Position history & route replay
- Ingestion pipeline health checks
- Device registry (metadata gaps, odometer, subscriptions)
- Schema & migration operations
- Container & service operations (logs, restart, disk, chunk sizes)
- Quick reference table for all flags
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-04-11 08:23:01 +03:00 |
|