tony/CHORUS
1
0
Fork 0
Code Issues 10 Pull Requests Actions Packages Projects Releases Wiki Activity
Files
4a778622890d51fb6e3bcc8f08b88b536cd8072e
CHORUS/docs/progress/report-SEC-SLURP-1.1.md
anthonyrawlins 4a77862289 chore: align slurp config and scaffolding
2025-09-27 21:03:12 +10:00

2.3 KiB
Raw Blame History

SEC-SLURP 1.1 Persistence Wiring Report

Summary of Changes

  • Added LevelDB-backed persistence scaffolding in pkg/slurp/slurp.go, capturing the storage path, local storage handle, and the roadmap-tagged metrics helpers required for SEC-SLURP 1.1.
  • Upgraded SLURP’s lifecycle so initialization bootstraps cached context data from disk, cache misses hydrate from persistence, successful UpsertContext calls write back to LevelDB, and shutdown closes the store with error telemetry.
  • Introduced pkg/slurp/slurp_persistence_test.go to confirm contexts survive process restarts and can be resolved after clearing in-memory caches.
  • Instrumented cache/persistence metrics so hit/miss ratios and storage failures are tracked for observability.
  • Implemented lightweight crypto/key-management stubs (pkg/crypto/role_crypto_stub.go, pkg/crypto/key_manager_stub.go) so SLURP modules compile while the production stack is ported.
  • Updated DHT distribution and encrypted storage layers (pkg/slurp/distribution/dht_impl.go, pkg/slurp/storage/encrypted_storage.go) to use the crypto stubs, adding per-role fingerprints and durable decoding logic.
  • Expanded storage metadata models (pkg/slurp/storage/types.go, pkg/slurp/storage/backup_manager.go) with fields referenced by backup/replication flows (progress, error messages, retention, data size).
  • Incrementally stubbed/simplified distributed storage helpers to inch toward a compilable SLURP package.
  • Attempted GOWORK=off go test ./pkg/slurp; the original authority-level blocker is resolved, but builds still fail in storage/index code due to remaining stub work (e.g., Bleve queries, DHT helpers).

Recommended Next Steps

  • Stub the remaining storage/index dependencies (Bleve query scaffolding, UCXL helpers, errorCh queues, cache regex usage) or neutralize the heavy modules so that GOWORK=off go test ./pkg/slurp compiles and runs.
  • Feed the durable store into the resolver and temporal graph implementations to finish the SEC-SLURP 1.1 milestone once the package builds cleanly.
  • Extend Prometheus metrics/logging to track cache hit/miss ratios plus persistence errors for observability alignment.
  • Review unrelated changes still tracked on feature/phase-4-real-providers (e.g., docker-compose edits) and either align them with this roadmap work or revert for focus.