Atlas Plan
Plans012 2026 02 23 Pipeline Workflow Unification

Completed

  • T-001: Refactor CLI argument parser
  • T-002: Add sync command
  • T-004: Create _pipeline_runs table
  • T-005: Add transform command
  • T-006: Add publish command
  • T-007: Create unified report command
  • T-008: Implement quarterly report aggregation
  • T-009: Add staleness check
  • T-010: Implement dimension resolver for db_person
  • T-011: Implement dimension resolver for db_organization
  • T-012: Implement db_account creation for orders
  • T-003: Update root package.json scripts
  • T-013: Update AGENTS.md pipeline commands
  • T-014: Update architecture.md deployment section
  • T-015: Update @packages/pipeline AGENTS.md
  • T-016: Deprecate old run command

In Progress

  • None yet

Blocked

  • None

Pending

  • None

Learnings

  • Parsing month ranges centrally (parseMonth) prevents command-specific validation drift.
  • Pipeline metadata helpers are easier to compose when table bootstrap is idempotent in DuckDB.
  • sync orchestration stays readable when stage boundaries are explicit and logged per step.
  • Wrapping dbt invocation in a command module makes standalone transform and chained sync flows share the same behavior.
  • Publish dimension resolution is safer when caches are keyed by normalized natural keys and scoped to entity context.
  • Runtime lookup maps from LibSQL reference tables reduce hard-coded ID coupling inside pipeline command logic.
  • Range-based report assembly is easiest to evolve when report generation and JSON writing are separated into reusable helpers.
  • Staleness checks are operationally safer as warnings (not hard failures) with explicit --force override.
  • Root script ergonomics improve adoption when primary workflows are promoted and stage commands remain available for debugging.
  • Keeping run as a warning alias provides migration safety without preserving outdated behavior.

Questions

  • Should clean-report command be kept as-is or folded into report? → Keep as-is
  • Should run command be deprecated or kept as alias? → Deprecate with warning

Next

  1. Run /plan.review for final compliance and closure notes.
  2. Prepare commit(s) with pipeline + docs + plan artifact updates.
  3. Propose @plan/state.md update to reflect completed workflow unification.

On this page