Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
f660a21
Recover multi-agent calibration pipeline unification work
MaxGhenis Feb 8, 2026
fc53360
Fix critical bugs in recovered calibration pipeline code
MaxGhenis Feb 8, 2026
81e5272
WIP: auto-save before context compact (8 files on unify-calibration-p…
MaxGhenis Feb 8, 2026
c3c04ea
Merge recovered enhanced_cps.py with dual-path architecture
MaxGhenis Feb 8, 2026
4bea2b7
Extract shared logic into BaseMatrixBuilder, update SparseMatrixBuilder
MaxGhenis Feb 8, 2026
17b4ff5
Split etl_all_targets.py into focused ETL modules
MaxGhenis Feb 8, 2026
b2cb2d0
Fix 9 failing calibration tests after base class extraction
MaxGhenis Feb 8, 2026
05422ec
Add two-pass geographic target reconciliation to ETL pipeline
MaxGhenis Feb 8, 2026
6bde58f
Trigger CI
MaxGhenis Feb 8, 2026
fdab1ec
Merge main into unify-calibration-pipeline-v2
MaxGhenis Feb 8, 2026
eba1487
Add changelog entry for target reconciliation
MaxGhenis Feb 8, 2026
c45b146
Format files to match CI black version
MaxGhenis Feb 8, 2026
fa8ffd9
Remove legacy calibration code, use DB-only path
MaxGhenis Feb 8, 2026
f252a72
Fix black formatting for CI
MaxGhenis Feb 8, 2026
a5320c0
Remove all legacy calibration code
MaxGhenis Feb 8, 2026
dbae410
Add geo_level filter to matrix builder, fix tests for DB-only path
MaxGhenis Feb 8, 2026
623e2ef
Add unified calibration pipeline with clone+assign geography
MaxGhenis Feb 9, 2026
5f681e0
WIP: auto-save before context compact (4 files on unify-calibration-p…
MaxGhenis Feb 9, 2026
07d40e7
Refactor matrix build to two-phase disk-cached COO approach
MaxGhenis Feb 9, 2026
9497bd3
Pass cache_dir to build_matrix in l0_sweep
MaxGhenis Feb 9, 2026
184a564
Remove unnecessary delete_arrays, add h5 purity test
MaxGhenis Feb 9, 2026
a475f05
Remove all delete_arrays, assert h5 has no formula vars
MaxGhenis Feb 9, 2026
ccc4b17
WIP: auto-save before context compact (2 files on unify-calibration-p…
MaxGhenis Feb 9, 2026
aadd973
Add pipeline comparison diagram
MaxGhenis Feb 9, 2026
39200c4
Reorder pipeline: clone before PUF, geography before QRF
MaxGhenis Feb 9, 2026
027a865
WIP: auto-save before context compact (3 files on unify-calibration-p…
MaxGhenis Feb 9, 2026
d40faa5
Fix QRF imputation: compute demographics via Microsim, map to entity …
MaxGhenis Feb 9, 2026
997ad19
Remove QRF training sample limits — use all PUF records
MaxGhenis Feb 9, 2026
d56c80c
Add source_impute module: ACS/SIPP/SCF imputations with state
MaxGhenis Feb 9, 2026
bce3ca0
Fix source_impute: compute derived predictors from data dict
MaxGhenis Feb 9, 2026
0a9fb9c
Fix SCF imputation: aggregate person-level predictions to household e…
MaxGhenis Feb 9, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions .beads/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
# SQLite databases
*.db
*.db?*
*.db-journal
*.db-wal
*.db-shm

# Daemon runtime files
daemon.lock
daemon.log
daemon.pid
bd.sock

# Legacy database files
db.sqlite
bd.db

# Merge artifacts (temporary files from 3-way merge)
beads.base.jsonl
beads.base.meta.json
beads.left.jsonl
beads.left.meta.json
beads.right.jsonl
beads.right.meta.json

# Keep JSONL exports and config (source of truth for git)
!issues.jsonl
!metadata.json
!config.json
81 changes: 81 additions & 0 deletions .beads/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,81 @@
# Beads - AI-Native Issue Tracking

Welcome to Beads! This repository uses **Beads** for issue tracking - a modern, AI-native tool designed to live directly in your codebase alongside your code.

## What is Beads?

Beads is issue tracking that lives in your repo, making it perfect for AI coding agents and developers who want their issues close to their code. No web UI required - everything works through the CLI and integrates seamlessly with git.

**Learn more:** [github.com/steveyegge/beads](https://github.com/steveyegge/beads)

## Quick Start

### Essential Commands

```bash
# Create new issues
bd create "Add user authentication"

# View all issues
bd list

# View issue details
bd show <issue-id>

# Update issue status
bd update <issue-id> --status in-progress
bd update <issue-id> --status done

# Sync with git remote
bd sync
```

### Working with Issues

Issues in Beads are:
- **Git-native**: Stored in `.beads/issues.jsonl` and synced like code
- **AI-friendly**: CLI-first design works perfectly with AI coding agents
- **Branch-aware**: Issues can follow your branch workflow
- **Always in sync**: Auto-syncs with your commits

## Why Beads?

✨ **AI-Native Design**
- Built specifically for AI-assisted development workflows
- CLI-first interface works seamlessly with AI coding agents
- No context switching to web UIs

🚀 **Developer Focused**
- Issues live in your repo, right next to your code
- Works offline, syncs when you push
- Fast, lightweight, and stays out of your way

🔧 **Git Integration**
- Automatic sync with git commits
- Branch-aware issue tracking
- Intelligent JSONL merge resolution

## Get Started with Beads

Try Beads in your own projects:

```bash
# Install Beads
curl -sSL https://raw.githubusercontent.com/steveyegge/beads/main/scripts/install.sh | bash

# Initialize in your repo
bd init

# Create your first issue
bd create "Try out Beads"
```

## Learn More

- **Documentation**: [github.com/steveyegge/beads/docs](https://github.com/steveyegge/beads/tree/main/docs)
- **Quick Start Guide**: Run `bd quickstart`
- **Examples**: [github.com/steveyegge/beads/examples](https://github.com/steveyegge/beads/tree/main/examples)

---

*Beads: Issue tracking that moves at the speed of thought* ⚡
56 changes: 56 additions & 0 deletions .beads/config.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,56 @@
# Beads Configuration File
# This file configures default behavior for all bd commands in this repository
# All settings can also be set via environment variables (BD_* prefix)
# or overridden with command-line flags

# Issue prefix for this repository (used by bd init)
# If not set, bd init will auto-detect from directory name
# Example: issue-prefix: "myproject" creates issues like "myproject-1", "myproject-2", etc.
# issue-prefix: ""

# Use no-db mode: load from JSONL, no SQLite, write back after each command
# When true, bd will use .beads/issues.jsonl as the source of truth
# instead of SQLite database
# no-db: false

# Disable daemon for RPC communication (forces direct database access)
# no-daemon: false

# Disable auto-flush of database to JSONL after mutations
# no-auto-flush: false

# Disable auto-import from JSONL when it's newer than database
# no-auto-import: false

# Enable JSON output by default
# json: false

# Default actor for audit trails (overridden by BD_ACTOR or --actor)
# actor: ""

# Path to database (overridden by BEADS_DB or --db)
# db: ""

# Auto-start daemon if not running (can also use BEADS_AUTO_START_DAEMON)
# auto-start-daemon: true

# Debounce interval for auto-flush (can also use BEADS_FLUSH_DEBOUNCE)
# flush-debounce: "5s"

# Multi-repo configuration (experimental - bd-307)
# Allows hydrating from multiple repositories and routing writes to the correct JSONL
# repos:
# primary: "." # Primary repo (where this database lives)
# additional: # Additional repos to hydrate from (read-only)
# - ~/beads-planning # Personal planning repo
# - ~/work-planning # Work planning repo

# Integration settings (access with 'bd config get/set')
# These are stored in the database, not in this file:
# - jira.url
# - jira.project
# - linear.url
# - linear.api-key
# - github.org
# - github.repo
# - sync.branch - Git branch for beads commits (use BEADS_SYNC_BRANCH env var or bd config set)
5 changes: 5 additions & 0 deletions .beads/metadata.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
{
"database": "beads.db",
"jsonl_export": "issues.jsonl",
"last_bd_version": "0.26.0"
}
3 changes: 3 additions & 0 deletions .gitattributes
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@

# Use bd merge for beads JSONL files
.beads/issues.jsonl merge=beads
1 change: 1 addition & 0 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -63,6 +63,7 @@ database:
python policyengine_us_data/db/etl_snap.py
python policyengine_us_data/db/etl_state_income_tax.py
python policyengine_us_data/db/etl_irs_soi.py
python policyengine_us_data/db/reconcile_targets.py
python policyengine_us_data/db/validate_database.py

database-refresh:
Expand Down
6 changes: 6 additions & 0 deletions changelog_entry.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
- bump: minor
changes:
added:
- Added two-pass geographic target reconciliation to ETL pipeline, ensuring state targets sum to national and CD targets sum to state.
- Added raw_value column to Target model to preserve original source values before reconciliation.
- Added geographic reconciliation validation to validate_database.py.
Binary file added docs/pipeline-comparison.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading