Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
57 commits
Select commit Hold shift + click to select a range
4c0f1c6
Shrink datasets
nikhilwoodruff Jul 10, 2025
6b2a56f
Move to package
nikhilwoodruff Jul 10, 2025
05ee7e4
Try L0
nikhilwoodruff Jul 10, 2025
e38c647
Format
nikhilwoodruff Jul 10, 2025
bdf3d6d
attempting to vectorize minimizing of ecps
juaristi22 Jul 11, 2025
03e5d0d
adding random sampling minimization strategy
juaristi22 Jul 11, 2025
cd0776c
add notebook with testing functionality (havent tested locally)
juaristi22 Jul 11, 2025
2c050fc
lint
juaristi22 Jul 11, 2025
ee98fc3
debugged 2nd cell: created path & removed optional parameters.
eccuraa Jul 12, 2025
f6d7f0f
few updates to the testing framework
juaristi22 Jul 14, 2025
a042a01
added CPS_2023 to lite mode generation
baogorek Jul 11, 2025
cabeb56
Fixed manual test
baogorek Jul 11, 2025
7b76afb
try again with locked version
baogorek Jul 11, 2025
4056df4
trying things
baogorek Jul 11, 2025
96c4c25
lint
baogorek Jul 11, 2025
e20c75c
trying 3.11.12
baogorek Jul 11, 2025
776eda8
now actually specifying py version
baogorek Jul 11, 2025
cd77179
pandas v
baogorek Jul 11, 2025
d0ce44d
small runner
baogorek Jul 11, 2025
eb96cd5
trying everything
baogorek Jul 11, 2025
59ff94e
relaxing python version in pyproject.toml
baogorek Jul 11, 2025
d3fa67b
putting things back in order.
baogorek Jul 11, 2025
273c48d
Use normal runner in PR tests
nikhilwoodruff Jul 12, 2025
8c2fbda
added the 3.11.12 pin
baogorek Jul 12, 2025
edb0945
cps.py
baogorek Jul 14, 2025
994ac15
adding diagnostics
baogorek Jul 14, 2025
341a355
lint
baogorek Jul 14, 2025
c2ab4b6
taking out bad targets
baogorek Jul 14, 2025
6f7a03a
fixing workflow arg passthrough
baogorek Jul 14, 2025
3dba2a2
deps and defaults
baogorek Jul 14, 2025
7710a4c
wrong pipeline for manual test
baogorek Jul 14, 2025
27f46fd
trying again to get the manual test to work
baogorek Jul 14, 2025
fef1eca
reverting to older workflow code
baogorek Jul 14, 2025
5eb1050
cleaning up enhanced_cps.py
baogorek Jul 14, 2025
1fb4318
Update package version
MaxGhenis Jul 14, 2025
a62328a
attempting to vectorize minimizing of ecps
juaristi22 Jul 11, 2025
6d3f8b4
add notebook with testing functionality (havent tested locally)
juaristi22 Jul 11, 2025
94cacde
few updates to the testing framework
juaristi22 Jul 14, 2025
a71530b
fix calibration for each approach
juaristi22 Jul 14, 2025
f146620
fixed testing framework
juaristi22 Jul 14, 2025
7a2d074
Merge branch 'main' into maria/shrink
juaristi22 Jul 14, 2025
51d9c9c
attempt generating Minimized ECPS
juaristi22 Jul 15, 2025
9f02665
load artifact in workflows
juaristi22 Jul 15, 2025
fdd2e52
fix importing errors
juaristi22 Jul 15, 2025
a87a0b9
fix dataset initialization error
juaristi22 Jul 15, 2025
6f78752
and imports
juaristi22 Jul 15, 2025
9d0c9e1
attempting to fix data download validation error
juaristi22 Jul 15, 2025
340dc6b
minor bug
juaristi22 Jul 15, 2025
c03eb49
fix dataset path
juaristi22 Jul 15, 2025
6007db2
fix minimize.py variables
juaristi22 Jul 15, 2025
171d072
change params
juaristi22 Jul 15, 2025
1e23581
round 2
juaristi22 Jul 15, 2025
8119f7c
check if sparse l0 approach to minimizing works
juaristi22 Jul 15, 2025
5ae89d5
update datasets to be generated
juaristi22 Jul 15, 2025
0521be6
try adding logic to generate the sparse ecps if missing
juaristi22 Jul 15, 2025
1d38077
make saving minimized ECPS optional
juaristi22 Jul 15, 2025
6bb0fb1
reducing iterations hoping jobs dont get killed
juaristi22 Jul 15, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions .github/workflows/code_changes.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,12 @@ jobs:
with:
name: calibration_log.csv
path: calibration_log.csv
- name: Save minimized ECPS calibration log
uses: actions/upload-artifact@v4
with:
name: minimized_enhanced_cps_2024_calibration_log.csv
path: minimized_enhanced_cps_2024_calibration_log.csv
if-no-files-found: ignore
- name: Run tests
run: pytest
- name: Upload data
Expand Down
7 changes: 7 additions & 0 deletions .github/workflows/pr_code_changes.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -71,6 +71,7 @@ jobs:
run: make download
env:
HUGGING_FACE_TOKEN: ${{ secrets.HUGGING_FACE_TOKEN }}
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

- name: Build datasets
run: make data
Expand All @@ -82,6 +83,12 @@ jobs:
with:
name: calibration_log.csv
path: calibration_log.csv
- name: Save minimized ECPS calibration log
uses: actions/upload-artifact@v4
with:
name: minimized_enhanced_cps_2024_calibration_log.csv
path: minimized_enhanced_cps_2024_calibration_log.csv
if-no-files-found: ignore
- name: Run tests
run: pytest

Expand Down
4 changes: 4 additions & 0 deletions changelog_entry.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
- bump: minor
changes:
added:
- Minimized Enhanced CPS.
2 changes: 2 additions & 0 deletions policyengine_us_data/datasets/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,8 @@
CensusCPS_2023,
EnhancedCPS_2024,
ReweightedCPS_2024,
MinimizedEnhancedCPS_2024,
SparseEnhancedCPS_2024,
)
from .puf import PUF_2015, PUF_2021, PUF_2024, IRS_PUF_2015
from .acs import ACS_2022
Expand Down
Loading
Loading