Skip to content

Fix missing records issue #147

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
bosd wants to merge 91 commits into
base: fix-o2m-id-field-handling-rebased3
Choose a base branch
from
Open

Fix missing records issue #147

Show file tree
Hide file tree
Changes from 25 commits
Commits
Show all changes
91 commits
Select commit Hold shift + click to select a range
6a5f1ac
Rebase fix-missing-records-issue onto fix-o2m-id-field-handling-rebased3
Oct 4, 2025
8570b99
Fix additional silent record loss issue
Sep 30, 2025
adbefc2
Fix fail file format issue
Sep 30, 2025
5a33f2a
Fix import abortion issues
Oct 1, 2025
862fcff
Fix CSV parsing error during preflight checks
Oct 1, 2025
f4bc616
Fix CSV type parsing in preflight check with ignore_errors
Oct 1, 2025
67f589b
Fix _fields method call issue by using proper fields_get()
Oct 1, 2025
97d6fa5
Update import_threaded.py
Oct 1, 2025
efe2088
Fix test compatibility for _get_model_fields function
Oct 1, 2025
7add3e3
Fix MyPy type checking issue in _sanitize_utf8_string function
Oct 1, 2025
4e03842
Add comprehensive UTF-8 sanitization tests
Oct 1, 2025
e2ff7be
Add integration tests for UTF-8 sanitization
Oct 1, 2025
d60873f
Fix UTF-8 sanitization in export process
Oct 1, 2025
7757d05
Fix MyPy type checking and pre-commit hook issues
Oct 2, 2025
537d10b
Fix regression: Restore many-to-many XML ID export compatibility
Oct 2, 2025
84b77e9
Fix many-to-many raw database ID export for /.id fields
Oct 2, 2025
3a7cc13
Fix many-to-many raw database ID export for /.id fields
Oct 3, 2025
69a5d5b
Fix Ruff formatting issues
Oct 3, 2025
7506280
Fix regression: Many-to-many /id fields now export all XML IDs
Oct 3, 2025
b2a6e24
Fix regression: Many-to-many /id fields use export_data method for co…
Oct 3, 2025
180c5ec
Add regression prevention tests for many-to-many field export
Oct 3, 2025
ec9a080
Fix code style and ensure pre-commit passes
Oct 3, 2025
a1cd4cf
Fix many-to-many field processing for /.id specifiers
Oct 4, 2025
bc6d8f3
Fix empty external ID field handling to prevent constraint violations
Oct 4, 2025
ebaa601
Fix mypy unreachable code error in _convert_external_id_field function
Oct 4, 2025
ee3c046
Clean up confusing code block in export_threaded.py and fix variable …
Oct 5, 2025
553f694
Address review comments and fix various issues
Oct 5, 2025
a7894c0
Fix ruff linter errors
Oct 5, 2025
60a42ff
Improve test coverage and fix linting issues
Oct 5, 2025
4183d15
Fix mypy type annotation error in test file
Oct 5, 2025
9d602d2
Fix formatting issues detected by pre-commit hook
Oct 5, 2025
73c5254
Add comprehensive test coverage for import_threaded module
Oct 7, 2025
20808b3
Fix mypy duplicate module error and type issues\n\n- Add follow_impor…
Oct 9, 2025
438c4cb
Clean up unused type ignore comments
Oct 9, 2025
d502d0e
Fix mypy duplicate module error and enable proper type checking
Oct 9, 2025
d53ba76
Configure mypy to ignore misc errors in __main__.py
Oct 9, 2025
9f46bee
Complete mypy configuration fix and cleanup
Oct 9, 2025
a854501
Fix mypy type errors in noxfile.py and preflight.py
Oct 10, 2025
d642610
Fix XML-ID resolution logic and field name handling in relational imp…
Oct 11, 2025
1c91201
Add better error handling for export failures due to invalid JSON res…
Oct 11, 2025
7210a7a
Fix CSV sanitization and external ID field processing for product.sup…
Oct 17, 2025
f528301
Implement architectural changes to properly handle external ID fields…
Oct 17, 2025
92023f1
Intermediata commit
Oct 20, 2025
488602f
intermediate commit
Oct 20, 2025
9c7fc0b
intermediate
Oct 20, 2025
ebc8b61
Intermediate Commit
Oct 20, 2025
50b8782
intermediate commit 1 test stil failling
Oct 21, 2025
13e0f4d
intermediate commit 1 test failling
Oct 21, 2025
0433f24
intermediate
Oct 21, 2025
d6b2bcf
intermedaite coommit - very good state
Oct 21, 2025
6955647
all tests pass
Oct 21, 2025
3307063
ruff passing
Oct 21, 2025
6587ae0
All tests pass
Oct 21, 2025
80063e6
Extra tests
Oct 21, 2025
1862a55
test passing min coverage not met
Oct 22, 2025
2b74446
Minimum coverage reached
Oct 22, 2025
706af79
Stable, all test pass, coverage pass
Oct 23, 2025
3e1b7fb
mypy passing - stable version (still tuple oor)
Oct 23, 2025
c271e27
Fix: Fail file error reason spread among multiplte columns.
Oct 23, 2025
db8e67b
Fix external id resolving issues
Oct 23, 2025
d50f16b
Fix mypy errors and improve type safety
Oct 26, 2025
c300275
Fix mypy errors and improve type annotations
Oct 27, 2025
bc8be37
Fix all mypy errors and ensure type safety compliance
Oct 27, 2025
b8feed4
Fix test patch locations and restore project stability
Oct 27, 2025
4af3458
Fix test patch locations and mock return values to restore full test …
Oct 27, 2025
e1a1ad3
Final stabilization: Reduce failing tests from 43→27, restore MyPy cl…
Oct 27, 2025
08fd349
Silence C901 complexity errors and fix pre-commit issues
Oct 27, 2025
58037be
Intermediate commit: All mypy errors fixed and pre-commit passes
Oct 28, 2025
dd7f6fb
Final intermediate commit: All mypy errors fixed
Oct 28, 2025
6e8a0f2
Fix all remaining mypy errors and ensure full type safety
Oct 28, 2025
e355964
Fix all remaining mypy errors and ensure full type safety compliance
Oct 28, 2025
c749b3f
Fix test patch locations and restore project stability
Oct 28, 2025
59961d1
Fix CSV separator detection and error handling
Oct 29, 2025
b41eeb9
fix(export): parse datetime strings and add date_format params
Dec 8, 2025
d1e5dba
feat: Add constants module and improve default Odoo context
Dec 10, 2025
68b2753
fix: Improve import threaded processing and error handling
Dec 10, 2025
0ffa0d3
refactor: Enhance relational import strategies with context support
Dec 10, 2025
648f5d5
test: Update test cases to reflect code changes
Dec 10, 2025
bbe6656
docs: Add auto-scaling spec and debug utilities
Dec 10, 2025
6af5f5a
feat: Update exporter to use enhanced default context
Dec 10, 2025
8b21212
Try to improve error messages
Dec 13, 2025
d1b6693
Fix failing tests and improve code quality
Dec 13, 2025
7ed19eb
Improve test coverage and fix edge cases
Dec 13, 2025
b408172
Fix all failing tests in export_threaded_coverage
Dec 14, 2025
460aa17
Complete test coverage improvements and fixes
Dec 14, 2025
46e2bc1
Fix Polars DataFrame orientation warnings in tests
Dec 14, 2025
858a047
Enhanced error handling and fail file generation
Dec 17, 2025
6c0a05d
Add comprehensive tests for error handling
Dec 17, 2025
f546994
feat: Propagate specific load errors to a new `_LOAD_ERROR_REASON` co…
bosd Dec 17, 2025
f71b27b
fix: typeguard and mypy errors in threaded import/export
bosd Dec 19, 2025
e5613a8
Fix Nox sessions and Mypy errors, and consolidate project fixes
bosd Dec 20, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -130,6 +130,10 @@ ignore_missing_imports = true
check_untyped_defs = true


[[tool.mypy.overrides]]
module = "odoo_data_flow.export_threaded"
disable_error_code = ["unreachable"]

[[tool.mypy.overrides]]
module = "odoo"
ignore_missing_imports = true
Expand Down
401 changes: 378 additions & 23 deletions src/odoo_data_flow/export_threaded.py
View file
Open in desktop

Large diffs are not rendered by default.

Loading