Skip to content

Conversation

@kanterov
Copy link
Collaborator

@kanterov kanterov commented Aug 15, 2025

Changes

Change code generation to make each namespace (e.g., databricks.bundles.jobs) isolated from another, following the design of Databricks SDK v1.

Since we already exported all necessary classes from namespace packages, imports don't change. There are 2 copies of the cluster-related classes, and they can't be used interchangeably anymore when constructing jobs and pipelines. One can be converted into another through dictionaries:

import databricks.bundles.jobs as jobs
import databricks.bundles.pipelines as pipelines

job_init_scripts = jobs.InitScriptInfo(...)
pipeline_init_scripts = pipelines.InitScriptInfo.from_dict(job_init_scripts.to_dict())

Why

It uncouples resources from each other and allows us to evolve their schema independently

Tests

Updating existing tests and reviewing codegen diff

@kanterov kanterov temporarily deployed to test-trigger-is August 15, 2025 08:49 — with GitHub Actions Inactive
@kanterov kanterov marked this pull request as ready for review August 15, 2025 08:49
@kanterov kanterov force-pushed the isolate-python-namespaces branch from 3683010 to 02c449c Compare August 15, 2025 09:01
@kanterov kanterov temporarily deployed to test-trigger-is August 15, 2025 09:01 — with GitHub Actions Inactive
@eng-dev-ecosystem-bot
Copy link
Collaborator

eng-dev-ecosystem-bot commented Aug 15, 2025

Run: 17046048154

Env ✅‌pass 🙈‌skip
✅‌ aws linux 310 482
✅‌ aws windows 311 481
✅‌ aws-ucws linux 423 381
✅‌ aws-ucws windows 424 380
✅‌ azure linux 310 481
✅‌ azure windows 311 480
✅‌ azure-ucws linux 425 378
✅‌ azure-ucws windows 426 377
✅‌ gcp linux 309 483
✅‌ gcp windows 310 482

@kanterov kanterov force-pushed the isolate-python-namespaces branch from 02c449c to e57f1c9 Compare August 18, 2025 16:08
@kanterov kanterov temporarily deployed to test-trigger-is August 18, 2025 16:08 — with GitHub Actions Inactive
@kanterov kanterov enabled auto-merge August 18, 2025 16:09
@kanterov kanterov added this pull request to the merge queue Aug 18, 2025
Merged via the queue into main with commit cf7e107 Aug 18, 2025
19 checks passed
@kanterov kanterov deleted the isolate-python-namespaces branch August 18, 2025 16:52
deco-sdk-tagging bot added a commit that referenced this pull request Aug 21, 2025
## Release v0.265.0

### CLI
* Fix "cache: token not found" for auth token command ([#3447](#3447))

### Dependency updates
* Upgrade TF provider to 1.87.0 ([#3430](#3430))
* Upgrade Go SDK to 0.81.0 ([#3449](#3449))

### Bundles
* Add support for Lakebase database instances in DABs ([#3283](#3283))
* Add support for Lakebase database catalogs in DABs ([#3436](#3436))
* Improve error message for SDK/API errors ([#3379](#3379))
* Separate generated classes between jobs and pipelines in Python support ([#3428](#3428))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants