Skip to content

Conversation

@kanterov
Copy link
Collaborator

@kanterov kanterov commented Apr 9, 2025

Changes

Add a minimal README that will be used for the PyPi package.

Why

We need to give the PyPi package README in case it gets discovered before CLI.

@kanterov kanterov marked this pull request as ready for review April 9, 2025 15:30
@kanterov kanterov temporarily deployed to test-trigger-is April 9, 2025 15:30 — with GitHub Actions Inactive

Python for Databricks Asset Bundles extends [Databricks Asset Bundles](https://docs.databricks.com/aws/en/dev-tools/bundles/) so that you can:
- Define jobs and pipelines as Python code. These jobs can coexist with jobs defined in YAML.
- Dynamically create jobs and pipelines using metadata.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we expand on what we mean by metadata here?

Python for Databricks Asset Bundles extends [Databricks Asset Bundles](https://docs.databricks.com/aws/en/dev-tools/bundles/) so that you can:
- Define jobs and pipelines as Python code. These jobs can coexist with jobs defined in YAML.
- Dynamically create jobs and pipelines using metadata.
- Modify jobs and pipelines defined in YAML or Python during bundle deployment.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

WDYT?

Suggested change
- Modify jobs and pipelines defined in YAML or Python during bundle deployment.
- Modify jobs and pipelines defined in YAML or Python during bundle deployment at runtime.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't want to say runtime, because it can be confused with job runtime that is not true. It was a common source of confusion until we made it very straightforward.

Copy link
Contributor

@lennartkats-db lennartkats-db left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you! The main thing here is so maintainers and others exploring the code know what this is about. And this README provides even more info beyond that.

@kanterov kanterov added this pull request to the merge queue Apr 10, 2025
Merged via the queue into main with commit 0b1325a Apr 10, 2025
15 checks passed
@kanterov kanterov deleted the python-readme branch April 10, 2025 13:48
kanterov added a commit that referenced this pull request Apr 10, 2025
## Changes
Add a minimal README that will be used for the PyPi package.

## Why
We need to give the PyPi package README in case it gets discovered
before CLI.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants