Fix default-python template not to add environments when serverless=yes and include_python=no (#2866)

## Changes
Do not add environments section in default-python templates if there is
no python_wheel_task section.

## Why
Since it's python_wheel_task that triggers implicit artifact and wheel
creation, environment fails with the error when resolving `./dist/*.whl`
pattern.

## Tests
New acceptance test that extensively deploys all possible combinations
of default-python template. On main branch this test fails for
combinations with serverless=yes include_python=no.

Author: denik

NEXT_CHANGELOG.md

@@ -12,5 +12,6 @@
 * Removed unused fields from resources.models schema: creation\_timestamp, last\_updated\_timestamp, latest\_versions and user\_id. Using them now raises a warning.
 * Preserve folder structure for app source code in bundle generate ([#2848](https://github.com/databricks/cli/pull/2848))
 * Fixed normalising requirements file path in dependencies section ([#2861](https://github.com/databricks/cli/pull/2861))
+* Fix default-python template not to add environments when serverless=yes and include\_python=no ([#2866](https://github.com/databricks/cli/pull/2866))
 
 ### API Changes

acceptance/bundle/templates/default-python/combinations/check_output.py

@@ -0,0 +1,51 @@
+#!/usr/bin/env python3
+import sys
+import os
+import subprocess
+
+
+BUILDING = "Building python_artifact"
+UPLOADING = "Uploading dist/"
+STATE = "Updating deployment state"
+
+
+def is_printable_line(line):
+    # only shown when include_python=yes
+    if line.startswith(BUILDING):
+        return False
+
+    # only shown when include_python=yes
+    if line.startswith(UPLOADING):
+        return False
+
+    # not shown when all settings are equal to "no"
+    if line.startswith(STATE):
+        return False
+
+    return True
+
+
+p = subprocess.run(sys.argv[1:], stdout=subprocess.PIPE, stderr=subprocess.PIPE, encoding="utf-8")
+try:
+    assert p.returncode == 0
+    assert p.stdout == ""
+    for line in p.stderr.strip().split("\n"):
+        if is_printable_line(line):
+            print(line.strip())
+
+    if os.environ["INCLUDE_PYTHON"] == "yes":
+        assert BUILDING in p.stderr
+        assert UPLOADING in p.stderr
+    else:
+        assert BUILDING not in p.stderr
+        assert UPLOADING not in p.stderr
+
+except:
+    print(f"STDOUT: {len(p.stdout)} chars")
+    if p.stdout:
+        print(p.stdout)
+    print(f"STDERR: {len(p.stderr)} chars")
+    if p.stderr:
+        print(p.stderr)
+    print(f"CODE: {p.returncode}", flush=True)
+    raise

acceptance/bundle/templates/default-python/combinations/input.json.tmpl

@@ -0,0 +1,7 @@
+{
+    "project_name": "my_default_python",
+    "include_notebook": "$INCLUDE_NOTEBOOK",
+    "include_dlt": "$INCLUDE_DLT",
+    "include_python": "$INCLUDE_PYTHON",
+    "serverless": "$SERVERLESS"
+}

acceptance/bundle/templates/default-python/combinations/output.txt

@@ -0,0 +1,35 @@
+
+>>> [CLI] bundle init default-python --config-file ./input.json
+
+Welcome to the default Python template for Databricks Asset Bundles!
+Workspace to use (auto-detected, edit in 'my_default_python/databricks.yml'): [DATABRICKS_URL]
+
+✨ Your new project has been created in the 'my_default_python' directory!
+
+Please refer to the README.md file for "getting started" instructions.
+See also the documentation at https://docs.databricks.com/dev-tools/bundles/index.html.
+
+>>> [CLI] bundle validate -t dev
+Name: my_default_python
+Target: dev
+Workspace:
+  Host: [DATABRICKS_URL]
+  User: [USERNAME]
+  Path: /Workspace/Users/[USERNAME]/.bundle/my_default_python/dev
+
+Validation OK!
+
+>>> [CLI] bundle validate -t prod
+Name: my_default_python
+Target: prod
+Workspace:
+  Host: [DATABRICKS_URL]
+  User: [USERNAME]
+  Path: /Workspace/Users/[USERNAME]/.bundle/my_default_python/prod
+
+Validation OK!
+
+>>> ../check_output.py [CLI] bundle deploy -t dev
+Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/my_default_python/dev/files...
+Deploying resources...
+Deployment complete!

acceptance/bundle/templates/default-python/combinations/script

@@ -0,0 +1,15 @@
+envsubst < input.json.tmpl > input.json
+trace $CLI bundle init default-python --config-file ./input.json
+
+cd ./my_default_python
+trace $CLI bundle validate -t dev
+trace $CLI bundle validate -t prod
+
+trace ../check_output.py $CLI bundle deploy -t dev
+
+# Fails on testserver with: Error: Method Not Allowed
+#trace ../check_output.py $CLI bundle deploy -t prod
+
+# Do not affect this repository's git behaviour #2318
+mv .gitignore out.gitignore
+rm .databricks/.gitignore

acceptance/bundle/templates/default-python/combinations/test.toml

@@ -0,0 +1,13 @@
+Ignore = ["my_default_python", "input.json"]
+EnvMatrix.INCLUDE_NOTEBOOK = ["yes", "no"]
+EnvRepl.INCLUDE_NOTEBOOK = false
+EnvMatrix.INCLUDE_DLT = ["yes", "no"]
+EnvRepl.INCLUDE_DLT = false
+EnvMatrix.INCLUDE_PYTHON = ["yes", "no"]
+EnvRepl.INCLUDE_PYTHON = false
+EnvMatrix.SERVERLESS = ["yes", "no"]
+EnvRepl.SERVERLESS = false
+
+[[Repls]]
+Old = '202\d{5}.\d{5,}'
+New = '[VERSION_TIMESTAMP]'

libs/template/templates/default-python/template/{{.project_name}}/resources/{{.project_name}}.job.yml.tmpl

@@ -66,7 +66,7 @@ resources:
 {{- end -}}
 {{else}}
 {{- end}}
-{{if $with_serverless}}
+{{if $with_serverless}}{{if (eq .include_python "yes")}}
       # A list of task execution environment specifications that can be referenced by tasks of this job.
       environments:
         - environment_key: default
@@ -77,7 +77,7 @@ resources:
             client: "1"
             dependencies:
               - ../dist/*.whl
-{{ else }}
+{{end}}{{ else }}
       job_clusters:
         - job_cluster_key: job_cluster
           new_cluster: