Fixes of scaffolding instructions #4215

keugenek · 2026-01-07T21:50:43Z

Summary

Update databricks_discover tool description to emphasize it must be called first
Update flow.tmpl with explicit scaffolding workflow rules

Changes

provider.go:

databricks_discover description now says "CALL THIS FIRST" and explains it returns scaffolding commands

flow.tmpl:

Added "Critical Workflow Rules" section
Rule: "NEVER use npm/npx/vite directly - init-template creates proper Databricks bundle"
Reordered tools to put databricks_discover first with "MUST call first" note

Why

AI agents were defaulting to npm/vite for scaffolding instead of using invoke_databricks_cli with init-template. These prompt improvements guide agents to call databricks_discover first, which returns the correct scaffolding workflow.

experimental/apps-mcp/lib/prompts/flow.tmpl

Clarify that npm run dev/install/build are OK for development, only npm create vite should be avoided for initial scaffolding. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

experimental/apps-mcp/lib/providers/clitools/provider.go

Co-authored-by: Lennart Kats (databricks) <lennart.kats@databricks.com>

Merged improvements: mention editing code, deploying bundles, querying data, and workspace configuration context. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

eng-dev-ecosystem-bot · 2026-01-08T17:11:55Z

Commit: 5f65ee3

Run: 20817671639

	Env	💥PANIC	❌FAIL	🟨KNOWN	🤯MISS	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
🟨	aws linux			18			5	2	417	663	88:06
❌	aws windows		2	23				2	417	661	89:16
💥	aws-ucws linux	1		13	18		9	2	569	533	120:00
🟨	aws-ucws windows			19			4	2	588	532	113:25
🟨	azure linux			2		4	16	3	413	662	62:52
🟨	azure windows			11			7	3	419	660	60:56
🟨	azure-ucws linux			2		9	9	3	580	533	245:34
🟨	azure-ucws windows			15	4			3	584	530	120:00
🟨	gcp linux			2			16	3	397	671	48:22
🟨	gcp windows			11			7	3	399	669	55:14

51 interesting tests: 24 KNOWN, 17 MISS, 6 flaky, 2 FAIL, 1 PANIC, 1 SKIP

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	🟨K	🟨K	🤯M	🟨K	💚R	🟨K	💚R	🤯M	💚R	🟨K
🟨	TestAccept/bundle/deployment/bind/alert	🙈S	🙈S	🙈S	🙈S	💚R	💚R	🔄f	🟨K	💚R	💚R
🟨	TestAccept/bundle/generate/alert	🟨K	🟨K	🟨K	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
🟨	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	🟨K	🟨K	💚R	🟨K	🔄f	🟨K	💚R	🟨K
🟨	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	🟨K	🟨K	💚R	🟨K	🔄f	🟨K	💚R	🟨K
🟨	TestAccept/bundle/resources/alerts/basic	🟨K	🟨K	🟨K	🟨K	💚R	💚R	💚R	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	🟨K	🟨K	💚R	💚R	🔄f	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	🟨K	🟨K	💚R	💚R	🔄f	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/alerts/with_file	🟨K	🟨K	🟨K	🟨K	💚R	💚R	💚R	🤯M	💚R	💚R
🟨	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	🟨K	🟨K	💚R	💚R	🔄f	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	🟨K	🟨K	💚R	💚R	🔄f	🤯M	💚R	💚R
🔄	TestAccept/bundle/resources/clusters/run/spark_python_task	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/clusters/run/spark_python_task/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/nested-folders	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/nested-folders/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/nested-folders/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/simple	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/simple/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/simple/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/simple_outside_bundle_root	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/simple_outside_bundle_root/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/simple_outside_bundle_root/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/simple_syncroot	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/dashboards/simple_syncroot/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	🤯M	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🤯	TestAccept/bundle/resources/database_catalogs/basic	🙈s	🙈s	🤯M	✅p	🙈s	🙈s	✅p	✅p	🙈s	🙈s
🤯	TestAccept/bundle/resources/database_catalogs/basic/DATABRICKS_BUNDLE_ENGINE=direct			🤯M	✅p			✅p	✅p
🤯	TestAccept/bundle/resources/database_catalogs/basic/DATABRICKS_BUNDLE_ENGINE=terraform			🤯M	✅p			✅p	✅p
🤯	TestAccept/bundle/resources/database_instances/single-instance	🙈s	🙈s	🤯M	✅p	🙈s	🙈s	✅p	✅p	🙈s	🙈s
🤯	TestAccept/bundle/resources/database_instances/single-instance/DATABRICKS_BUNDLE_ENGINE=direct			🤯M	✅p			✅p	✅p
💥	TestAccept/bundle/resources/database_instances/single-instance/DATABRICKS_BUNDLE_ENGINE=terraform			💥P	✅p			✅p	✅p
🙈	TestAccept/bundle/resources/permissions	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🔄	TestAccept/bundle/resources/permissions/factcheck	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	🙈s	🙈s
🔄	TestAccept/bundle/resources/permissions/factcheck/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	🟨K	🟨K	🟨K	🟨K	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	🟨K	🟨K
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	🟨K	🟨K	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	💚R	💚R
❌	TestAccept/bundle/templates/default-python/combinations/classic	✅p	❌F	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=yes/PY=yes/READPLAN=	✅p	❌F	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/templates/default-python/combinations/serverless	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p
🔄	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=yes/READPLAN=	🙈s	🙈s	✅p	✅p	🙈s	🙈s	🔄f	✅p	🙈s	🙈s
🤯	TestInprocessMode	🙈s	🙈s	🤯M	🙈s	🙈s	🙈s	🙈s	🤯M	🙈s	🙈s
🟨	TestExport	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
🟨	TestExportWithFileFlag	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
🟨	TestImportDir	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
🟨	TestImportDirDoesNotOverwrite	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
🟨	TestImportDirWithOverwriteFlag	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
🟨	TestImportFileFormatAuto	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
🟨	TestImportFileFormatSource	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K

Top 50 slowest tests (at least 2 minutes):

duration	env	testname
40:37	azure-ucws linux	TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=terraform
13:44	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
13:36	gcp linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
13:34	azure-ucws windows	TestAccept/bundle/resources/permissions/factcheck/DATABRICKS_BUNDLE_ENGINE=terraform
11:58	gcp windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
10:41	azure windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
10:35	aws-ucws windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
10:30	aws-ucws linux	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=direct
10:30	aws-ucws windows	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=direct
10:28	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
10:18	gcp windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
10:17	azure windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
9:59	aws-ucws windows	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=terraform
9:56	aws-ucws linux	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=terraform
9:47	azure windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
8:51	aws-ucws linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=SINGLE_USER
8:40	azure-ucws windows	TestAccept/bundle/resources/database_catalogs/basic/DATABRICKS_BUNDLE_ENGINE=terraform
8:31	azure windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
8:07	aws windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION
8:06	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION
8:05	azure-ucws windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
8:03	aws-ucws linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
7:54	aws-ucws windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=SINGLE_USER
7:52	gcp linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
7:51	gcp windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
7:51	aws-ucws windows	TestSparkJarTaskDeployAndRunOnVolumes/Databricks_Runtime_15.4_LTS
7:51	gcp linux	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_15.4_LTS
7:45	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster/DATABRICKS_BUNDLE_ENGINE=direct
7:43	azure windows	TestAccept/bundle/integration_whl/interactive_cluster/DATABRICKS_BUNDLE_ENGINE=direct
7:42	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION
7:40	azure linux	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_14.3_LTS
7:37	aws-ucws windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=direct
7:36	aws-ucws windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
7:35	gcp windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=direct
7:35	gcp windows	TestAccept/bundle/run/app-with-job/DATABRICKS_BUNDLE_ENGINE=direct
7:35	aws-ucws linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
7:34	azure windows	TestAccept/bundle/resources/clusters/run/spark_python_task/DATABRICKS_BUNDLE_ENGINE=direct
7:30	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=SINGLE_USER
7:29	gcp windows	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_14.3_LTS
7:29	azure-ucws linux	TestAccept/bundle/resources/permissions/factcheck/DATABRICKS_BUNDLE_ENGINE=terraform
7:28	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster/DATABRICKS_BUNDLE_ENGINE=terraform
7:28	aws-ucws windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
7:26	gcp linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
7:23	aws linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
7:23	gcp windows	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_15.4_LTS
7:21	aws-ucws linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
7:18	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=USER_ISOLATION
7:18	aws windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
7:17	aws-ucws linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
7:17	azure linux	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_15.4_LTS

Fixes of scaffolding instructions

33ff24d

keugenek requested review from a team and lennartkats-db as code owners January 7, 2026 21:50

keugenek temporarily deployed to test-trigger-is January 7, 2026 21:51 — with GitHub Actions Inactive

arsenyinfo reviewed Jan 8, 2026

View reviewed changes

experimental/apps-mcp/lib/prompts/flow.tmpl Outdated Show resolved Hide resolved

Allow npm commands after scaffolding

e187fc4

Clarify that npm run dev/install/build are OK for development, only npm create vite should be avoided for initial scaffolding. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

keugenek temporarily deployed to test-trigger-is January 8, 2026 11:03 — with GitHub Actions Inactive

Merge branch 'main' into ekniazev/mcp-prompt-fix

33c27ba

keugenek temporarily deployed to test-trigger-is January 8, 2026 11:33 — with GitHub Actions Inactive

lennartkats-db reviewed Jan 8, 2026

View reviewed changes

experimental/apps-mcp/lib/providers/clitools/provider.go Show resolved Hide resolved

lennartkats-db reviewed Jan 8, 2026

View reviewed changes

experimental/apps-mcp/lib/providers/clitools/provider.go Outdated Show resolved Hide resolved

Update experimental/apps-mcp/lib/providers/clitools/provider.go

8ab6941

Co-authored-by: Lennart Kats (databricks) <lennart.kats@databricks.com>

keugenek temporarily deployed to test-trigger-is January 8, 2026 11:56 — with GitHub Actions Inactive

arsenyinfo approved these changes Jan 8, 2026

View reviewed changes

Broaden databricks_discover description

08e4a76

Merged improvements: mention editing code, deploying bundles, querying data, and workspace configuration context. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

keugenek temporarily deployed to test-trigger-is January 8, 2026 12:23 — with GitHub Actions Inactive

keugenek added this pull request to the merge queue Jan 8, 2026

Merged via the queue into main with commit 5f65ee3 Jan 8, 2026
14 checks passed

keugenek deleted the ekniazev/mcp-prompt-fix branch January 8, 2026 13:00

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Fixes of scaffolding instructions #4215

Fixes of scaffolding instructions #4215

keugenek commented Jan 7, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jan 8, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Fixes of scaffolding instructions #4215

Fixes of scaffolding instructions #4215

Conversation

keugenek commented Jan 7, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jan 8, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants