Blog#
Databricks job/task context
Suppose we're running following job/task in a Azure Databricks workspace:
jobId: "1111"
jobRunId: "2222"
taskRunId: "3333"
jobName: "ths job name"
taskName: "first-task"
databricksWorkspaceUrl: https://adb-4444444444.123.azuredatabricks.net/
Run below command in a Databricks job (task precisely):
Azure pipeline conditions
Azure pipeline has two kinds of conditions:
- With keyword
condition - With jinja like format
${{if elseif else}}
In both syntax, we have use parameters and variables, but there's a big difference between them which makes DevOps frustrated.
Azure Pipeline Checkout Multiple Repositories
This post will talk about some Azure pipeline predefined variables' values in a multiple repositories checkout situation. The official doc is here.
Manage Azure Databricks Service Principal
Most of Databricks management can be done from the GUI or CLI, but for Azure Service Principal, we can only manage it by the SCIM API. There's an open PR for adding support of SCIM API in Databricks CLI, but the lastest update is back to the beginning of 2021.
This post is to add some tips that not covered by the official API docs.