Databricks job/task context

July 28, 2022 1 minute read

Giving an example of Databricks job/task json context values

Azure pipeline conditions

July 3, 2022 2 minute read

Azure pipeline has two kinds of conditions:

Using Databricks Connect inside a container

June 8, 2022 4 minute read

Using Databricks Connect inside a container with VSCode remote containers with spark, jre, python, databricks-connect pre-installed.

Azure Pipeline Checkout Multiple Repositories

April 3, 2022 13 minute read

This post will talk about some Azure pipeline predefined variables’ values in a multiple repositories checkout situation. The official doc is here.

Manage Azure Databricks Service Principal

March 27, 2022 1 minute read

Azure pipeline variables and parameters

March 9, 2022 2 minute read

Azure pipeline checkout repository from another project

February 19, 2022 3 minute read

Azure pipeline reuse variables in template from another repository

February 9, 2022 1 minute read

Azure pipeline predefined variables

January 22, 2022 2 minute read

The official doc gives an explanation of all the predefined variables, but it lacks of some concret examples. Hereunder some examples for my preferred variab...

Python Asyncio Study notes

September 4, 2021 less than 1 minute read

concurrent.futures