Blog#

Calling Azure REST API

This blog Calling Azure REST API via curl is pretty good. Just two more things.

Python aiohttp rate limit

HTTP rate limit is often the max requests in a limited time period, and sometimes could also be the max concurrent requests.

Syncing repository from github to gitee

I need to sync github repository (files and commits only) https://github.com/copdips/copdips.github.io to gitee repository https://gitee.com/copdips/copdips.github.io.

Python difference on subprocess run(), call(), check_call(), check_output()

Using ast and cst to change Python code

Azure pipeline Windows agent UnicodeEncodeError

For people who encounter UnicodeEncodeError when using Windows Azure Pipeline agent, the issue might be here.

As per above link, or this email, the solutions could be:

• You can override just sys.std* to UTF-8 by setting the environment variable PYTHONIOENCODING=UTF-8.
• You can override all I/O to use UTF-8 by setting PYTHONUTF8=1, or by passing the command-line option -X utf8.

Azure pipeline delete blobs from blob storage

The example given by this post is for Azure Pipeline with the latest Ubuntu agent, for AzCli from local machine, removing the --auth-mode login part should work.

As it's a Linux pipeline agent, the pipeline task AzureFileCopy can not be used, it's written in Powershell, we should use the AzureCLI task instead.

Databricks cluster access mode

Adding data files to Python package with setup.py

Azure pipeline System.AccessToken in shared pipeline