Github Actions - Python
Posts by Year
2023
Python Asyncio Unittest
Unittest based on Pytest framework not on embedded unittest.
2022
Azure pipeline delete blobs from blob storage
The example given by this post is for Azure Pipeline with the latest Ubuntu agent, for AzCli from local machine, removing the --auth-mode login part should w...
Databricks cluster access mode
What is cluster access mode
Databricks job/task context
Giving an example of Databricks job/task json context values
Azure pipeline conditions
Azure pipeline has two kinds of conditions:
Using Databricks Connect inside a container
Using Databricks Connect inside a container with VSCode remote containers with spark, jre, python, databricks-connect pre-installed.
Azure Pipeline Checkout Multiple Repositories
This post will talk about some Azure pipeline predefined variables’ values in a multiple repositories checkout situation. The official doc is here.
Azure pipeline predefined variables
The official doc gives an explanation of all the predefined variables, but it lacks of some concret examples. Hereunder some examples for my preferred variab...
2021
Python Asyncio Study notes
concurrent.futures
Trying Python pipreqs and pip-tools
Some simple demos to test pipreqs and pip-tools
Python Requests With Retry
Make python requests retry easily to use
Python Lint And Format
Azure SDK Python Guidelines
2020
My Powerline setup and configuration
Just my way to setup and configure powerline in WSL
Rolling back from flask-restplus reqparse to native flask request to parse inputs
flask-restplus (flask-restx) reqparse is deprecated, migration to native flask request has some points to take care of
Compiling SQLAlchemy query to nearly real raw sql query
Compiling SQLAlchemy query to nearly real raw sql query
Using Python Contextmanager To Create A Timer Decorator
Using Python contextmanager to create a timer decorator
Making isort compatible with black
Making isort compatible with black
Fixing an ipython Windows ConEmu only bug on ‘MouseEventType.MOUSE_DOWN’
This post is for manually fixing an ipython Windows ConEmu only bug (from prompt_toolkit): Exception ‘MouseEventType.MOUSE_DOWN’ is not a valid MouseEventType
Flattening nested dict in Python
Flattening a nested dict/json with list as some keys’ value.
Setting up WSL
Setting up WSL (Windows Subsystem for Linux)
2019
Using Scoop On Windows
Some tips to use Scoop.
Using Powershell To Retrieve Latest Package Url From Github Releases
Github can host package releases, I will show you how to use Powershell to retrieve the latest release download url.
Elastic Painless Scripted Field On Null/Missing Value
How to use painless scripted field to working on objects which might be null or missing in some documents.
Install Python3 on Ubuntu
Install Python3 on Ubuntu by using official source.
SQLAlchemy mixin in method
Share common methods across SQLAlchemy db model classes by using mixin.
A fast way to check TCP port in Powershell
Test-NetConnection is too slow if the remote port is not opened due to its timeout setting. Use System.Net.Sockets.TcpClient instead.
Troubleshooting Python Twine Cannot Upload Package On Windows
Python has several tools to upload packages to PyPi or some private Artifactory locations. The mostly used one should be twine. Although twine is not a Pytho...
Filtering In Pandas Dataframe
Filtering a pandas dataframe with series, query, or numpy methods.
Git Cheat Sheet
This is not a complete Git cheat sheet for everyone, this is just a personal cheat sheet for some often forgotten git commands.
Using Python SQLAlchemy session in multithreading
Using Python SQLAlchemy session in multithreading by using contextmanager or scope_session.
Creating Custom Python Request Auth Class
Creating custom python request auth class with requests.auth.AuthBase.
2018
Creating Multiple Redis Instance Services On Windows
Creating multiple Redis instance as Windows service on the same Windows server.
Setting Pwsh Invoke-WebRequest Proxy
One-line command to set Powershell Core web cmdlets proxy.
Using Gitlab integrated CICD for Python project on Windows
Gitlab ships with its own free CICD which works pretty well. This post will give a .gitlab-ci.yml demo for a Python project running on Gitlab Windows runner.
Migrate Gitlab in docker
This post will walk you through the steps to migrate Gitlab from one docker container to another. The steps need you to know how to install a new Gitlab c...
Update Gitlab in docker
Step by step procedure to update Gitlab in docker.
Terminate Powershell script or session
I always asked myself how to terminate a Powershell script or session, each time I needed to do some tests by myself and also searched on Google. But I co...
Backup and restore Gitlab in docker
Step by step procedure to backup and restore Gitlab in docker.
Install Gitlab Runner on Windows by Powershell PsRemoting
Install Gitlab runner on Windows over winrm PsRemoting with full command line.
Setup HTTPS for Gitlab
Setup a SAN SSL certificate to use the HTTPS on Gitlab-CE in docker on Ubuntu server.
Install Gitlab-CE in Docker on Ubuntu
Step by step installation of Gitlab-CE in docker on Ubuntu server.
Use Powershell to manage Windows Scheduled Task
Create, get, migrate Windows scheduled task by a pure Powershell way.
Convert markdown or rst to Atlassian Confluance documentation format
Atlassian Confluance is not fully markdown friendly yet, to versioning your doc in pure text mode, you can use html format as a bridge.
Use python tabulate module to create tables
If you want to create some tables from a python list, you can use the tabulate module, it can generate the table easily in text mode and in many formats, ...
Use pyVmomi EventHistoryCollector to get all the vCenter events
pyVmomi event manager returns only the last 1000 events. But EventHistoryCollector object’s ReadNextEvents()method can collect all the events.
Install Python on Windows with Powershell without administrator privileges
To fast deploy Python on Windows OS and without administrator privileges, we can use Powershell Install-Package to archive it.
Git untrack submodule from git status
submodule folders cannot be added into .gitignore file to untrack them from git status, we will use ignore=dirty to ignore it
Import Python module with sys.path variable when without __init__ file
When file A needs to import a function from the file B in another folder, and B is not in a module, we can use the sys.path variable.
Converting Python json dict list to csv file in 2 lines of code by pandas
One of the fastest way to convert Python json dict list to csv file with only 2 lines of code by pandas
Select-ColorString : A Unix’s grep-like Powershell Cmdlet Based On Select-String With Color
Update 2019-12-28 Powershell 7 Select-String default highlighting
Using Readline In Python REPL On Windows With PyReadline and PtPython
Use PyReadline and PtPython to have the powerful Readline in Python REPL on Windows OS.
Setting up Jekyll with Minimal Mistakes theme on Windows
Preview Jekyll blog locally on Windows with the Minimal Mistakes theme.
Powershell stop-parsing (--%)
Use Powershell stop-parsing (--%) to treat the remaining characters in the line as a literal.
Setting Up Powershell gallery And Nuget gallery
As like pypi for Python, npm for Node.js, we also have Powershell Gallery and Nuget Gallery for Powershell.
Setting up Github Pages With custom domain over HTTPS
With Github pages, we can create our blogs in our own domain over HTTPS completely free. Of course you should pay for your domain name at the Registrar.