Using Databricks Connect inside a container with VSCode remote containers with spark, jre, python, databricks-connect pre-installed.
Posts by Year
This post will talk about some Azure pipeline predefined variables’ values in a multiple repositories checkout situation. The official doc is here.
The official doc gives an explanation of all the predefined variables, but it lacks of some concret examples. Hereunder some examples for my preferred variab...
Some simple demos to test pipreqs and pip-tools
Make python requests retry easily to use
Just my way to setup and configure powerline in WSL
flask-restplus (flask-restx) reqparse is deprecated, migration to native flask request has some points to take care of
Compiling SQLAlchemy query to nearly real raw sql query
Using Python contextmanager to create a timer decorator
Making isort compatible with black
This post is for manually fixing an ipython Windows ConEmu only bug (from prompt_toolkit): Exception ‘MouseEventType.MOUSE_DOWN’ is not a valid MouseEventType
Flattening a nested dict/json with list as some keys’ value.
Setting up WSL (Windows Subsystem for Linux)
Some tips to use Scoop.
Github can host package releases, I will show you how to use Powershell to retrieve the latest release download url.
How to use painless scripted field to working on objects which might be null or missing in some documents.
Install Python3 on Ubuntu by using official source.
Share common methods across SQLAlchemy db model classes by using mixin.
Test-NetConnection is too slow if the remote port is not opened due to its timeout setting. Use System.Net.Sockets.TcpClient instead.
Python has several tools to upload packages to PyPi or some private Artifactory locations. The mostly used one should be twine. Although twine is not a Pytho...
Filtering a pandas dataframe with series, query, or numpy methods.
Some personal often forgotten git commands.
Using Python SQLAlchemy session in multithreading by using contextmanager or scope_session.
Creating custom python request auth class with requests.auth.AuthBase.
Creating multiple Redis instance as Windows service on the same Windows server.
One-line command to set Powershell Core web cmdlets proxy.
Gitlab ships with its own free CICD which works pretty well. This post will give a .gitlab-ci.yml demo for a Python project running on Gitlab Windows runner.
This post will walk you through the steps to migrate Gitlab from one docker container to another. The steps need you to know how to install a new Gitlab c...
Step by step procedure to update Gitlab in docker.
I always asked myself how to terminate a Powershell script or session, each time I needed to do some tests by myself and also searched on Google. But I co...
Step by step procedure to backup and restore Gitlab in docker.
Install Gitlab runner on Windows over winrm PsRemoting with full command line.
Setup a SAN SSL certificate to use the HTTPS on Gitlab-CE in docker on Ubuntu server.
Step by step installation of Gitlab-CE in docker on Ubuntu server.
Create, get, migrate Windows scheduled task by a pure Powershell way.
Atlassian Confluance is not fully markdown friendly yet, to versioning your doc in pure text mode, you can use html format as a bridge.
If you want to create some tables from a python list, you can use the tabulate module, it can generate the table easily in text mode and in many formats, ...
pyVmomi event manager returns only the last 1000 events. But EventHistoryCollector object’s ReadNextEvents()method can collect all the events.
To fast deploy Python on Windows OS and without administrator privileges, we can use Powershell Install-Package to archive it.
submodule folders cannot be added into .gitignore file to untrack them from git status, we will use ignore=dirty to ignore it
When file A needs to import a function from the file B in another folder, and B is not in a module, we can use the sys.path variable.
One of the fastest way to convert Python json dict list to csv file with only 2 lines of code by pandas
Update 2019-12-28 Powershell 7 Select-String default highlighting
Use PyReadline and PtPython to have the powerful Readline in Python REPL on Windows OS.
Some useful alias which make your Git life happier.
Preview Jekyll blog locally on Windows with the Minimal Mistakes theme.
Use Powershell stop-parsing (--%) to treat the remaining characters in the line as a literal.
As like pypi for Python, npm for Node.js, we also have Powershell Gallery and Nuget Gallery for Powershell.
With Github pages, we can create our blogs in our own domain over HTTPS completely free. Of course you should pay for your domain name at the Registrar.