Python aiohttp rate limit
Posts by Tag
- python 29
- cicd 18
- azure 14
- powershell 13
- gitlab 7
- ubuntu 6
- docker 5
- format 4
- databricks 4
- packaging 3
- git 3
- sqlalchemy 3
- web 2
- nuget 2
- proxy 2
- markdown 2
- requests 2
- wsl 2
- linux 2
- vscode 2
- async 2
- spark 2
- github 1
- github-pages 1
- powershell-gallery 1
- parsing 1
- ssh 1
- jekyll 1
- windows 1
- ruby 1
- repl 1
- readline 1
- string 1
- regex 1
- json 1
- csv 1
- module 1
- submodule 1
- package 1
- pyvmomi 1
- vmware 1
- scheduled-task 1
- certificate 1
- openssl 1
- backup 1
- update 1
- migration 1
- service 1
- redis 1
- multithreading 1
- pandas 1
- filtering 1
- network 1
- elastic 1
- scoop 1
- itertools 1
- ipython 1
- contextlib 1
- flask 1
- shell 1
- pip 1
- unittest 1
- pytest 1
- datetime 1
- container 1
- storage 1
- codec 1
- ast 1
- api 1
- rest 1
- githubaction 1
- sonar 1
python
Python Asyncio Study notes
concurrent.futures
Trying Python pipreqs and pip-tools
Some simple demos to test pipreqs and pip-tools
Python Requests With Retry
Make python requests retry easily to use
Rolling back from flask-restplus reqparse to native flask request to parse inputs
flask-restplus (flask-restx) reqparse is deprecated, migration to native flask request has some points to take care of
Compiling SQLAlchemy query to nearly real raw sql query
Compiling SQLAlchemy query to nearly real raw sql query
Using Python Contextmanager To Create A Timer Decorator
Using Python contextmanager to create a timer decorator
Making isort compatible with black
Making isort compatible with black
Fixing an ipython Windows ConEmu only bug on ‘MouseEventType.MOUSE_DOWN’
This post is for manually fixing an ipython Windows ConEmu only bug (from prompt_toolkit): Exception ‘MouseEventType.MOUSE_DOWN’ is not a valid MouseEventType
Flattening nested dict in Python
Flattening a nested dict/json with list as some keys’ value.
Install Python3 on Ubuntu
Install Python3 on Ubuntu by using official source.
SQLAlchemy mixin in method
Share common methods across SQLAlchemy db model classes by using mixin.
Troubleshooting Python Twine Cannot Upload Package On Windows
Python has several tools to upload packages to PyPi or some private Artifactory locations. The mostly used one should be twine. Although twine is not a Pytho...
Filtering In Pandas Dataframe
Filtering a pandas dataframe with series, query, or numpy methods.
Using Python SQLAlchemy session in multithreading
Using Python SQLAlchemy session in multithreading by using contextmanager or scope_session.
Creating Custom Python Request Auth Class
Creating custom python request auth class with requests.auth.AuthBase.
Using Gitlab integrated CICD for Python project on Windows
Gitlab ships with its own free CICD which works pretty well. This post will give a .gitlab-ci.yml demo for a Python project running on Gitlab Windows runner.
Use python tabulate module to create tables
If you want to create some tables from a python list, you can use the tabulate module, it can generate the table easily in text mode and in many formats, ...
Use pyVmomi EventHistoryCollector to get all the vCenter events
pyVmomi event manager returns only the last 1000 events. But EventHistoryCollector object’s ReadNextEvents()method can collect all the events.
Install Python on Windows with Powershell without administrator privileges
To fast deploy Python on Windows OS and without administrator privileges, we can use Powershell Install-Package to archive it.
Import Python module with sys.path variable when without __init__ file
When file A needs to import a function from the file B in another folder, and B is not in a module, we can use the sys.path variable.
Converting Python json dict list to csv file in 2 lines of code by pandas
One of the fastest way to convert Python json dict list to csv file with only 2 lines of code by pandas
Using Readline In Python REPL On Windows With PyReadline and PtPython
Use PyReadline and PtPython to have the powerful Readline in Python REPL on Windows OS.
cicd
Azure pipeline delete blobs from blob storage
The example given by this post is for Azure Pipeline with the latest Ubuntu agent, for AzCli from local machine, removing the --auth-mode login part should w...
Azure pipeline conditions
Azure pipeline has two kinds of conditions:
Azure Pipeline Checkout Multiple Repositories
This post will talk about some Azure pipeline predefined variables’ values in a multiple repositories checkout situation. The official doc is here.
Azure pipeline predefined variables
The official doc gives an explanation of all the predefined variables, but it lacks of some concret examples. Hereunder some examples for my preferred variab...
Using Gitlab integrated CICD for Python project on Windows
Gitlab ships with its own free CICD which works pretty well. This post will give a .gitlab-ci.yml demo for a Python project running on Gitlab Windows runner.
Migrate Gitlab in docker
This post will walk you through the steps to migrate Gitlab from one docker container to another. The steps need you to know how to install a new Gitlab c...
Update Gitlab in docker
Step by step procedure to update Gitlab in docker.
Backup and restore Gitlab in docker
Step by step procedure to backup and restore Gitlab in docker.
Install Gitlab Runner on Windows by Powershell PsRemoting
Install Gitlab runner on Windows over winrm PsRemoting with full command line.
Setup HTTPS for Gitlab
Setup a SAN SSL certificate to use the HTTPS on Gitlab-CE in docker on Ubuntu server.
Install Gitlab-CE in Docker on Ubuntu
Step by step installation of Gitlab-CE in docker on Ubuntu server.
azure
Azure pipeline delete blobs from blob storage
The example given by this post is for Azure Pipeline with the latest Ubuntu agent, for AzCli from local machine, removing the --auth-mode login part should w...
Databricks cluster access mode
What is cluster access mode
Databricks job/task context
Giving an example of Databricks job/task json context values
Azure pipeline conditions
Azure pipeline has two kinds of conditions:
Azure Pipeline Checkout Multiple Repositories
This post will talk about some Azure pipeline predefined variables’ values in a multiple repositories checkout situation. The official doc is here.
Azure pipeline predefined variables
The official doc gives an explanation of all the predefined variables, but it lacks of some concret examples. Hereunder some examples for my preferred variab...
powershell
Using Scoop On Windows
Some tips to use Scoop.
Using Powershell To Retrieve Latest Package Url From Github Releases
Github can host package releases, I will show you how to use Powershell to retrieve the latest release download url.
A fast way to check TCP port in Powershell
Test-NetConnection is too slow if the remote port is not opened due to its timeout setting. Use System.Net.Sockets.TcpClient instead.
Creating Multiple Redis Instance Services On Windows
Creating multiple Redis instance as Windows service on the same Windows server.
Setting Pwsh Invoke-WebRequest Proxy
One-line command to set Powershell Core web cmdlets proxy.
Using Gitlab integrated CICD for Python project on Windows
Gitlab ships with its own free CICD which works pretty well. This post will give a .gitlab-ci.yml demo for a Python project running on Gitlab Windows runner.
Terminate Powershell script or session
I always asked myself how to terminate a Powershell script or session, each time I needed to do some tests by myself and also searched on Google. But I co...
Install Gitlab Runner on Windows by Powershell PsRemoting
Install Gitlab runner on Windows over winrm PsRemoting with full command line.
Use Powershell to manage Windows Scheduled Task
Create, get, migrate Windows scheduled task by a pure Powershell way.
Install Python on Windows with Powershell without administrator privileges
To fast deploy Python on Windows OS and without administrator privileges, we can use Powershell Install-Package to archive it.
Select-ColorString : A Unix’s grep-like Powershell Cmdlet Based On Select-String With Color
Update 2019-12-28 Powershell 7 Select-String default highlighting
Powershell stop-parsing (--%)
Use Powershell stop-parsing (--%) to treat the remaining characters in the line as a literal.
Setting Up Powershell gallery And Nuget gallery
As like pypi for Python, npm for Node.js, we also have Powershell Gallery and Nuget Gallery for Powershell.
gitlab
Using Gitlab integrated CICD for Python project on Windows
Gitlab ships with its own free CICD which works pretty well. This post will give a .gitlab-ci.yml demo for a Python project running on Gitlab Windows runner.
Migrate Gitlab in docker
This post will walk you through the steps to migrate Gitlab from one docker container to another. The steps need you to know how to install a new Gitlab c...
Update Gitlab in docker
Step by step procedure to update Gitlab in docker.
Backup and restore Gitlab in docker
Step by step procedure to backup and restore Gitlab in docker.
Install Gitlab Runner on Windows by Powershell PsRemoting
Install Gitlab runner on Windows over winrm PsRemoting with full command line.
Setup HTTPS for Gitlab
Setup a SAN SSL certificate to use the HTTPS on Gitlab-CE in docker on Ubuntu server.
Install Gitlab-CE in Docker on Ubuntu
Step by step installation of Gitlab-CE in docker on Ubuntu server.
ubuntu
Install Python3 on Ubuntu
Install Python3 on Ubuntu by using official source.
Migrate Gitlab in docker
This post will walk you through the steps to migrate Gitlab from one docker container to another. The steps need you to know how to install a new Gitlab c...
Update Gitlab in docker
Step by step procedure to update Gitlab in docker.
Backup and restore Gitlab in docker
Step by step procedure to backup and restore Gitlab in docker.
Setup HTTPS for Gitlab
Setup a SAN SSL certificate to use the HTTPS on Gitlab-CE in docker on Ubuntu server.
Install Gitlab-CE in Docker on Ubuntu
Step by step installation of Gitlab-CE in docker on Ubuntu server.
docker
Using Databricks Connect inside a container
Using Databricks Connect inside a container with VSCode remote containers with spark, jre, python, databricks-connect pre-installed.
Migrate Gitlab in docker
This post will walk you through the steps to migrate Gitlab from one docker container to another. The steps need you to know how to install a new Gitlab c...
Update Gitlab in docker
Step by step procedure to update Gitlab in docker.
Backup and restore Gitlab in docker
Step by step procedure to backup and restore Gitlab in docker.
Install Gitlab-CE in Docker on Ubuntu
Step by step installation of Gitlab-CE in docker on Ubuntu server.
format
Making isort compatible with black
Making isort compatible with black
Convert markdown or rst to Atlassian Confluance documentation format
Atlassian Confluance is not fully markdown friendly yet, to versioning your doc in pure text mode, you can use html format as a bridge.
Use python tabulate module to create tables
If you want to create some tables from a python list, you can use the tabulate module, it can generate the table easily in text mode and in many formats, ...
databricks
Databricks cluster access mode
What is cluster access mode
Databricks job/task context
Giving an example of Databricks job/task json context values
Using Databricks Connect inside a container
Using Databricks Connect inside a container with VSCode remote containers with spark, jre, python, databricks-connect pre-installed.
packaging
Troubleshooting Python Twine Cannot Upload Package On Windows
Python has several tools to upload packages to PyPi or some private Artifactory locations. The mostly used one should be twine. Although twine is not a Pytho...
Setting Up Powershell gallery And Nuget gallery
As like pypi for Python, npm for Node.js, we also have Powershell Gallery and Nuget Gallery for Powershell.
git
Git Cheat Sheet
This is not a complete Git cheat sheet for everyone, this is just a personal cheat sheet for some often forgotten git commands.
Git untrack submodule from git status
submodule folders cannot be added into .gitignore file to untrack them from git status, we will use ignore=dirty to ignore it
sqlalchemy
Compiling SQLAlchemy query to nearly real raw sql query
Compiling SQLAlchemy query to nearly real raw sql query
SQLAlchemy mixin in method
Share common methods across SQLAlchemy db model classes by using mixin.
Using Python SQLAlchemy session in multithreading
Using Python SQLAlchemy session in multithreading by using contextmanager or scope_session.
web
Setting up Jekyll with Minimal Mistakes theme on Windows
Preview Jekyll blog locally on Windows with the Minimal Mistakes theme.
Setting up Github Pages With custom domain over HTTPS
With Github pages, we can create our blogs in our own domain over HTTPS completely free. Of course you should pay for your domain name at the Registrar.
nuget
Install Python on Windows with Powershell without administrator privileges
To fast deploy Python on Windows OS and without administrator privileges, we can use Powershell Install-Package to archive it.
Setting Up Powershell gallery And Nuget gallery
As like pypi for Python, npm for Node.js, we also have Powershell Gallery and Nuget Gallery for Powershell.
proxy
Setting Pwsh Invoke-WebRequest Proxy
One-line command to set Powershell Core web cmdlets proxy.
Setting Up Powershell gallery And Nuget gallery
As like pypi for Python, npm for Node.js, we also have Powershell Gallery and Nuget Gallery for Powershell.
markdown
Convert markdown or rst to Atlassian Confluance documentation format
Atlassian Confluance is not fully markdown friendly yet, to versioning your doc in pure text mode, you can use html format as a bridge.
Use python tabulate module to create tables
If you want to create some tables from a python list, you can use the tabulate module, it can generate the table easily in text mode and in many formats, ...
requests
Python Requests With Retry
Make python requests retry easily to use
Creating Custom Python Request Auth Class
Creating custom python request auth class with requests.auth.AuthBase.
wsl
My Powerline setup and configuration
Just my way to setup and configure powerline in WSL
Setting up WSL
Setting up WSL (Windows Subsystem for Linux)
linux
My Powerline setup and configuration
Just my way to setup and configure powerline in WSL
Setting up WSL
Setting up WSL (Windows Subsystem for Linux)
vscode
Using Databricks Connect inside a container
Using Databricks Connect inside a container with VSCode remote containers with spark, jre, python, databricks-connect pre-installed.
Making isort compatible with black
Making isort compatible with black
async
Python Asyncio Study notes
concurrent.futures
spark
Databricks cluster access mode
What is cluster access mode
Using Databricks Connect inside a container
Using Databricks Connect inside a container with VSCode remote containers with spark, jre, python, databricks-connect pre-installed.
github
Setting up Github Pages With custom domain over HTTPS
With Github pages, we can create our blogs in our own domain over HTTPS completely free. Of course you should pay for your domain name at the Registrar.
github-pages
Setting up Github Pages With custom domain over HTTPS
With Github pages, we can create our blogs in our own domain over HTTPS completely free. Of course you should pay for your domain name at the Registrar.
powershell-gallery
Setting Up Powershell gallery And Nuget gallery
As like pypi for Python, npm for Node.js, we also have Powershell Gallery and Nuget Gallery for Powershell.
parsing
Powershell stop-parsing (--%)
Use Powershell stop-parsing (--%) to treat the remaining characters in the line as a literal.
ssh
Powershell stop-parsing (--%)
Use Powershell stop-parsing (--%) to treat the remaining characters in the line as a literal.
jekyll
Setting up Jekyll with Minimal Mistakes theme on Windows
Preview Jekyll blog locally on Windows with the Minimal Mistakes theme.
windows
Setting up Jekyll with Minimal Mistakes theme on Windows
Preview Jekyll blog locally on Windows with the Minimal Mistakes theme.
ruby
Setting up Jekyll with Minimal Mistakes theme on Windows
Preview Jekyll blog locally on Windows with the Minimal Mistakes theme.
repl
Using Readline In Python REPL On Windows With PyReadline and PtPython
Use PyReadline and PtPython to have the powerful Readline in Python REPL on Windows OS.
readline
Using Readline In Python REPL On Windows With PyReadline and PtPython
Use PyReadline and PtPython to have the powerful Readline in Python REPL on Windows OS.
string
Select-ColorString : A Unix’s grep-like Powershell Cmdlet Based On Select-String With Color
Update 2019-12-28 Powershell 7 Select-String default highlighting
regex
Select-ColorString : A Unix’s grep-like Powershell Cmdlet Based On Select-String With Color
Update 2019-12-28 Powershell 7 Select-String default highlighting
json
Converting Python json dict list to csv file in 2 lines of code by pandas
One of the fastest way to convert Python json dict list to csv file with only 2 lines of code by pandas
csv
Converting Python json dict list to csv file in 2 lines of code by pandas
One of the fastest way to convert Python json dict list to csv file with only 2 lines of code by pandas
module
Import Python module with sys.path variable when without __init__ file
When file A needs to import a function from the file B in another folder, and B is not in a module, we can use the sys.path variable.
submodule
Git untrack submodule from git status
submodule folders cannot be added into .gitignore file to untrack them from git status, we will use ignore=dirty to ignore it
package
Install Python on Windows with Powershell without administrator privileges
To fast deploy Python on Windows OS and without administrator privileges, we can use Powershell Install-Package to archive it.
pyvmomi
Use pyVmomi EventHistoryCollector to get all the vCenter events
pyVmomi event manager returns only the last 1000 events. But EventHistoryCollector object’s ReadNextEvents()method can collect all the events.
vmware
Use pyVmomi EventHistoryCollector to get all the vCenter events
pyVmomi event manager returns only the last 1000 events. But EventHistoryCollector object’s ReadNextEvents()method can collect all the events.
scheduled-task
Use Powershell to manage Windows Scheduled Task
Create, get, migrate Windows scheduled task by a pure Powershell way.
certificate
Setup HTTPS for Gitlab
Setup a SAN SSL certificate to use the HTTPS on Gitlab-CE in docker on Ubuntu server.
openssl
Setup HTTPS for Gitlab
Setup a SAN SSL certificate to use the HTTPS on Gitlab-CE in docker on Ubuntu server.
backup
Backup and restore Gitlab in docker
Step by step procedure to backup and restore Gitlab in docker.
update
Update Gitlab in docker
Step by step procedure to update Gitlab in docker.
migration
Migrate Gitlab in docker
This post will walk you through the steps to migrate Gitlab from one docker container to another. The steps need you to know how to install a new Gitlab c...
service
Creating Multiple Redis Instance Services On Windows
Creating multiple Redis instance as Windows service on the same Windows server.
redis
Creating Multiple Redis Instance Services On Windows
Creating multiple Redis instance as Windows service on the same Windows server.
multithreading
Using Python SQLAlchemy session in multithreading
Using Python SQLAlchemy session in multithreading by using contextmanager or scope_session.
pandas
Filtering In Pandas Dataframe
Filtering a pandas dataframe with series, query, or numpy methods.
filtering
Filtering In Pandas Dataframe
Filtering a pandas dataframe with series, query, or numpy methods.
network
A fast way to check TCP port in Powershell
Test-NetConnection is too slow if the remote port is not opened due to its timeout setting. Use System.Net.Sockets.TcpClient instead.
elastic
Elastic Painless Scripted Field On Null/Missing Value
How to use painless scripted field to working on objects which might be null or missing in some documents.
scoop
Using Scoop On Windows
Some tips to use Scoop.
itertools
Flattening nested dict in Python
Flattening a nested dict/json with list as some keys’ value.
ipython
Fixing an ipython Windows ConEmu only bug on ‘MouseEventType.MOUSE_DOWN’
This post is for manually fixing an ipython Windows ConEmu only bug (from prompt_toolkit): Exception ‘MouseEventType.MOUSE_DOWN’ is not a valid MouseEventType
contextlib
Using Python Contextmanager To Create A Timer Decorator
Using Python contextmanager to create a timer decorator
flask
Rolling back from flask-restplus reqparse to native flask request to parse inputs
flask-restplus (flask-restx) reqparse is deprecated, migration to native flask request has some points to take care of
shell
My Powerline setup and configuration
Just my way to setup and configure powerline in WSL
pip
Trying Python pipreqs and pip-tools
Some simple demos to test pipreqs and pip-tools
unittest
Back to top ↑pytest
Back to top ↑datetime
Back to top ↑container
Using Databricks Connect inside a container
Using Databricks Connect inside a container with VSCode remote containers with spark, jre, python, databricks-connect pre-installed.
storage
Azure pipeline delete blobs from blob storage
The example given by this post is for Azure Pipeline with the latest Ubuntu agent, for AzCli from local machine, removing the --auth-mode login part should w...