记录 - Gary's Blog

Run/Debug Azure Function App with Local Storage Azurite

2023-11-23 4 记录 Leave a Comment

To archive this, you have to have VSCode installed in local machine. Step 1: Install Azurite in VSCode Open VSCode Extensions and search Azurite, install it. Press F1, in command bar, search Azurite: Start, select it then the Azurite will start in your local machine. Step 2: Install Microsoft Azure Storage Expl…

How to run ML/DL model on remote GPU server in Jupyter notebook

2023-11-07 12 记录 Leave a Comment

If your AWS, Azure or any other remote server has GPU, you would like to run you model on them. Maybe tensorflow, keras, or sklean. Just follow these steps: Step 1 Install Docker and Cuda driver on your server. Step 2 Run tensorflow and jupyter container on your server. docker run -p 8888:8888 quay.io/jupyter/s…

Complete Guide: Sending Emails via AWS SES using SMTP

2023-10-16 15 记录 Leave a Comment

While I started to send email via AWS SES, it took me a long time to config it to make it working. So I wrote it down once I success doing it. Here are the important poinits: Verified identities Create SMTP credentials Send email with smtplib Raise ticket to AWS (default the SMTP is in sandbox, you can only sen…

Python solved SMTP ssl.SSLError: [SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:1002)

2023-10-10 55 记录 Leave a Comment

Usually, we send email by SMTP using: def send_email(receivers, subject, body): msg = EmailMessage() msg['From'] = SMTP_USER msg['Bcc'] = receivers msg['Subject'] = subject msg.add_alternative(body, subtype='html') with smtplib.SMTP_SSL(SMTP_HOST, SMTP_PORT) as server: se…

Selenium infinite scrolling to bottom using python

2023-09-19 15 记录 Leave a Comment

We have 3 kinds of infinite scrolling to bottom while using selenium. Simply scrolling - Stop until there is no more content. Meet scrolling - Stop until we meet a speciy element. Partial scrolling - Scrolling content in specify html container, stop until there are no more content. All these 3 scenses will use …

How to install OS and connect to NanoPi-R2S (rk3328)

2023-09-12 53 记录 Leave a Comment

Official wiki page OS image on Google Drive Install OS Go to google drive, navigate to: 01_Official images/01_SD card images. Download any image, e.g., "rk3328-sd-debian-bullseye-core-5.15-arm64-20230529.img.gz". Unzip it to "rk3328-sd-debian-bullseye-core-5.15-arm64-20230529.img". importat…

The most commonly used functions in machine learning data cleaning

2023-09-05 22 记录 Leave a Comment

1. Get null percentage of columns def get_null_percentage(df): count = df.isnull().sum() percent = (df.isnull().mean() * 100).round(2) summary = pd.DataFrame({'count': count, 'percentage': percent}) return summary[summary["count"] > 0].sort_values(ascending=False, by="perce…

How to find all indicators and country codes while using imf api

2023-08-08 67 记录 Leave a Comment

When following the imf api service to query data, you have to specify the indicators. You must have viewed this 2 posts: How to Use the API (Python and R) IMF API (Python) But both of them do not explain how to get full list of indicators as well as the country code. Get full list of imf indicators We have to a…

What is OpenAI Function Calling and How to Use it?

2023-06-17 95 记录 1 Comment

Simply put, OpenAI / ChatGPT function calling can identify the intent and entities in a sentence through a language model. For example, when the user asks "I want to recharge my phone100 USD". The model should recognize the intent recharge and it's 2 entities recharge amont: 100 currency:USD Back to O…

A script to test MySQL port is running

2023-05-03 62 记录 Leave a Comment

#!/bin/bash ip="<MySQL HOST>" port="<MySQL PORT>" output_file="<Log File Path>" while : do nc -zv "$ip" "$port" > /dev/null datetime=$(date +"%Y-%m-%d %H:%M:%S") if [ $? -eq 0 ]; then echo "$datetime: Port $port is open on $ip…