Web on Blog - uTIcARdI

VSCode as an IDLE for Django

Fri, 15 Nov 2019 00:00:00 +0000

This blog is about using MS VSCode as Django IDLE (OS: Mac OX, the steps are referenceable on Linux, Windows).

1. Download installation files and install MS VScode, Python from following links:

Optional: On Mac OS, I recommend homebrew for Python Installation because third party libraries’ dependency will be processed smoothly.

Install homebrew:
/usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
Install Python3:
brew install python@3

2. Python Extension

Launch VSCode and install the Extension: Python

Post a file to Flask by Curl via API

Wed, 20 Feb 2019 00:00:00 +0000

Curl is widely used in command lines or scripts to transfer data.
Different ways to use curl to post a file to a web server with samples (from both client-side and server: Python-Flask side) will be discussed because it took me a while on the server-side to receiving the data from client.
I would like to add samples of Python-requests, Postman later.

Started with

macOS Mojave
Python 3.7.2
Flask 1.0.2
Flask-RESTful 0.3.7
curl 7.54.0 (x86_64-apple-darwin18.0)

The Flask code:

# Py file name: simple.py
from flask import Flask, request
from flask_restful import Api, Resource, reqparse
import werkzeug

app = Flask(__name__)
api = Api(app)

class kzwebfile(Resource):

 def post(self, filename):
pass

api.add_resource(kzwebfile, '/<string:filename>')

if __name__ == "__main__":
 app.run()

Hugo-Customization

Wed, 06 Feb 2019 00:00:00 +0000

A list about how I customize Hugo and why I did the change, the post will be updated continuously.

1. fractions

Network Engineer should care about this, because it shows wrong IP/mask format with default value:

fractions with default value

Disable it in config.toml:

[blackfriday]
 fractions = false

2. hrefTargetBlank

This default value of the option is false which means external links(The wording was corrected to “absolute” from ’external’ on Hugo official doc). I prefer to change the value to true.

Hugo-Versioning

Sun, 27 Jan 2019 00:00:00 +0000

Hugo provides the detail instructions about how to deploy it on different environment.

At first, I followed Deployment of Project Pages from /docs folder on master branch, and put all files in one repository.

I continue to check Deployment of Project Pages From Your gh-pages branch after I did some customization on hugo-theme-cleanwhite and want to publish the change to the forked branch.

Instead of the follow Hugo guide, I did some try myself. I searched “change a subfolder to another repository and found the article: Moving Files from one Git Repository to Another, Preserving History but its case is:

Hugo-Images management

Fri, 25 Jan 2019 00:00:00 +0000

I introduced why I migrate my blog to github and Hugo here. Most of articles have been moved to here in 30 days. Next, I just want to talk about something about posts’ images management, versioning, theme customization/something about SEO.

Before start

All images will be compressed before I upload them for the post. Many tools that could do this, such as tinypng, UPNG. My choice is Tinypng because it supports variety formats and its API.

img compression (20M to 5.1M)

Tinypng’s APIs can be called by Python-Requests in this way:

import os
from os import path
import requests
from requests.auth import HTTPBasicAuth

def picopt(root_path, apikey):
 for f in os.listdir(root_path):
 fullurl = os.sep.join([root_path, f])
 if path.isdir(fullurl):
 picopt(fullurl, apikey)
 else:
 if fullurl.endswith(('.DS_Store', '-opt.png', '-opt.jpg', '-opt.jpeg')):
 print('ignore ' + fullurl)
 continue
 print('processing ' + fullurl)

 with open(fullurl, 'rb') as imgf:
 content = imgf.read()
 res = requests.post(
 auth=HTTPBasicAuth("api:%s" %(apikey), ''), url='https://api.tinify.com/shrink', data=content)
 print(res.json())
 optimgurl = res.json()['output']['url']
 # print(optimgurl)
 res = requests.get(
 auth=HTTPBasicAuth("api:%s" %(apikey), ''), url=optimgurl)

 filename, filetypestr = fullurl.rsplit('.', 1)
 optfullurl = '-opt.'.join([filename, filetypestr])
 with open(optfullurl, 'wb') as fd:
 for chunk in res.iter_content(chunk_size=128):
 fd.write(chunk)
 print('optimized img file: ' + fullurl)

if __name__ == "__main__":
 devkey = ''
 postimgsfolder = ''
 picopt(postimgsfolder, devkey)

aiohttp/aiodns-Resolving using custom nameservers

Wed, 23 Jan 2019 00:00:00 +0000

aiohttp is an Asynchronous HTTP client/server framework for asyncio and Python

I tried it because of the features:

With this, verifying the CDN’s POPs with different ISPs’ DNS on single a point should be possible.

Since the code on the official document is simple:

from aiohttp.resolver import AsyncResolver

resolver = AsyncResolver(nameservers=[“8.8.8.8”, “8.8.4.4”]) conn = aiohttp.TCPConnector(resolver=resolver)


I tried it with following code:

~~~python
import aiohttp
import asyncio
from aiohttp.resolver import AsyncResolver

resolver = AsyncResolver(nameservers=["114.114.114.114"])

async def dnstesting():
 async with aiohttp.ClientSession(connector=aiohttp.TCPConnector(verify_ssl=False, use_dns_cache=False, resolver=resolver)) as session:
 r = await session.get("http://google.com")
 print(r.text)

asyncio.run(dnstesting())

Run with following error:

Hello World

Tue, 01 Jan 2019 00:00:00 +0000

Hello World!

Thanks

Hugo
Git Page
hugo-theme-cleanwhite I did some changes on the theme, will share it after testing.

I spend days and finally get this Blog runs up. In the next days, will move the posts from WordPress: hanbaobao2005.WordPress.com to here.

Happy Holidays :-)

Update at Jan-26-2019:

I have been running blogs for years, started at NetEase(NetEase shut down its blog service at Nov-30-2018), then to Blogger(The blog was closed), and WordPress after Blogger was blocked within China. I setup the blog on Git Page and Hugo because I still unable to get used to the WordPress editor even I have used it for more than 2 years.

Flask, Flask-WTF, Flask-Bootstrap, Select2, jinja2 integration

Mon, 16 Apr 2018 00:00:00 +0000

I intend to acquire the Python skill on web after years’ work on data processing, so I started with Flask by the following Miguel Grinberg’s instruction: The Flask Mega, you can learn how to integrate bootstrap with your project from it.

After that, you can learn how to integrate select2 with your project by reading Flask Web开发:用Select2实现类似知乎的标签系统 as a guide.

30分钟上手Python网络爬虫

Tue, 30 Jan 2018 00:00:00 +0000

原文链接: https://hackernoon.com/30-minute-python-web-scraper-39d6d038e5da

此翻译已经获得作者许可。对原文、本文任何形式的转载、引用，必须知会作者

我想用Python和Selenium做网络爬虫有一会了，但是一直没有实施。几天之前，我决定小试一下。看起来令人望而却步，但实现代码从Unsplash抓取一些漂亮的图片却是相当容易的。

简易图片爬虫的食材

Python(3.6.3或更新的版本)
Pycharm(社区版就够了)
pip install requests Pillow selenium
geckodriver
Mozlla Firefox
互联网
30分钟(或更少）

*译者注：