Paranoid text spacing in Python

Vinta Chen

Last update: Nov 19, 2022

Related tags

Overview

pangu.py

https://img.shields.io/pypi/v/pangu.svg?style=flat-square

https://img.shields.io/pypi/pyversions/pangu.svg?style=flat-square

https://img.shields.io/badge/made%20with-%e2%9d%a4-ff69b4.svg?style=flat-square

Paranoid text spacing for good readability, to automatically insert whitespace between CJK (Chinese, Japanese, Korean) and half-width characters (alphabetical letters, numerical digits and symbols).

pangu.go (Go)
pangu.java (Java)
pangu.js (JavaScript)
pangu.py (Python)
pangu.space (Web API)

Installation

$ pip install -U pangu

Usage

In Python

import pangu

new_text = pangu.spacing_text('當你凝視著bug，bug也凝視著你')
# new_text = '當你凝視著 bug，bug 也凝視著你'

nwe_content = pangu.spacing_file('path/to/file.txt')
# nwe_content = '與 PM 戰鬥的人，應當小心自己不要成為 PM'

In CLI

$ pangu "請使用uname -m指令來檢查你的Linux作業系統是32位元或是[敏感词已被屏蔽]位元"
請使用 uname -m 指令來檢查你的 Linux 作業系統是 32 位元或是 [敏感词已被屏蔽] 位元

$ python -m pangu "為什麼小明有問題都不Google？因為他有Bing"
為什麼小明有問題都不 Google？因為他有 Bing

$ echo "未來的某一天，Gmail配備的AI可能會得出一個結論：想要消滅垃圾郵件最好的辦法就是消滅人類" >> path/to/file.txt
$ pangu -f path/to/file.txt >> pangu_file.txt
$ cat pangu_file.txt
未來的某一天，Gmail 配備的 AI 可能會得出一個結論：想要消滅垃圾郵件最好的辦法就是消滅人類

$ echo "心裡想的是Microservice，手裡做的是Distributed Monolith" | pangu
心裡想的是 Microservice，手裡做的是 Distributed Monolith

$ echo "你從什麼時候開始產生了我沒使用Monkey Patch的錯覺?" | python -m pangu
你從什麼時候開始產生了我沒使用 Monkey Patch 的錯覺？

Simple python program to auto credit your code, text, book, whatever!

Credit Simple python program to auto credit your code, text, book, whatever! Setup First change credit_text to whatever text you would like to credit

1 Jan 29, 2022

Parse Any Text With Python

ParseAnyText A small package to parse strings. What is the work of it? Well It's a module to creates parser that helps to parse a text easily with les

1 Jan 11, 2022

Adventura is an open source Python Text Adventure Engine

Adventura Adventura is an open source Python Text Adventure Engine, Not yet uplo

5 Oct 2, 2022

Skype export archive to text converter for python

Skype export archive to text converter This software utility extracts chat logs

2 Jun 30, 2022

Deasciify-highlighted - A Python script for deasciifying text to Turkish and copying clipboard

deasciify-highlighted is a Python script for deasciifying text to Turkish and copying clipboard.

3 Mar 18, 2022

A python Tk GUI that creates, writes text and attaches images into a custom spreadsheet file

13 Dec 9, 2022

A working (ish) python script to convert text to a gradient.

verticle-horiontal-gradient-script A working (ish) python script to convert text to a gradient. This script is poorly made with the well known python

1 Feb 20, 2022

Fixes mojibake and other glitches in Unicode text, after the fact.

ftfy: fixes text for you print(fix_encoding("(à¸‡'âŒ£')à¸‡")) (ง'⌣')ง Full documentation: https://ftfy.readthedocs.org Testimonials “My life is li

3.4k Jan 8, 2023

Markup is an online annotation tool that can be used to transform unstructured documents into structured formats for NLP and ML tasks, such as named-entity recognition. Markup learns as you annotate in order to predict and suggest complex annotations. Markup also provides integrated access to existing and custom ontologies, enabling the prediction and suggestion of ontology mappings based on the text you're annotating.

Markup is an online annotation tool that can be used to transform unstructured documents into structured formats for NLP and ML tasks, such as named-entity recognition. Markup learns as you annotate in order to predict and suggest complex annotations. Markup also provides integrated access to existing and custom ontologies, enabling the prediction and suggestion of ontology mappings based on the text you're annotating.

146 Dec 18, 2022

Comments

关于 Markdown 语法中行内代码的处理

如题，现在很多文章都将Markdown 中行内代码“ ` ”语法作为强调句等功能使用，不仅限于代码，因此行内代码块中第一个字符是中文的情况也不算少见。在这种情况下 pangu 也会自动添加空格，如下：

原文：这是行内代码的例子。 pangu 生成的格式：这是 行内代码 的例子。

个人觉得不太妥，请问这种情况下是否应该出现空格？

opened by miranquil 4
Cleanup codebase.
This pull request consists of the following changes:

.gitignore is updated.

pangu command is now generated by setuptools using entry_points and thus bin/pangu is removed.

pangu.PanguCLI is replaced by pangu.main.

Use of eval() in setup.py is removed.

eval() can be used to manipulate program behaviour. For a runtime safe version, see: ast.literal_eval.

publish and wheel commands are moved into Makefile.

setup.py commands should inherit from distutils.core.Command and be registered using entry_points or cmdclass.

Preferably, packages can be published by Travis CI.

README.rst is updated to reflect the May PyPI URL change.
opened by futursolo 3
requirements.txt 中包含額外的依賴

pangu.py 本身應該是不需要 six 或是 requests 的，可否將這兩項從 requirements.txt 中移除，或是轉移至 setuptools.setup(extras_require={"dev": ["six", "requests"]})？

opened by futursolo 2
support greek letters

Support Greek letters used in mathematics, science, and engineering [Α-Ωα-ω] reference: https://en.wikipedia.org/wiki/Greek_letters_used_in_mathematics,_science,_and_engineering

opened by jxlwqq 1