I cannot install this package with pip, the following happens

$ sudo pip install unicode-slugify Downloading/unpacking unicode-slugify Could not find any downloads that satisfy the requirement unicode-slugify No distributions at all found for unicode-slugify Storing complete log in /home/tirithen/.pip/pip.log

And the log says:

/usr/bin/pip run on Wed Jan 25 13:58:45 2012 Downloading/unpacking unicode-slugify Getting page http://pypi.python.org/simple/unicode-slugify URLs to search for versions for unicode-slugify:

• http://pypi.python.org/simple/unicode-slugify/ Getting page http://github.com/mozilla/unicode-slugify Analyzing links from page http://pypi.python.org/simple/unicode-slugify/ Skipping link http://github.com/mozilla/unicode-slugify (from http://pypi.python.org/simple/unicode-slugify/); not a file Analyzing links from page https://github.com/mozilla/unicode-slugify Skipping link https://github.com/opensearch.xml (from https://github.com/mozilla/unicode-slugify); unknown archive format: .xml Skipping link https://github.com/fluidicon.png (from https://github.com/mozilla/unicode-slugify); unknown archive format: .png Skipping link https://a248.e.akamai.net/assets.github.com/stylesheets/bundles/github-31ce35e65492efdddc8289c3acbc0cfc685612dc.css (from https://github.com/mozilla/unicode-slugify); unknown archive format: .css Skipping link https://github.com/mozilla/unicode-slugify/tree/4431bee634b19b8f2849c62c81fffa08375abfad (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/commits/master.atom (from https://github.com/mozilla/unicode-slugify); unknown archive format: .atom Skipping link https://github.com (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/plans (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/explore (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/features (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/blog (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/login?return_to=%2Fmozilla%2Funicode-slugify (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/watchers (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/network (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/pulls (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/issues (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/graphs (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify#readme (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http:// (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/zipball/master (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify.git (from https://github.com/mozilla/unicode-slugify); unknown archive format: .git Skipping link git://github.com/mozilla/unicode-slugify.git (from https://github.com/mozilla/unicode-slugify); unknown archive format: .git Skipping link https://github.com/mozilla/unicode-slugify/dismiss-tree-finder-help (from https://github.com/mozilla/unicode-slugify); not a file Skipping link javascript:; (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/tree/master (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/commits/master (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/branches (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/tags (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/downloads (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/commit/4431bee634b19b8f2849c62c81fffa08375abfad (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/issues/2 (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/davedash (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/commits/master/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/tree/4431bee634b19b8f2849c62c81fffa08375abfad/slugify (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/commit/0303c4b824bc7ee8b692a6ccc22037daee02b207 (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/brodie (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/blob/4431bee634b19b8f2849c62c81fffa08375abfad/.gitignore (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/commit/a082e5e847bf3e7a362a5e8cf1372251defe9935 (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/blob/4431bee634b19b8f2849c62c81fffa08375abfad/LICENSE (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/blob/4431bee634b19b8f2849c62c81fffa08375abfad/MANIFEST.in (from https://github.com/mozilla/unicode-slugify); unknown archive format: .in Skipping link https://github.com/mozilla/unicode-slugify/commit/f0fada39c86e61ad82b83604ba25d4fc16ee3f84 (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/mozilla/unicode-slugify/blob/4431bee634b19b8f2849c62c81fffa08375abfad/README.md (from https://github.com/mozilla/unicode-slugify); unknown archive format: .md Skipping link https://github.com/mozilla/unicode-slugify/blob/4431bee634b19b8f2849c62c81fffa08375abfad/requirements.txt (from https://github.com/mozilla/unicode-slugify); unknown archive format: .txt Skipping link https://github.com/mozilla/unicode-slugify/blob/4431bee634b19b8f2849c62c81fffa08375abfad/setup.py (from https://github.com/mozilla/unicode-slugify); unknown archive format: .py Skipping link https://github.com/mozilla/unicode-slugify/commit/5b2f6dd8c3e6bfa61cd2843c3f90962e38fc9b0d (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/about (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/contact (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/training (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://enterprise.github.com/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://status.github.com/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://get.gaug.es/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://speakerdeck.com (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://gist.github.com (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://mac.github.com/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://mobile.github.com/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://jobs.github.com/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://shop.github.com/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://octodex.github.com/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://help.github.com/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://developer.github.com/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://github.github.com/github-flavored-markdown/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://pages.github.com/ (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/site/terms (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/site/privacy (from https://github.com/mozilla/unicode-slugify); not a file Skipping link https://github.com/security (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://www.rackspace.com (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://www.rackspace.com%20 (from https://github.com/mozilla/unicode-slugify); not a file Skipping link http://www.rackspacecloud.com (from https://github.com/mozilla/unicode-slugify); not a file Could not find any downloads that satisfy the requirement unicode-slugify No distributions at all found for unicode-slugify Exception information: Traceback (most recent call last): File "/usr/lib/pymodules/python2.7/pip/basecommand.py", line 130, in main self.run(options, args) File "/usr/lib/pymodules/python2.7/pip/commands/install.py", line 223, in run requirement_set.prepare_files(finder, force_root_egg_info=self.bundle, bundle=self.bundle) File "/usr/lib/pymodules/python2.7/pip/req.py", line 911, in prepare_files url = finder.find_requirement(req_to_install, upgrade=self.upgrade) File "/usr/lib/pymodules/python2.7/pip/index.py", line 154, in find_requirement raise DistributionNotFound('No distributions at all found for %s' % req) DistributionNotFound: No distributions at all found for unicode-slugify

Calling: slugify.slufigy("Ставки земельного налога в городах Свердловской области в 2014 году")

generates this slug: stavki-zemel'nogo-naloga-v-gorodakh-sverdlovskoi-oblasti-v-2014-godu

The single quote char was unexpected. Is there a way to force the slugs to only contain alphanumeric or hyphen characters, even when using a foreign language?

  Downloading unicode-slugify-0.1.3.tar.gz
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 20, in <module>
      File "/tmp/pip-build-s4ot22tg/unicode-slugify/setup.py", line 7, in <module>
        long_description=open('README.md').read(),
      File "/var/cache/drone/src/github.com/dz0ny/app/.tox/py34/lib/python3.4/encodings/ascii.py", line 26, in decode
        return codecs.ascii_decode(input, self.errors)[0]
    UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 361: ordinal not in range(128)

Fixes #24

unidecode package no longer supports python 2.6.

A side effect of this is being able to do io.open('README.md', encoding='utf-8').read() in the setup.py file

Mentioned in my first merge request, smart_boolean enables to replace common latin letters with their ascii representations.

Example:

from slugify import slugify
>>> slugify(u'Bakıcı geldi')
u'bak\u0131c\u0131-geldi'
>>> slugify(u'Bakıcı geldi', smart_replace=True)
u'bakici-geldi'

So that people who does not have 'ı' letter in their keyboards will be able to match the string by using either 'ı' or 'i' from their keyboards.

For current version, 'bakici' cannot match 'bakıcı'. But with smart_replace, 'bakıcı' and 'bakici' can both match 'bakıcı' because 'bakici' may represent 'bakıcı' within an English keyboard.

List of common latin letters to replace

• ı, ì, í, î, ï -> i -İ, Ì, Í, Î, Ï -> I
• ö, ó, ò, ô, õ, ø -> o
• Ö, Ò, Ó, Ô, Õ, Ø -> O
• ü, ù, ú, û -> u
• Ü, Ù, Ú, Û -> U
• à, á, â, ã, ä, å -> a
• À, Á, Â, Ã, Ä, Å -> A
• æ -> ae
• Æ -> AE
• è, é, ê, ë -> e
• È, É, Ê, Ë -> E
• ñ -> n
• Ñ -> N
• ý, ÿ -> y
• Ý, Ÿ -> Y
• ş -> s
• Ş -> S
• ç -> c
• Ç -> C
• ğ -> g
• Ğ -> G

The readme file shows this example:

# Replace non ascii chars with their "best" representation
slugify(u'北京 (capital of China)', only_ascii=True)
# u'bei-jing-capital-of-china'

but when running it locally, the result is different:

In [1]: from slugify import slugify                                                                                                                                                           

In [2]: slugify('北京 (capital of China)', only_ascii=True)                                                                                                                                   
Out[2]: 'Bei Jing -capital-of-china'

I'm using v0.1.3 and Python 3.6.8

Because unidecode can add Caps and/or spaces, it must be called before space striping and lowering. e.g:

slugify(u'北京 (China)', only_ascii=True)
# before this correction:
'Bei Jing -china'
# with this correction:
'bei-jing-china'

If you would like to include unidecoded within this slugifier, I also created this request. It's up to you to pick one. This covers more than latin letters: https://pypi.python.org/pypi/Unidecode

Related to @davedash 's tweet: https://twitter.com/davedash/status/554723084918607872

Based on #18

• Corrects it to be compatible with those python versions : 2.6, 2.7, 3.2, 3.3, 3.4.
• Adds tox.ini file to be able to use automated tests via tox with those python versions.
• Adds .travis.yml file to be able to use automated tests via travis with those python versions.

I thought others might encounter the same problem as I did, so I'll share my solution and possibly get some feedback if there is a better way to do it.

Problem: If you use slugs generated by unicode-slugify with Django's SlugField, you will be prevented from saving a form with a SlugField (e.g. in the Django Admin) if the field value is invalid by Django's slug standard.

Solution: Replace SlugField with a new UnicodeSlugField which inherits everything from SlugField except that pesky validation. Add a new validator using unicode-slugify.

This package is awesome -- except for the fact that it pulls in Django just to handle unicode well. If there's a way to avoid this, we probably should.

I have recived a UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 361: ordinal not in range(128) error when installing using pip and Python 3.6.8. there is the trace:

ERROR: Command errored out with exit status 1:
 command: /home/devikhxr/virtualenv/public_comohay.com/3.6/bin/python3.6_bin -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-68hcpkqo/unicode-slugify/setup.py'"'"'; __file__='"'"'/tmp/pip-install-68hcpkqo/unicode-slugify/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-2f7x6_ul
     cwd: /tmp/pip-install-68hcpkqo/unicode-slugify/
Complete output (7 lines):
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/tmp/pip-install-68hcpkqo/unicode-slugify/setup.py", line 7, in <module>
    long_description=open('README.md').read(),
  File "/home/devikhxr/virtualenv/public_comohay.com/3.6/lib64/python3.6/encodings/ascii.py", line 26, in decode
    return codecs.ascii_decode(input, self.errors)[0]
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 361: ordinal not in range(128)
----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

Deprecation warning due to invalid escape sequences. Using raw strings or escaping them again helps in resolving this. Check https://github.com/asottile/pyupgrade/ for automatic fix of this.

find . -iname '*.py' | grep -Ev 'rdf4|doc|benchmark|tool' | xargs -P4 -I{} python3.8 -Wall -m py_compile {}
./slugify/__init__.py:84: DeprecationWarning: invalid escape sequence \s
  new = re.sub('[%s\s]+' % space_replacement, space_replacement, new)

FYI: The following changes were made to this repository's wiki:

• defacing spam has been removed

• the wiki has been disabled, as it was not used

These were made as the result of a recent automated defacement of publically writeable wikis.

Add badges to pypi, the code of conduct and the ci results in the readme.

Examples:

• https://github.com/Kinto/kinto/blob/master/README.rst
• https://github.com/Kinto/kinto.js/blob/master/README.md

Both this project and python-slugify (which logzero uses as a dependency) have the root module as slugify which I'm guessing a lot of users have experienced. I like this package, but I think it'd help to rename the root folder something like UnicodeSlugify or unicodeslugify.

Just a thought...