While working with words_alpha.txt in Python 3.6, I have faced slow loading and slow searching. I think there should be JSON formatted dictionary for better searching performance of all words.

The word list was originally used in a proof-of-concept auto-completion mini-project: https://github.com/nelsonic/ac but it's since been used by quite a few people. Please give examples of how you are using the list in your project(s) so we can add them as suggestions in the readme. thanks!

I created some scripts to make things easier. Just run bash scripts/create.sh and the words added to words.txt will be sorted, words_alpha.txt will be updated, words_dictionary.json is updated, and all the .zip files are updated. This makes life a lot easier, I think. I also added dino to the words to fix #37.

Subject says it all. Several compound words are found, but not "price" itself

New to GitHub, not sure how to contribute yet. Filing an issue to track it.

% grep price words.txt Caprice caprices counter-price cut-price half-price Haltemprice high-priced low-priced miniprice miniprices misprice one-price outprice outpriced outprices overprice overpriced overprices popular-priced preprice prepriced priceable priceably price-cut price-cutter price-cutting priced price-deciding price-enhancing pricefixing price-fixing pricey priceite priceless pricelessly pricelessness price-lowering pricemaker pricer price-raising price-reducing pricers price-ruling prices price-stabilizing reprice repriced reprices underprice underpriced underprices uneven-priced unpriceably unpriced well-priced

The word "cryptocurrency" exists in the English language (according to Merriam Webster dictionary) and is not in words_alpha.txt. This word should be added as it is a common word now.

Is there any reason why the content of words_dictionary.json isn't a JSON array ?

For e.g instead of it being { "aalii": 1, "aaliis": 1, "aals": 1 } it could be ["aalii", "aaliis", "aals"]

I did not review the entire file but found a bunch of words like avestruz and mudar (Portuguese words), biznagas (Spanish word) and bizzarro (Italian word) in the words_alpha.txt file. I don't think these exist in the English language so what gives? I'm sure there's more of them...

I have copied read_english_dictionary.py and words_alpha.txt. When I run the code it just returns 'false' If I add print(english_words) it prints what looks like the file contents, but not a recognisable list of English words Am I missing something here? Mick

changed the example load_words function to return immediately. and instead of just checking against 'fate' allow end user to just do an input check in a loop until they interrupt the script.

At present there are 20 open Pull Requests: https://github.com/dwyl/english-words/pulls

This is both a great and a really bad sign. 🎉 😕

On the positive side it's awesome that people want to contribute to the project [not just take the words and give nothing back...] and continually renews my faith in Open Source! 😍

But the down-side of having so many PRs open is that the efforts of several people are wasted ... 😞 ewe need to do a much better job of communicating how to contribute.

https://github.com/dwyl/english-words/pull/130 is an example of one that clearly took some effort and will add value to people! 👌 So we need to make every effort to ensure that the effort was not wasted! ⏳

Note: this is priority-3 ("nice to have") because while we definitely want to maintain and improve this repo, we have extremely limited time. And since we are not currently using it in our App ... we cannot justify the time allocation/investment right now. That's why I've "ignored" the open PRs. 🙄 Only features that relate to the App are given higher priority. It's possible that we could use English Words in the App e.g. for auto-completion/suggestion. In which case the priority of updating/maintaining this repo/project would be raised.

Todo

• [ ] Review the PR: 👀

  • [ ] Assign it to yourself and add the label: in-review 👨‍🏫
  • [ ] View the code/words updates and leave comments 💬
  • [ ] If you feel it's immediately mergeable, approve it and assign it to me. 🙏
  • [ ] If it's not mergable, please leave a comment for the author (including an apology for the delay and link to this issue) 🔗

• [ ] Criteria that qualifies for merging:

  • [ ] Minor code change where CI passes. ✅ e.g: https://github.com/dwyl/english-words/pull/153
  • [ ] Word change that references an issue where it was previously discussed. ✅

• [ ] Instantly reject PRs that update Zip files and explain that Zip files files are commonly used for viruses so we cannot afford to trust anyone with updating them. "It's not you, it's me/us" we "Trust No One" https://en.wikipedia.org/wiki/Trust_no_one_(Internet_security)

@LuchoTurtle you mentioned this repo to me verbally in our catch up yesterday. If you want to make a stab at reviewing the open PRs in a Pomodoro Break, go for it! Please just leave a comment on this issue first and link to the PR you're picking off.

Just Want a List of Words? ❓

If you only care about the list of words in this repo, 📝 that's great; use them and have an awesome day! 🎉

Want More? 🚀

For the minuscule minority of people who want more, this issue is for you! 🙌

Brief History / Context

A few years ago I needed a list of English Words for a work project. 👨‍💻 Went searching and didn't find a ready-made list of English Words ... 🔍 🤷‍♂️

But found this StackOverflow Question and Answer: https://stackoverflow.com/questions/2213607/how-to-get-english-language-word-database

Extracted the words from the Excel file that was on InfoChimps (now 404) and dumped them in a .txt file. Put it on GitHub and linked to it in a comment on SO and didn't give it anymore thought. 👌

Sadly, the work project that used the words was closed source for a company that got acquired and the App was shut down. 😢 The folly of working on closed source things is that you often have nothing to show for your years of your life! 💭

Meanwhile many thousands of people have downloaded the word list and the repo has 8.3k ⭐ 🤯

The mini [Open Source] demo project I created: nelsonic/autocomplete ➡️ wordsy.herokuapp.com ...

will soon be taken offline by Heroku's Bean-counters 🙄

I outlined what I wanted to do in autocomplete#tasks but it's very incomplete ... so this issue will give a muuuuch better roadmap of what we're doing. 🤞

What challenge are we solving? 🤔

The original purpose of this repo will 100% be maintained. ✅ What we are doing is enhancing the repo with a showcase App that allows people to:

With that in mind, this is the plan:

1. High quality list of English words in an easy to extract file/format e.g. .txt, .json and .zip
2. Instructions for how to use the words in various programming languages; code examples.

• [ ] JavaScript/TypeScript
• [ ] Python
• [ ] Elixir
• [ ] Dart
• [ ] Rust
• [ ] Invite contributions from the community for code examples from more programming languages [but NOT frameworks] Make it clear that we really don't want a React sample because we don't want to encourage anyone to use it.

3. Clarity on the Process for updating the words list both adding, correcting and removing [invalid] words.
4. Automate the creation of the .zip file so that we don't have people attempting to submit Pull Requests with Zip Files.

We're never going to accept a PR with a zip file. It's an easy attack vector for a malicious auto-executable. Read more: https://github.com/snyk/zip-slip-vulnerability It's not that we don't "trust" people ... but we know that not everyone on GitHub has good intentions. Crime pays otherwise there wouldn't be any crims ... And cyber-crime pays big BTCs! So let's just avoid it. 👌

5. Allow anyone to lookup words with auto-completion and to make suggestions via Web App/UI. That will invite way more people including non-technical people who don't know how to use GitHub to help maintain+improve the list of words.

Todo

• [ ] Review the existing/open PRs and try to merge them: https://github.com/dwyl/english-words/issues/155
• [ ] Create Phoenix App 🆕 ... Note: waiting for Phoenix v1.7 to do this to minimise time wasted with updates ... ⏳
• [ ] Re-create basic features from nelsonic/autocomplete:
  • [ ] Use PostgreSQL for simplicity.
  • [ ] If we notice too much query latency, we can switch to SQLite or ETS for speed:
• [ ] Load the current English Words List into the DB
• [ ] Determine/decide what other metadata we want to store for each word. 💭
• [ ] Discuss any other features we want to have. (please comment!) 💬