Tool which allow you to detect and translate text.

Damian Panek

Last update: Nov 28, 2022

Related tags

Computer Vision nlp recognition deep-learning text craft pytorch text-recognition text-processing ocr-recognition crnn scene-text-detection scene-text-detectors

Overview

Text detection and recognition

This repository contains tool which allow to detect region with text and translate it one by one.

Description

Two pretrained neural networks are used. One of them is responsible for detecting places in which text appear and return its coordinates. Structure use for this operation is based on CRAFT architecture.

Craft Paper

Second network take detected words and recognize words included inside it. Convolutional Recurrential neural networks (CRNN) are used for this operation.

CRNN Paper

Example

Under construction

Deployment

I decided to deploy it on heroku (temporarily solution), but the amount of memory available on this platform is not enough. You can check it on heroku app. I decided to add bootstrap template because whole solution become more intuitive.

Windows Installation

To install it locally, you can run from your virtual env

python -m pip install requirements.txt

Linux installation

to install it properly on Linux OS you have to install additionaly


apt-get update
apt-get install -y libsm6 libxext6 libxrender-dev
pip install opencv-python

If problems with cv2 imports are still appearing then you should install

pip install opencv-contrib-python

Then you can run

```python
python -m pip install requirements.txt

Run

To run it locally, please activate your environment

> win
venv\Scripts\activate.bat

>linux
source venv\Scripts\activate

and run straight from project origin

python  app.py

If everything goes properly, you'll see on localhost:8000, screen just like one below.

Updates

I decided to remove argparse, because as I mention earlier, it was less intuitive. Solution is not fast, is more like an toy example which shows how to use Pytorch model on deployment environment.

Version which I use here contain torch-cpu which make preprocessing and detecting slightly slower. I test it on cuda and it was much faster.

If you have more information, drop me a line If you like it, give a star

Draft: Show how does it work on complex .tif example document.

Contact Info

Comments

failing with Could not find a version that satisfies the requirement cv2

`eliuha@machine:~/dev/lpr/pytorch-text-recognition$ python app.py --input_file test_image.jpeg /home/eliuha/anaconda3/lib/python3.6/site-packages/matplotlib/font_manager.py:279: UserWarning: Matplotlib is building the font cache using fc-list. This may take a moment. 'Matplotlib is building the font cache using fc-list. ' Traceback (most recent call last): File "app.py", line 19, in import text_reco.models.craft.craft_utils as craft_utils File "/home/eliuha/dev/lpr/pytorch-text-recognition/text_reco/models/craft/craft_utils.py", line 6, in import cv2 ModuleNotFoundError: No module named 'cv2'

opened by eliuha 4
LinkRefiner

@s3nh clovaai just released the LinkRefiner code clovaai/CRAFT-pytorch@3cd65f5 better you implement it, along with option to train . So that we can detect text-lines

opened by ghost 0
Training on custom data??

Hi, I'd like to know if this repo can be used to train CRAFT on custom data using weakly supervised learning ? I have images with a lot of text on them. All of the text has been tagged but at a sentence level, i.e., I have the bounding box information and ground truth label information but at a sentence level. Can weakly supervised learning be used in this case ?

opened by dhruvsharma717 0
CRAFT Model memory usage

Seems your code mostly inspired from: https://github.com/clovaai/CRAFT-pytorch

I was using the same repo for text detection model and saw cpu memory usage of CRAFT model. It increases after each image. Were you able to detect the same problem.

opened by p9anand 0
ValueError: tile cannot extend outside image

Hi, Thanks for this amazing work. I was using this repo for recognition task but when i run the app.py ,upload the image and click on get your results it gives ValueError: tile cannot extend outside image.

opened by mahendra047 1

Tool which allow you to detect and translate text.

Related tags

Overview

Text detection and recognition

Description

Example

Deployment

Windows Installation

Linux installation

Run

Updates

Comments

failing with Could not find a version that satisfies the requirement cv2

LinkRefiner

Training on custom data??

CRAFT Model memory usage

ValueError: tile cannot extend outside image

Owner

Damian Panek

Deskew is a command line tool for deskewing scanned text documents. It uses Hough transform to detect "text lines" in the image. As an output, you get an image rotated so that the lines are horizontal.

This is a c++ project deploying a deep scene text reading pipeline with tensorflow. It reads text from natural scene images. It uses frozen tensorflow graphs. The detector detect scene text locations. The recognizer reads word from each detected bounding box.

A tool combining EasyOCR and LaMa to automatically detect text and replace it with an inpainted background.

text detection mainly based on ctpn model in tensorflow, id card detect, connectionist text proposal network

Satoshi is a discord bot template in python using discord.py that allow you to track some live crypto prices with your own discord bot.

Detect and fix skew in images containing text

Detect text blocks and OCR poorly scanned PDFs in bulk. Python module available via pip.

Detect handwritten words in a text-line (classic image processing method).

Hiiii this is the Spanish for Linux and win 10 and in the near future the english version of PortScan my new tool on which you can see what ports are Open only with the IP adress.

This is a project to detect gestures to zoom in or out, using the real-time distance between the index finger and the thumb. It's based on OpenCV and Mediapipe.

Detect the mathematical formula from the given picture and the same formula is extracted and converted into the latex code

Turn images of tables into CSV data. Detect tables from images and run OCR on the cells.

This tool will help you convert your text to handwriting xD

Detect textlines in document images

Detect textlines in document images

This is an API written in python that uses FastAPI. It is a simple API that can detect discord tokens in Images.

Code for the paper STN-OCR: A single Neural Network for Text Detection and Text Recognition