Hello, I'm used your code for generating OCR dataset in many case. Thanks for your efforts really :D

But, I want to make vertical text image..

https://github.com/ankush-me/SynthText/blob/master/text_utils.py#L165 this section would decide "text mask" rendering.. but It's hard to make vertical text data. At present, only horizontal characters are made.

on this line : https://github.com/ankush-me/SynthText/blob/master/text_utils.py#L219

original code :

newrect = font.get_rect(ch)
newrect.y = last_rect.y
if i > mid_idx:
newrect.topleft = (last_rect.topright[0]+2, newrect.topleft[1])
            else:
                newrect.topright = (last_rect.topleft[0]-2, newrect.topleft[1])
            newrect.centery = max(newrect.height, min(fsize[1] - newrect.height, newrect.centery + curve[i]))
            try:
                bbrect = font.render_to(surf, newrect, ch, rotation=rots[i])
            except ValueError:
                bbrect = font.render_to(surf, newrect, ch)
            bbrect.x = newrect.x + bbrect.x
            bbrect.y = newrect.y - bbrect.y
            bbs.append(np.array(bbrect))
            last_rect = newrect

my code :

newrect = font.get_rect(ch)
            # newrect.y = last_rect.y
            newrect.x = last_rect.x
            if i > mid_idx:
                # print(ch, " <- right")
                # newrect.topleft = (last_rect.topright[0] + 2, newrect.topleft[1])
                # newrect.topleft = (last_rect.topright[0], newrect.topleft[1] + 2)
                # newrect.topleft = (newrect.topright[0], last_rect.topleft[1] + 2)
                # newrect.topright = (newrect.bottomright[0], last_rect.bottomright[1] + 3)
                newrect.topleft = (newrect.bottomleft[0], last_rect.bottomleft[1] + 2)
            else:
                # print(ch, " <- left")
                # newrect.topright = (last_rect.topleft[0] - 2, newrect.topleft[1])
                # newrect.topright = (last_rect.topleft[0], newrect.topleft[1] - 2)
                # newrect.topright = (newrect.topright[0], last_rect.topleft[1] - 2)
                newrect.bottomright = (newrect.topright[0], last_rect.topright[1] - 2)
            newrect.centery = max(newrect.height, min(fsize[1] - newrect.height, newrect.centery + curve[i]))
            # newrect.centerx = max(newrect.width, min(fsize[0] - newrect.width, newrect.centerx + curve[i]))
            try:
                bbrect = font.render_to(surf, newrect, ch, rotation=rots[i])
            except ValueError:
                print("render error, without rotation..")
                bbrect = font.render_to(surf, newrect, ch)
            bbrect.x = newrect.x + bbrect.x
            bbrect.y = newrect.y - bbrect.y
            bbs.append(np.array(bbrect))
            last_rect = newrect

sample result :

sample result with annotation :

The possibilities are there, but they are not perfect. I really need your help..

Thanks.

Text on generated images appears to be cut. I just cloned the repo, switched to branch python3, ran gen.py, and added a cv2.imwrite() inside visualize_results.py to save the generate images as an image. I am getting images like this

Someone please help

when i use the python gen.py --viz in the command

it generates ~/SynthText-master$ python gen.py --viz Traceback (most recent call last): File "gen.py", line 19, in from synthgen import * File "/home/ubuntu/SynthText-master/synthgen.py", line 20, in import text_utils as tu File "/home/ubuntu/SynthText-master/text_utils.py", line 12, in from pygame import freetype ImportError: cannot import name freetype

waht is the wrong ?

Hello! I am trying to create a new dataset using a different set of texts/words and was able to generate the image containing the new texts. However, I want to crop the individual texts using the code mentioned here: https://github.com/ankush-me/SynthText/issues/174 but it appears that it needs a "gt.mat" file. I tried to do this by adding a line of code within the visualize_results.py

viz_textbb(rgb, [charBB], wordBB)
print ("     image name   : ", colorize(Color.RED, k, bold=True))
print ("  ** no. of chars : ", colorize(Color.YELLOW, charBB.shape[-1]))
print ("  ** no. of words : ", colorize(Color.YELLOW, wordBB.shape[-1]))
print ("  ** text         : ", colorize(Color.GREEN, txt))
gt_file = {"imnames": k, "wordBB": wordBB, "charBB": charBB, "txt": txt} ## added this

then eventually saving gt_file as a gt.mat file using scipy.io. However whenever i use this gt.mat to the code mentioned above to crop word patches, i get an error:

Traceback (most recent call last):
  File "crop.py", line 146, in <module>
    do_work(opts,synth_dat)
  File "crop.py", line 104, in do_work
    np.random.shuffle(i_range)
  File "mtrand.pyx", line 4529, in numpy.random.mtrand.RandomState.shuffle
  File "mtrand.pyx", line 4532, in numpy.random.mtrand.RandomState.shuffle
TypeError: 'range' object does not support item assignment

I feel like the error is coming from my generated gt.mat because of its format. Would just like to ask how to properly create a gt.mat file that can be used as an input to the cropping code?

Thank you very much and thank you btw for this wonderful project. I've been learning it for weeks and love it so much!

After you create your own pictures with text, How to represent the ground truth of the text on these pictures？What is your method? Is this form (x,y,w,h)？And Is the expression the same for the tilted text?

@ankush-me Hi, where are the 5 images (hiking, indian+musicians, sandwich, sea, village) that Synthtext script uses saved, from where the script load this images? Is there some file or? Ty

My tensorflow is 1.2 and python is 3.5 .I run your code and get this error: Traceback (most recent call last): File "gen.py", line 140, in main(args.viz) File "gen.py", line 95, in main RV3 = RendererV3(DATA_PATH,max_time=SECS_PER_IMG) File "/home/tian/tensorflow/example/SynthText/synthgen.py", line 368, in init self.text_renderer = tu.RenderFont(data_dir) File "/home/tian/tensorflow/example/SynthText/text_utils.py", line 108, in init self.font_state = FontState(data_dir) File "/home/tian/tensorflow/example/SynthText/text_utils.py", line 421, in init self.char_freq = cp.load(f) TypeError: a bytes-like object is required, not 'str'

Can you tell me how to solve it ?

Hi all and @ankush-me ,

can someone help me, I don't understand how to add my own font into script? I found in code fontlist.txt text source - a file that is used as text source. So there I put my .ttf fonts that I downloaded from here: https://www.1001fonts.com/text-fonts.html?page=1&fbclid=IwAR395plHPNmZemLoKmvpedbqRv0z8pUVU66np7LLWzia14GrAKWcZB1H5o4 and then terminal shows me and error :

'Fabiolo' is the name of font

When I use the upper one (fontlist1.txt - mine) there shows an error. When I use the bottom one (fontlist.txt - originally from SynthText script) that works fine everytime.

Here you can see how I add paths and names into fontlist1.txt I also add the font names like 'Fabiolo', 'Halida Sans', ... into Font Manager but still nothing, shows the same errors.

In synthgen.py filter() method.

@staticmethod
def filter(seg,area,label):
    """
    Apply the filter.
    The final list is ranked by area.
    """
    good = label[area > TextRegions.minArea]
    area = area[area > TextRegions.minArea]
    filt,R = [],[]
    for idx,i in enumerate(good):
        mask = seg==i
        xs,ys = np.where(mask)

        coords = np.c_[xs,ys].astype('float32')
        rect = cv2.minAreaRect(coords)          
        box = np.array(cv2.cv.BoxPoints(rect))
        h,w,rot = TextRegions.get_hw(box,return_rot=True)

        f = (h > TextRegions.minHeight 
            and w > TextRegions.minWidth
            and TextRegions.minAspect < w/h < TextRegions.maxAspect
            and area[idx]/w*h > TextRegions.pArea)
        filt.append(f)
        R.append(rot)

` when it used cv2.minAreaRect(coords) , I think the coordinates should be the form of (index in width, index in height). But coords is get by using np.where(mask), so the coords actually is (index in height, index in width). So is this a bug ? And I just find the box four points can't encase the segment correctly? Or is it just ok or my understanding wrong ?

The index of '67/fruits_129_18.jpg' in the entire dataset is 82567. There are only 3 words in the image but the corresponding wordBB has shape (2,4,16), charBB has shape (2,4,56).

The md5 value has been checked which confirms the download is right.

hello,please help me,I was so trouble in the run demo. I am running python gen.py --viz I get ./result/SynthText.h5 But I cannot get the SynthText-image result. How to get the SynthText-image result? like this

I just downloaded this code and run the sample without any problems, however in the visualization popup window I get the following:

I just run the command python gen.py --viz I'm trying to see if it is just a visualization error but I can't find any information on the annotation labels under ./results/SynthText.h5, only the resulting image itself.

For example:

Hi @ankush-me , I have this error and don't know what is incorrect? Is the AssertError important?

And can you explain what is this text placement parameters:

self.f_shrink = 0.90
self.max_shrink_trials = 5 # 0.9^5 ~= 0.6
self.p_flat = 0.10

because when I change it, nothing is changed with text on image

Hi all and @ankush-me ,

while generating images I can save images with rendered text in folder but how can I save text masks in some other folder in .png, .jpg or some image format, not binary?

Hello @ankush-me,

In poisson_reconstruct.py is the:

IM_TOP -> text instance
IM_BACK -> background image

There says:

combine images using poission editing.
IM_TOP and IM_BACK should be of the same size.

But what images script combines?

Also in the poisson_reconstruct.py what is these gxs,gys,gxd,gyd? This is X and Y coordinates of something?

[gxs,gys] = get_grads(ims)
[gxd,gyd] = get_grads(imd)

Is the alpha blend done here?

elif mode=='blend': # from recursive call:
           # just do an alpha blend
           gx = gxs+gxd
           gy = gys+gyd

When I replace 'blend' instead 'max' in functionblit_images(), nothing happens?