I added my 25 images with watermark custom images in data/VOCdevkit/VOC2012/JPEGImages as described and trained using given command.

In the last line return (next_element, [iterator.make_initializer(x) for x in [train, val]]) this portion of the code gives above error.

def dataset_split(dataset_fn, split): # import pdb; pdb.set_trace(); records = get_records() split = int(len(records) * split) train, val = dataset_fn(records[:split]), dataset_fn(records[split:]) iterator = tf.contrib.data.Iterator.from_structure( train.output_types, train.output_shapes) # import ipdb; ipdb.set_trace(); next_element = iterator.get_next() return (next_element, [iterator.make_initializer(x) for x in [train, val]])

What could be the issue? Thanks.

Could you please add model.ckpt that you have trained to avoid personal full dataset training as well? I assume using this model with transfer learning way: get a pre-trained model, set up training on my own dataset to reach the best result

Hi, I ran a problem when trying to test your pre-trained model on my own image, and I'm a little confused by the cat-selection.png. I know that the model can work well when corresponding selection.png is provided. But I noticed that cat.png and cat-selection.png have completely different sizes. How does the model know the corresponding relationship between two images. I tried to change the size of cat-selection.png and the outcome did become worse, so I'm pretty sure that there's something I didn't notice. Can anyone answer my question?

1 watermarks.py line 12 should be tf.flags.DEFINE_string('logdir', '/log', 'Log directory') 2 you should build an directory named 'data' and put the traindata in that 3 training cost lots of time

I just found your repo and tried to use the CNN on a dataset of images, but I ran into a problem.

As described in the README I installed the dependencies with pip, downloaded the training material into the data/ folder and trained the CNN with the given command.

The part I don't understand right now is how I can use the trained CNN for my images. Hopefully you can help me with that.

i am not familiar tensorflow-python, but i'd love to try running this interesting project.

will anyone post steps to run it ( video tutorial would be extremely helpful )

what does the output.png look like when run python watermarks.py --image assets/output.png --selection assets/cat-selection.png? my output.png still has the watermark and it looks like a part of source image.

Hi, first of all thanks for project 👍

This branch includes below updates :

• Exception has been added for saver restore operation because of The passed save_path is not a valid checkpoint: tmp/model.ckpt error.

• Method docs has been added.

• .idea folders has been ignored for pyCharm.

I trained on dataset of 192 images. Train size = 192*0.8/2 = 153 and training on 39 images. I started training on google cloud with 24 GB Ram . 100 epoch completed with in 15 min but while evaluating after 100 epoch .. It is taking a lot of time. Its been 9 hours since evaluation part started after 100 epoch and its still not completed.

What can be done to speed it up? Thanks.

======================================================================`
ERROR: test_inference_voc (__main__.WatermarkTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/ubuntu/anaconda3/envs/watermark/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1323, in _do_call
    return fn(*args)
  File "/home/ubuntu/anaconda3/envs/watermark/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1302, in _run_fn
    status, run_metadata)
  File "/home/ubuntu/anaconda3/envs/watermark/lib/python3.6/site-packages/tensorflow/python/framework/errors_impl.py", line 473, in __exit__
    c_api.TF_GetCode(self.status.status))
tensorflow.python.framework.errors_impl.NotFoundError: Key conv2d_9/kernel not found in checkpoint
	 [[Node: save_1/RestoreV2_117 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2_117/tensor_names, `save_1/RestoreV2_117/shape_and_slices)]]

How to solve this error? Why is it happening? Thanks

I'm not exactly sure where to place training data, if it should be in a specific format or not. Error message: Source images are missing!

Please document these into the README.md file. Its quite stressful to try and find.

Shayna&Jared@laptopv1 MINGW64 ~/Desktop/g $ git clone https://github.com/marcbelmont/cnn-watermark-removal.git fatal: bad config line 1 in file C:/Users/Shayna&Jared/.gitconfig

Shayna&Jared@laptopv1 MINGW64 ~/Desktop/g $ man git config bash: man: command not found

Shayna&Jared@laptopv1 MINGW64 ~/Desktop/g $ git -h fatal: bad config line 1 in file C:/Users/Shayna&Jared/.gitconfig

Shayna&Jared@laptopv1 MINGW64 ~/Desktop/g $ git clone https://github.com/marcbelmont/cnn-watermark-removal.git Cloning into 'cnn-watermark-removal'... remote: Enumerating objects: 95, done. remote: Counting objects: 100% (7/7), done. remote: Compressing objects: 100% (7/7), done. Receiving objects: 100% (95/95), 1.49 MiB | 352.00 KiB/s, done.eceiving objects: 90% (86/95), 1.37 MiB | 330.00 KiB/s

Resolving deltas: 100% (41/41), done.

Shayna&Jared@laptopv1 MINGW64 ~/Desktop/g $ pip install -r requirements.txt ERROR: Could not open requirements file: [Errno 2] No such file or directory: 'requirements.txt'

Shayna&Jared@laptopv1 MINGW64 ~/Desktop/g $ ls cnn-watermark-removal/

Shayna&Jared@laptopv1 MINGW64 ~/Desktop/g $ cd cnn-watermark-removal/

Shayna&Jared@laptopv1 MINGW64 ~/Desktop/g/cnn-watermark-removal $ ls assets/ dataset.py Pipfile Pipfile.lock README.md requirements.txt tests.py watermarks.py

Shayna&Jared@laptopv1 MINGW64 ~/Desktop/g/cnn-watermark-removal $ pip install -r requirements.txt Collecting matplotlib==3.1.1 Downloading matplotlib-3.1.1.tar.gz (37.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37.8/37.8 MB 1.4 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Collecting numpy==1.16.0 Downloading numpy-1.16.0.zip (5.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.1/5.1 MB 800.7 kB/s eta 0:00:00 Preparing metadata (setup.py) ... done Collecting Pillow==4.1.0 Downloading Pillow-4.1.0.tar.gz (11.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.3/11.3 MB 688.8 kB/s eta 0:00:00 Preparing metadata (setup.py) ... done ERROR: Could not find a version that satisfies the requirement tensorflow==1.14.0 (from versions: 2.8.0rc1, 2.8.0, 2.8.1, 2.8.2, 2.8.3, 2.9.0rc0, 2.9.0rc1, 2.9.0rc2, 2.9.0, 2.9.1, 2.9.2, 2.10.0rc0, 2.10.0rc1, 2.10.0rc2, 2.10.0rc3, 2.10.0)
ERROR: No matching distribution found for tensorflow==1.14.0

Shayna&Jared@laptopv1 MINGW64 ~/Desktop/g/cnn-watermark-removal $

Bumps pygments from 2.4.2 to 2.7.4.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Bumps pillow from 6.2.0 to 8.1.1.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

I mkdir 'cifar-10-batches-py' and copy the data "data_batch_*". after that, I run the script "python watermarks.py --logdir=./save " but I got this error:

'' Traceback (most recent call last): File "watermarks.py", line 311, in tf.app.run() File "lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 40, in run _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef) File "lib/python3.6/site-packages/absl/app.py", line 303, in run _run_main(main, args) File "lib/python3.6/site-packages/absl/app.py", line 251, in _run_main sys.exit(main(argv)) File "watermarks.py", line 306, in main train(sess, globals()[FLAGS.dataset]) File "watermarks.py", line 189, in train next_image, iterator_inits = dataset_split(dataset, .8) File "cnn-watermark-removal/dataset.py", line 70, in dataset_split records = get_records() File "cnn-watermark-removal/dataset.py", line 64, in get_records convert_to_record() File "cnn-watermark-removal/dataset.py", line 181, in convert_to_record writer.close() AttributeError: 'NoneType' object has no attribute 'close'

''

1. So do you have any idea about this? Does the cifar-10-batches-py data need something mask like 'cat-selection.png'?
2. If I want to train with my own data(like flowers with watermark), so what should I prepare? Can you list them? just like (1)original img, (2)mask png (3)watermark img? like this?

thx a lot!

!python watermarks.py --image assets/cat.png --selection assets/cat-selection.png --dataset=dataset_cifar --batch_size 32

WARNING:tensorflow:From watermarks.py:298: The name tf.app.run is deprecated. Please use tf.compat.v1.app.run instead.

WARNING:tensorflow:From watermarks.py:282: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

W1109 16:02:22.012408 140498710181760 deprecation_wrapper.py:119] From watermarks.py:282: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

2020-11-09 16:02:22.025011: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2020-11-09 16:02:22.028714: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2249995000 Hz
2020-11-09 16:02:22.028934: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x32032c0 executing computations on platform Host. Devices:
2020-11-09 16:02:22.028963: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
Traceback (most recent call last):
  File "watermarks.py", line 298, in <module>
    tf.app.run()
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/platform/app.py", line 40, in run
    _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef)
  File "/usr/local/lib/python3.6/dist-packages/absl/app.py", line 300, in run
    _run_main(main, args)
  File "/usr/local/lib/python3.6/dist-packages/absl/app.py", line 251, in _run_main
    sys.exit(main(argv))
  File "watermarks.py", line 289, in main
    lambda: dataset_paths([FLAGS.selection]))
  File "watermarks.py", line 117, in inference
    next_image, iterator_init = dataset()
  File "watermarks.py", line 286, in <lambda>
    lambda: dataset_paths([FLAGS.image]),
  File "/content/cnn-watermark-removal/dataset.py", line 50, in dataset_paths
    dataset = tf.Dataset.from_tensor_slices(tf.constant(paths))
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/util/deprecation_wrapper.py", line 106, in __getattr__
    attr = getattr(self._dw_wrapped_module, name)
AttributeError: module 'tensorflow' has no attribute 'Dataset'