This is a trace what happens:

basti@n095:/home/basti/tensorflow/tensorflow-shakespeare# sh run.sh ROOT_DIR /home/basti/tensorflow/tensorflow-shakespeare CACHE_DIR /home/basti/tensorflow/tensorflow-shakespeare/cache I tensorflow/core/common_runtime/local_device.cc:40] Local device intra op parallelism threads: 8 I tensorflow/core/common_runtime/direct_session.cc:58] Direct session inter op parallelism threads: 8 Creating 2 layers of 256 units.

Created model with fresh parameters. Traceback (most recent call last): File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main "main", fname, loader, pkg_name) File "/usr/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/home/basti/tensorflow/tensorflow-shakespeare/tensorshake/translate/translate.py", line 295, in tf.app.run() File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/default/_app.py", line 30, in run sys.exit(main(sys.argv)) File "/home/basti/tensorflow/tensorflow-shakespeare/tensorshake/translate/translate.py", line 292, in main train() File "/home/basti/tensorflow/tensorflow-shakespeare/tensorshake/translate/translate.py", line 158, in train model = create_model(sess, False) File "/home/basti/tensorflow/tensorflow-shakespeare/tensorshake/translate/translate.py", line 139, in create_model session.run(tf.variables.initialize_all_variables())

Thank you so much for sharing this. It's amazing. It's not clear to me though how to structure the data for training? Can you use TMX files? What exactly do I need to be able to train my data? Would Tab-delimited files be OK? What about XLIFF?

Thanks in advance!

for aligned_data in DATA_LINKS:
    for root, dirs, filenames in os.walk(get_dir(aligned_data)):

      #you should sort filnames here, or they wouldn't match

        for filename in filenames:
            with open(os.path.join(get_dir(aligned_data), filename), 'r') as f:

Patching CVE-2007-4559

Hi, we are security researchers from the Advanced Research Center at Trellix. We have began a campaign to patch a widespread bug named CVE-2007-4559. CVE-2007-4559 is a 15 year old bug in the Python tarfile package. By using extract() or extractall() on a tarfile object without sanitizing input, a maliciously crafted .tar file could perform a directory path traversal attack. We found at least one unsantized extractall() in your codebase and are providing a patch for you via pull request. The patch essentially checks to see if all tarfile members will be extracted safely and throws an exception otherwise. We encourage you to use this patch or your own solution to secure against CVE-2007-4559. Further technical information about the vulnerability can be found in this blog.

If you have further questions you may contact us through this projects lead researcher Kasimir Schulz.

I have received the following error when trying to execute the command ./run.sh the Tensorflow version is 1.0.1 in python 2.

Traceback (most recent call last): File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main "main", fname, loader, pkg_name) File "/usr/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/home/drwael/shakespeare/tensorshake/translate/translate.py", line 35, in from tensorshake.translate import seq2seq_model File "tensorshake/translate/seq2seq_model.py", line 13, in from tensorflow.models.rnn import rnn_cell ImportError: No module named models.rnn

Fantastic project :-). Thank you for sharing your code.

Have you got a working example yet? Im having trouble replicating the results (even when using your pre-trained model). e.g.

IN: but you’re not listening to me. OUT: succeeds tempered tempered tempered tempered drum drum drum drum drum drum drum drum drum drum

Would you be able to share a working pre-trained model? (or the necessary parameters?)

Many thanks.

trideep@trideep-HP-ENVY-x360-m6-Convertible:~/Downloads/tensorflow-shakespeare-master$ ./run.sh en_train /home/trideep/Downloads/tensorflow-shakespeare-master/cache/all_modern_train.ids fr_train /home/trideep/Downloads/tensorflow-shakespeare-master/cache/all_original_train.ids en_dev /home/trideep/Downloads/tensorflow-shakespeare-master/cache/all_modern_dev.ids fr_dev /home/trideep/Downloads/tensorflow-shakespeare-master/cache/all_original_dev.ids Creating 2 layers of 256 units. en_vocab_size 10000 fr_vocab_size 10000 <function sampled_loss at 0x7f3cea7839b0> Traceback (most recent call last): File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main "main", fname, loader, pkg_name) File "/usr/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/home/trideep/Downloads/tensorflow-shakespeare-master/tensorshake/translate/translate.py", line 314, in tf.app.run() File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py", line 30, in run sys.exit(main(sys.argv)) File "/home/trideep/Downloads/tensorflow-shakespeare-master/tensorshake/translate/translate.py", line 311, in main train() File "/home/trideep/Downloads/tensorflow-shakespeare-master/tensorshake/translate/translate.py", line 165, in train model = create_model(sess, False) File "/home/trideep/Downloads/tensorflow-shakespeare-master/tensorshake/translate/translate.py", line 133, in create_model forward_only=forward_only) File "tensorshake/translate/seq2seq_model.py", line 138, in init softmax_loss_function=softmax_loss_function) TypeError: model_with_buckets() got multiple values for keyword argument 'softmax_loss_function'