Recurrent Neural Network Tutorial, Part 2 - Implementing a RNN in Python and Theano

Denny Britz

Last update: Dec 15, 2022

Related tags

Deep Learning rnn-tutorial-rnnlm

Overview

Please read the blog post that goes with this code!

Jupyter Notebook Setup

System Requirements:

Python, pip
(Optional) virtualenv

To start the Jupyter Notebook:

# Clone the repo
git clone https://github.com/dennybritz/rnn-tutorial-rnnlm
cd rnn-tutorial-rnnlm

# Create a new virtual environment (optional, but recommended)
virtualenv venv
source venv/bin/activate

# Install requirements
pip install -r requirements.txt
# Start the notebook server
jupyter notebook

Setting up a CUDA-enabled GPU instance on EC2:

# Install build tools
sudo apt-get update
sudo apt-get install -y build-essential git python-pip libfreetype6-dev libxft-dev libncurses-dev libopenblas-dev  gfortran python-matplotlib libblas-dev liblapack-dev libatlas-base-dev python-dev python-pydot linux-headers-generic linux-image-extra-virtual
sudo pip install -U pip

# Install CUDA 7
wget http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1410/x86_64/cuda-repo-ubuntu1410_7.0-28_amd64.deb
sudo dpkg -i cuda-repo-ubuntu1410_7.0-28_amd64.deb
sudo apt-get update
sudo apt-get install -y cuda
sudo reboot

# Clone the repo and install requirements
git clone [email protected]:dennybritz/nn-theano.git
cd nn-theano
sudo pip install -r requirements.txt

# Set Environment variables
export CUDA_ROOT=/usr/local/cuda-7.0
export PATH=$PATH:$CUDA_ROOT/bin
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$CUDA_ROOT/lib64
export THEANO_FLAGS=mode=FAST_RUN,device=gpu,floatX=float32
# For profiling only
export CUDA_LAUNCH_BLOCKING=1

# Startup jupyter noteboook
jupyter notebook

To start a public notebook server that is accessible over the network you can follow the official instructions.

Comments

ValueError: dimension mismatch in args to gemv (50,50)x(80)->(50)

Hi Denny!

I mentioned in your tutorial about RNNs that I'm facing an error, similar to Edwin's. I actually had exactly the one he's facing, but I already fixed it. It was related to my GPU, which wasn't being correctly enabled.

Now, everything seems to be working fine, I also tested some Theano snippets to see if everything was working ok. However, when I try to execute the sampling code, I'm having the following error (I'll highlight the important parts after it, so you don't have to look directly at this Cthulhu):

Traceback (most recent call last):
  File "RNNLM.py", line 345, in <module>
    sent = generate_sentence(model)
  File "RNNLM.py", line 328, in generate_sentence
    next_word_probs = model.forward_propagation(new_sentence)
  File "rnn-tutorial-rnnlm/venv/local/lib/python2.7/site-packages/theano/compile/function_module.py", line 606, in __call__
    storage_map=self.fn.storage_map)
  File "rnn-tutorial-rnnlm/venv/local/lib/python2.7/site-packages/theano/compile/function_module.py", line 595, in __call__
    outputs = self.fn()
  File "rnn-tutorial-rnnlm/venv/local/lib/python2.7/site-packages/theano/scan_module/scan_op.py", line 672, in rval
    r = p(n, [x[0] for x in i], o)
  File "rnn-tutorial-rnnlm/venv/local/lib/python2.7/site-packages/theano/scan_module/scan_op.py", line 661, in <lambda>
    self, node)
  File "scan_perform.pyx", line 356, in theano.scan_module.scan_perform.perform (/root/.theano/compiledir_Linux-3.13--generic-x86_64-with-Ubuntu-14.04-trusty-x86_64-2.7.6-64/scan_perform/mod.cpp:3605)
  File "scan_perform.pyx", line 350, in theano.scan_module.scan_perform.perform (/root/.theano/compiledir_Linux-3.13--generic-x86_64-with-Ubuntu-14.04-trusty-x86_64-2.7.6-64/scan_perform/mod.cpp:3537)

ValueError: dimension mismatch in args to gemv (50,50)x(80)->(50)
Apply node that caused the error: GpuGemv{no_inplace}(GpuSubtensor{::, int32}.0, TensorConstant{1.0}, W_copy[cuda], <CudaNdarrayType(float32, vector)>, TensorConstant{1.0})
Inputs types: [CudaNdarrayType(float32, vector), TensorType(float32, scalar), CudaNdarrayType(float32, matrix), CudaNdarrayType(float32, vector), TensorType(float32, scalar)]

HINT: Use another linker then the c linker to have the inputs shapes and strides printed.
HINT: Re-running with most Theano optimization disabled could give you a back-trace of when this node was created. This can be done with by setting the Theano flag 'optimizer=fast_compile'. If that does not work, Theano optimizations can be disabled with 'optimizer=None'.
HINT: Use the Theano flag 'exception_verbosity=high' for a debugprint and storage map footprint of this apply node.
Apply node that caused the error: forall_inplace,gpu,scan_fn}(Shape_i{0}.0, Subtensor{int64:int64:int8}.0, GpuAlloc{memset_0=True}.0, Shape_i{0}.0, V, U, W)
Inputs types: [TensorType(int64, scalar), TensorType(int32, vector), CudaNdarrayType(float32, matrix), TensorType(int64, scalar), CudaNdarrayType(float32, matrix), CudaNdarrayType(float32, matrix), CudaNdarrayType(float32, matrix)]
Inputs shapes: [(), (1,), (1, 80), (), (8000, 50), (50, 8000), (50, 50)]
Inputs strides: [(), (4,), (0, 1), (), (50, 1), (8000, 1), (50, 1)]
Inputs values: [array(1), array([0], dtype=int32), 'not shown', array(1), 'not shown', 'not shown', 'not shown']

HINT: Re-running with most Theano optimization disabled could give you a back-trace of when this node was created. This can be done with by setting the Theano flag 'optimizer=fast_compile'. If that does not work, Theano optimizations can be disabled with 'optimizer=None'.
HINT: Use the Theano flag 'exception_verbosity=high' for a debugprint and storage map footprint of this apply node.

The important message is the following:

ValueError: dimension mismatch in args to gemv (50,50)x(80)->(50)

I think this piece of code is referrring to a multiplication between W (of size 50x50) and the hidden layer s_t, but with size 80 (obs: I'm using the same math notation you used, so I don't know if this is mapping directly to the Theano code. I'll check it out).

Do you know what could be causing that?

Sorry for bothering you.

opened by victorhcm 3

Licence

I would like to use this code for some project at the FAU (Friedrich-Alexander-University Erlangen-Nürnberg, Germany).

Without a license, I can use the code but may not redistribute it. I d like to have it graded, so I need to give it to the University. This may be forbidden without a license.

All in all, I would need a written text saying I can use it for this purpose, or a license.

Currently I am adjusting the code to learn a language character-based.

Thanks in advance, DSZ

opened by darksnakezero 2
Bump nbconvert from 4.0.0 to 6.3.0
Bumps nbconvert from 4.0.0 to 6.3.0.

Release notes

Sourced from nbconvert's releases.

5.5.0 Documentation Release

This tag is used to provide a working documentation build for RTD.

Commits

cefe0bf Release 6.3.0

a534fb9 Release 6.3.0b0

87920c5 Add changelog for 6.3.0 (#1669)

dd6d9c7 add slide numbering (#1654)

5d2c5e2 Update state filter (#1664)

11ea593 fix: avoid closing the script tag early by escaping a forward slash (#1665)

968c5fb Fix HTML templates mentioned in help docs (#1653)

35c4d07 Add a new output filter that excludes widgets if there is no state (#1643)

c663c75 6.2.0

fd1dd15 6.2.0rc2

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 1

Bump mistune from 0.7.1 to 0.8.1

Bumps mistune from 0.7.1 to 0.8.1.

Changelog

Sourced from mistune's changelog.

Changelog

Here is the full history of mistune.

Version 0.8.1


Released on Nov. 07, 2017

Security fix CVE-2017-16876, thanks Dawid Czarnecki

Version 0.8

Released on Oct. 26, 2017

Remove non breaking spaces preprocessing
Remove rev and rel attribute for footnotes
Fix bypassing XSS vulnerability by junorouse

This version is strongly recommended, since it fixed
a security issue.
Version 0.7.4
</code></pre>
<p>Released on Mar. 14, 2017</p>
<ul>
<li>Fix escape_link method by Marcos Ojeda</li>
<li>Handle block HTML with no content by David Baumgold</li>
<li>Use expandtabs for tab</li>
<li>Fix escape option for text renderer</li>
<li>Fix HTML attribute regex pattern</li>
</ul>
<p>Version 0.7.3</p>
<pre><code>
Released on Jun. 28, 2016

Fix strikethrough regex
Fix HTML attribute regex
Fix close tag regex

Version 0.7.2
</code></pre>
<p>Released on Feb. 26, 2016</p>
<ul>
<li>Fix <code>hard_wrap</code> options on renderer.</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/lepture/mistune/commit/cef69acaa506567595e95ab6ecea25a806de622e"><code>cef69ac</code></a> Add change log for v0.8.1</li>
<li><a href="https://github.com/lepture/mistune/commit/5f06d724bc05580e7f203db2d4a4905fc1127f98"><code>5f06d72</code></a> Fix CVE-2017-16876</li>
<li><a href="https://github.com/lepture/mistune/commit/7f7f106a717e6cf58012304e56b41d6fb2b98e5f"><code>7f7f106</code></a> Version bump 0.8</li>
<li><a href="https://github.com/lepture/mistune/commit/f8ac83ff6d49c0e850436b8d9e57b71c3b2c4d57"><code>f8ac83f</code></a> Cleanup appveyor CI</li>
<li><a href="https://github.com/lepture/mistune/commit/dda2ace2c74b534c82ba3a9571ee8e0bddba9e0e"><code>dda2ace</code></a> Fix CI testing</li>
<li><a href="https://github.com/lepture/mistune/commit/ab8f7de8bc78c2a88f9e01522b8a3a0aa8cd9416"><code>ab8f7de</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/lepture/mistune/issues/140">#140</a> from junorouse/master</li>
<li><a href="https://github.com/lepture/mistune/commit/d6f0b6402299bf5a380e7b4e77bd80e8736630fe"><code>d6f0b64</code></a> Fix bypassing XSS vulnerability.</li>
<li><a href="https://github.com/lepture/mistune/commit/5b8c3f7db4321bada0b955a9fb833a3faba4a67f"><code>5b8c3f7</code></a> Change donate link</li>
<li><a href="https://github.com/lepture/mistune/commit/4c117151ab536004599b0d5a8079ccda84cc5472"><code>4c11715</code></a> Add missing regex import to Lexers example (<a href="https://github-redirect.dependabot.com/lepture/mistune/issues/129">#129</a>)</li>
<li><a href="https://github.com/lepture/mistune/commit/e9e2066fee8ea4970cec17f1e480031db96906b9"><code>e9e2066</code></a> Update benchmark for misaka</li>
<li>Additional commits viewable in <a href="https://github.com/lepture/mistune/compare/v0.7.1...v0.8.1">compare view</a></li>
</ul>
</details>
<br />


Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options


You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
@dependabot use these labels will set the current labels as the default for future PRs for this repo and language
@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.


		                                  
		                                    dependencies


	                                 
										opened  by dependabot[bot]  1


	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    Bump notebook from 4.0.4 to 6.4.10
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   Bumps notebook from 4.0.4 to 6.4.10.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options


You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
@dependabot use these labels will set the current labels as the default for future PRs for this repo and language
@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.


		                                  
		                                    dependencies 
	                                    
	                                 
	                                 
										opened  by dependabot[bot]  1
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    Bump notebook from 4.0.4 to 6.1.5
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   Bumps notebook from 4.0.4 to 6.1.5.

Commits

See full diff in compare view





Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options


You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
@dependabot use these labels will set the current labels as the default for future PRs for this repo and language
@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.


		                                  
		                                    dependencies 
	                                    
	                                 
	                                 
										opened  by dependabot[bot]  1
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    Bump notebook from 4.0.4 to 5.7.8
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   Bumps notebook from 4.0.4 to 5.7.8.

Commits

See full diff in compare view





Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options


You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot ignore this [patch|minor|major] version will close this PR and stop Dependabot creating any more for this minor/major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
@dependabot use these labels will set the current labels as the default for future PRs for this repo and language
@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.


		                                  
		                                    dependencies 
	                                    
	                                 
	                                 
										opened  by dependabot[bot]  1
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    Bump nltk from 3.0.5 to 3.4.5
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   Bumps nltk from 3.0.5 to 3.4.5.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options


You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot ignore this [patch|minor|major] version will close this PR and stop Dependabot creating any more for this minor/major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
@dependabot use these labels will set the current labels as the default for future PRs for this repo and language
@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.


		                                  
		                                    dependencies 
	                                    
	                                 
	                                 
										opened  by dependabot[bot]  1
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    The equation problems in your related blogs
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   Recently, I have learned the RNN model from your bolgs. It is very nice! The codes in your github is very readable. However, I have found the equation of part 2 and part 4 of the blogs cannot show well. Instead, the original Latex format is showed, which is much difficult to read. However, the equations in part 1 show well. I would appreciate it if you can kindly handle this problem.

		                                  
		                                    
	                                    
	                                 
	                                 
										opened  by xiaohu2015  1
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    module compiled against API version 0xa but this version of numpy is 0x9 
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   I am a newcomer to RNN. When I try to type "python train-theano.py", the system does not work and report like this:
RuntimeError: module compiled against API version 0xa but this version of numpy is 0x9
RuntimeError: module compiled against API version 0xa but this version of numpy is 0x9
I have created a virtualenv, and install requirements.txt

		                                  
		                                    
	                                    
	                                 
	                                 
										opened  by xin-xinhanggao  1
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    Bump wheel from 0.26.0 to 0.38.1
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   Bumps wheel from 0.26.0 to 0.38.1.

Changelog
Sourced from wheel's changelog.

Release Notes
UNRELEASED

Updated vendored packaging to 22.0

0.38.4 (2022-11-09)

Fixed PKG-INFO conversion in bdist_wheel mangling UTF-8 header values in
METADATA (PR by Anderson Bravalheri)

0.38.3 (2022-11-08)

Fixed install failure when used with --no-binary, reported on Ubuntu 20.04, by
removing setup_requires from setup.cfg

0.38.2 (2022-11-05)

Fixed regression introduced in v0.38.1 which broke parsing of wheel file names with
multiple platform tags

0.38.1 (2022-11-04)

Removed install dependency on setuptools
The future-proof fix in 0.36.0 for converting PyPy's SOABI into a abi tag was
faulty. Fixed so that future changes in the SOABI will not change the tag.

0.38.0 (2022-10-21)

Dropped support for Python < 3.7
Updated vendored packaging to 21.3
Replaced all uses of distutils with setuptools
The handling of license_files (including glob patterns and default
values) is now delegated to setuptools>=57.0.0 (#466).
The package dependencies were updated to reflect this change.
Fixed potential DoS attack via the WHEEL_INFO_RE regular expression
Fixed ValueError: ZIP does not support timestamps before 1980 when using
SOURCE_DATE_EPOCH=0 or when on-disk timestamps are earlier than 1980-01-01. Such
timestamps are now changed to the minimum value before packaging.

0.37.1 (2021-12-22)

Fixed wheel pack duplicating the WHEEL contents when the build number has changed (#415)
Fixed parsing of file names containing commas in RECORD (PR by Hood Chatham)

0.37.0 (2021-08-09)

Added official Python 3.10 support
Updated vendored packaging library to v20.9



... (truncated)


Commits

6f1608d Created a new release
cf8f5ef Moved news item from PR #484 to its proper place
9ec2016 Removed install dependency on setuptools (#483)
747e1f6 Fixed PyPy SOABI parsing (#484)
7627548 [pre-commit.ci] pre-commit autoupdate (#480)
7b9e8e1 Test on Python 3.11 final
a04dfef Updated the pypi-publish action
94bb62c Fixed docs not building due to code style changes
d635664 Updated the codecov action to the latest version
fcb94cd Updated version to match the release
Additional commits viewable in compare view





Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options


You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
@dependabot use these labels will set the current labels as the default for future PRs for this repo and language
@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.


		                                  
		                                    dependencies 
	                                    
	                                 
	                                 
										opened  by dependabot[bot]  0
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    Bump ipython from 4.0.0 to 7.16.3
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   Bumps ipython from 4.0.0 to 7.16.3.

Commits

d43c7c7 release 7.16.3
5fa1e40 Merge pull request from GHSA-pq7m-3gw7-gq5x
8df8971 back to dev
9f477b7 release 7.16.2
138f266 bring back release helper from master branch
5aa3634 Merge pull request #13341 from meeseeksmachine/auto-backport-of-pr-13335-on-7...
bcae8e0 Backport PR #13335: What's new 7.16.2
8fcdcd3 Pin Jedi to <0.17.2.
2486838 release 7.16.1
20bdc6f fix conda build
Additional commits viewable in compare view





Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options


You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
@dependabot use these labels will set the current labels as the default for future PRs for this repo and language
@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.


		                                  
		                                    dependencies 
	                                    
	                                 
	                                 
										opened  by dependabot[bot]  0
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    Bump pygments from 2.0.2 to 2.7.4
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   Bumps pygments from 2.0.2 to 2.7.4.

Release notes
Sourced from pygments's releases.

2.7.4


Updated lexers:


Apache configurations: Improve handling of malformed tags (#1656)


CSS: Add support for variables (#1633, #1666)


Crystal (#1650, #1670)


Coq (#1648)


Fortran: Add missing keywords (#1635, #1665)


Ini (#1624)


JavaScript and variants (#1647 -- missing regex flags, #1651)


Markdown (#1623, #1617)


Shell

Lex trailing whitespace as part of the prompt (#1645)
Add missing in keyword (#1652)



SQL - Fix keywords (#1668)


Typescript: Fix incorrect punctuation handling (#1510, #1511)




Fix infinite loop in SML lexer (#1625)


Fix backtracking string regexes in JavaScript/TypeScript, Modula2
and many other lexers (#1637)


Limit recursion with nesting Ruby heredocs (#1638)


Fix a few inefficient regexes for guessing lexers


Fix the raw token lexer handling of Unicode (#1616)


Revert a private API change in the HTML formatter (#1655) --
please note that private APIs remain subject to change!


Fix several exponential/cubic-complexity regexes found by
Ben Caller/Doyensec (#1675)


Fix incorrect MATLAB example (#1582)


Thanks to Google's OSS-Fuzz project for finding many of these bugs.
2.7.3


Updated lexers:

Ada (#1581)
HTML (#1615, #1614)
Java (#1594, #1586)
JavaScript (#1605, #1589, #1588)
JSON (#1569 -- this is a complete rewrite)
Lean (#1601)
LLVM (#1612)
Mason (#1592)
MySQL (#1555, #1551)
Rust (#1608)
Turtle (#1590, #1553)



Deprecated JsonBareObjectLexer, which is now identical to JsonLexer (#1600)


The ImgFormatter now calculates the exact character width, which fixes some issues with overlapping text (#1213, #1611)




... (truncated)


Changelog
Sourced from pygments's changelog.

Version 2.7.4
(released January 12, 2021)


Updated lexers:


Apache configurations: Improve handling of malformed tags (#1656)


CSS: Add support for variables (#1633, #1666)


Crystal (#1650, #1670)


Coq (#1648)


Fortran: Add missing keywords (#1635, #1665)


Ini (#1624)


JavaScript and variants (#1647 -- missing regex flags, #1651)


Markdown (#1623, #1617)


Shell

Lex trailing whitespace as part of the prompt (#1645)
Add missing in keyword (#1652)



SQL - Fix keywords (#1668)


Typescript: Fix incorrect punctuation handling (#1510, #1511)




Fix infinite loop in SML lexer (#1625)


Fix backtracking string regexes in JavaScript/TypeScript, Modula2
and many other lexers (#1637)


Limit recursion with nesting Ruby heredocs (#1638)


Fix a few inefficient regexes for guessing lexers


Fix the raw token lexer handling of Unicode (#1616)


Revert a private API change in the HTML formatter (#1655) --
please note that private APIs remain subject to change!


Fix several exponential/cubic-complexity regexes found by
Ben Caller/Doyensec (#1675)


Fix incorrect MATLAB example (#1582)


Thanks to Google's OSS-Fuzz project for finding many of these bugs.
Version 2.7.3
(released December 6, 2020)


Updated lexers:

Ada (#1581)
HTML (#1615, #1614)
Java (#1594, #1586)
JavaScript (#1605, #1589, #1588)
JSON (#1569 -- this is a complete rewrite)
Lean (#1601)
LLVM (#1612)
Mason (#1592)





... (truncated)


Commits

4d555d0 Bump version to 2.7.4.
fc3b05d Update CHANGES.
ad21935 Revert "Added dracula theme style (#1636)"
e411506 Prepare for 2.7.4 release.
275e34d doc: remove Perl 6 ref
2e7e8c4 Fix several exponential/cubic complexity regexes found by Ben Caller/Doyensec
eb39c43 xquery: fix pop from empty stack
2738778 fix coding style in test_analyzer_lexer
02e0f09 Added 'ERROR STOP' to fortran.py keywords. (#1665)
c83fe48 support added for css variables (#1633)
Additional commits viewable in compare view





Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options


You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
@dependabot use these labels will set the current labels as the default for future PRs for this repo and language
@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.


		                                  
		                                    dependencies 
	                                    
	                                 
	                                 
										opened  by dependabot[bot]  0
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    Bump jinja2 from 2.8 to 2.11.3
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   Bumps jinja2 from 2.8 to 2.11.3.

Release notes
Sourced from jinja2's releases.

2.11.3
This contains a fix for a speed issue with the urlize filter. urlize is likely to be called on untrusted user input. For certain inputs some of the regular expressions used to parse the text could take a very long time due to backtracking. As part of the fix, the email matching became slightly stricter. The various speedups apply to urlize in general, not just the specific input cases.

PyPI: https://pypi.org/project/Jinja2/2.11.3/
Changes: https://jinja.palletsprojects.com/en/2.11.x/changelog/#version-2-11-3

2.11.2

Changelog: https://jinja.palletsprojects.com/en/2.11.x/changelog/#version-2-11-2

2.11.1
This fixes an issue in async environment when indexing the result of an attribute lookup, like {{ data.items[1:] }}.

Changes: https://jinja.palletsprojects.com/en/2.11.x/changelog/#version-2-11-1

2.11.0

Changes: https://jinja.palletsprojects.com/en/2.11.x/changelog/#version-2-11-0
Blog: https://palletsprojects.com/blog/jinja-2-11-0-released/
Twitter: https://twitter.com/PalletsTeam/status/1221883554537230336

This is the last version to support Python 2.7 and 3.5. The next version will be Jinja 3.0 and will support Python 3.6 and newer.
2.10.3

Changes: http://jinja.palletsprojects.com/en/2.10.x/changelog/#version-2-10-3

2.10.2

Changes: http://jinja.palletsprojects.com/en/2.10.x/changelog/#version-2-10-2

2.10.1

Changes: https://jinja.palletsprojects.com/en/2.10.x/changelog/#version-2-10-1
Blog: https://palletsprojects.com/blog/jinja-2-10-1-released/
Twitter: https://twitter.com/PalletsTeam/status/1114605127308992513

2.10
Primary changes

A NativeEnvironment that renders Python types instead of strings.
http://jinja.pocoo.org/docs/2.10/nativetypes/
A namespace object that works with {% set %}. This replaces
previous hacks for storing state across iterations or scopes.
http://jinja.pocoo.org/docs/2.10/templates/#assignments
The loop object now has nextitem and previtem attributes, as
well as a changed method, for the common case of outputting
something as a value in the loop changes. More complicated cases can
use the namespace object.
http://jinja.pocoo.org/docs/2.10/templates/#for

Install or upgrade
Install from PyPI with pip:


... (truncated)


Changelog
Sourced from jinja2's changelog.

Version 2.11.3
Released 2021-01-31

Improve the speed of the urlize filter by reducing regex
backtracking. Email matching requires a word character at the start
of the domain part, and only word characters in the TLD. :pr:1343

Version 2.11.2
Released 2020-04-13

Fix a bug that caused callable objects with __getattr__, like
:class:~unittest.mock.Mock to be treated as a
:func:contextfunction. :issue:1145
Update wordcount filter to trigger :class:Undefined methods
by wrapping the input in :func:soft_str. :pr:1160
Fix a hang when displaying tracebacks on Python 32-bit.
:issue:1162
Showing an undefined error for an object that raises
AttributeError on access doesn't cause a recursion error.
:issue:1177
Revert changes to :class:~loaders.PackageLoader from 2.10 which
removed the dependency on setuptools and pkg_resources, and added
limited support for namespace packages. The changes caused issues
when using Pytest. Due to the difficulty in supporting Python 2 and
:pep:451 simultaneously, the changes are reverted until 3.0.
:pr:1182
Fix line numbers in error messages when newlines are stripped.
:pr:1178
The special namespace() assignment object in templates works in
async environments. :issue:1180
Fix whitespace being removed before tags in the middle of lines when
lstrip_blocks is enabled. :issue:1138
:class:~nativetypes.NativeEnvironment doesn't evaluate
intermediate strings during rendering. This prevents early
evaluation which could change the value of an expression.
:issue:1186

Version 2.11.1
Released 2020-01-30

Fix a bug that prevented looking up a key after an attribute
({{ data.items[1:] }}) in an async template. :issue:1141



... (truncated)


Commits

cf21539 release version 2.11.3
15ef8f0 Merge pull request #1343 from pallets/urlize-speedup
ef658dc speed up urlize matching
eeca0fe Merge pull request #1207 from mhansen/patch-1
2dd7691 Merge pull request #1209 from mhansen/patch-3
4892940 do_dictsort: update example ready to copy/paste
7db7d33 api.rst: bugfix in docs, import PackageLoader
9ec465b fix changelog header
737a4cd release version 2.11.2
179df6b Merge pull request #1190 from pallets/native-eval
Additional commits viewable in compare view





Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options


You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
@dependabot use these labels will set the current labels as the default for future PRs for this repo and language
@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.


		                                  
		                                    dependencies 
	                                    
	                                 
	                                 
										opened  by dependabot[bot]  0
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    Change Python 2 language to Python 3
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   I converted Python 2 language to Python 3 and modified reading 'reddit-comment.csv' file to be compatible with Python 3. Additionally, I also updated again 'requirements.txt' file.

		                                  
		                                    
	                                    
	                                 
	                                 
										opened  by anthng  0
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    Why the timestep is not used in the forward_propagation
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   When i use lstm in keras or tensorflow, they have different data strctures. When i compared this tutorial with keras, i found the 'timestep' is only used in the backward_propagation, but not in the forward_propagation is this right?

		                                  
		                                    
	                                    
	                                 
	                                 
										opened  by Tongjilibo  0
									
	                              
	                           
	                        
	                        
	                           
	                              
	                                 
	                                 
	                                 
	                              
	                              
	                                 
	                                    
	                                    pip on requirement.txt gives "This backport is for Python 2.7 only." for functool32
	                                    
	                                 
	                                  
	                                 
	                                   
		                                   When
pip install -r requirements.txt
,
the following error occurred:
Collecting appnope==0.1.0 (from -r requirements.txt (line 1))
Using cached appnope-0.1.0-py2.py3-none-any.whl
Collecting backports.ssl-match-hostname==3.4.0.2 (from -r requirements.txt (line 2))
Using cached backports.ssl_match_hostname-3.4.0.2.tar.gz
Collecting certifi==2015.9.6.2 (from -r requirements.txt (line 3))
Using cached certifi-2015.9.6.2-py2.py3-none-any.whl
Collecting decorator==4.0.2 (from -r requirements.txt (line 4))
Using cached decorator-4.0.2-py2.py3-none-any.whl
Collecting funcsigs==0.4 (from -r requirements.txt (line 5))
Using cached funcsigs-0.4-py2.py3-none-any.whl
Collecting functools32==3.2.3.post2 (from -r requirements.txt (line 6))
Using cached functools32-3.2.3-2.zip
Complete output from command python setup.py egg_info:
This backport is for Python 2.7 only.
----------------------------------------

Command "python setup.py egg_info" failed with error code 1 in C:\Users\lud\AppData\Local\Temp\pip-build-oboinpbr\functools32\
My environment is
Python: 3.6.4
Pip: 9.0.1
Any suggestion?

		                                  
		                                    
	                                    
	                                 
	                                 
										opened  by stevenluda  0

Recurrent Neural Network Tutorial, Part 2 - Implementing a RNN in Python and Theano

Related tags

Overview

Jupyter Notebook Setup

Setting up a CUDA-enabled GPU instance on EC2:

Comments

5.5.0 Documentation Release

Changelog

Release Notes

2.7.4

2.7.3

Version 2.7.4

Version 2.7.3

2.11.3

2.11.2

2.11.1

2.11.0

2.10.3

2.10.2

2.10.1

2.10

Primary changes

Install or upgrade

Version 2.11.3

Version 2.11.2

Version 2.11.1

Owner

Denny Britz

Lightweight library to build and train neural networks in Theano

Theano is a Python library that allows you to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. It can use GPUs and perform efficient symbolic differentiation.

Theano is a Python library that allows you to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. It can use GPUs and perform efficient symbolic differentiation.

Theano is a Python library that allows you to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. It can use GPUs and perform efficient symbolic differentiation.

A modified version of DeepMind's Alphafold2 to divide CPU part (MSA and template searching) and GPU part (prediction model)

This repository is related to an Arabic tutorial, within the tutorial we discuss the common data structure and algorithms and their worst and best case for each, then implement the code using Python.

Facilitates implementing deep neural-network backbones, data augmentations

Pytorch implementation of "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling"

OHLC Average Prediction of Apple Inc. Using LSTM Recurrent Neural Network

Pytorch implementation of the Variational Recurrent Neural Network (VRNN).

PyTorch implementation of the Quasi-Recurrent Neural Network - up to 16 times faster than NVIDIA's cuDNN LSTM

Speech Separation Using an Asynchronous Fully Recurrent Convolutional Neural Network

A real world application of a Recurrent Neural Network on a binary classification of time series data

An implementation of Geoffrey Hinton's paper "How to represent part-whole hierarchies in a neural network" in Pytorch.

Implements Stacked-RNN in numpy and torch with manual forward and backward functions

📝 Wrapper library for text generation / language models at char and word level with RNN in TensorFlow

This is the code repository implementing the paper "TreePartNet: Neural Decomposition of Point Clouds for 3D Tree Reconstruction".

Algorithmic Trading using RNN

A pytorch implementation of Pytorch-Sketch-RNN