Differentiable Neural Computer in TensorFlow

deepmind differentiable-computing dnc jupyter-notebook nature neural-network tensorflow

Go to file

Sam Greydanus 96f62bbc6e repeat copy looking good		2017-02-21 17:18:13 -05:00
dnc	repeat copy now works pretty well	2017-02-21 16:38:44 -05:00
repeat-copy	repeat copy looking good	2017-02-21 17:18:13 -05:00
static	repeat copy now works pretty well	2017-02-21 16:38:44 -05:00
README.md	repeat copy now works pretty well	2017-02-21 16:38:44 -05:00

README.md

DNC: Differentiable Neural Computer

Implements DeepMind's third nature paper, Hybrid computing using a neural network with dynamic external memory by Graves et. al.

Based on the paper's appendix, I sketched the computational graph

I got the repeat-copy copy task to work (Jupyter notebook)

This is a work in progress

I have a general framework and a couple Jupyter notebooks for debugging. This is not a finished project. It's still very much in the dev stage. I need to:

write unit tests
improve documentation/comments
run it on more difficult tasks
add some nice visualizations

Dependencies

All code is written in python 2.7. You will need:
Numpy
Matplotlib
TensorFlow r1.0