Differentiable Neural Computer in TensorFlow
Go to file
2017-02-19 16:11:57 -05:00
copy first commit 2017-02-19 16:11:57 -05:00
dnc first commit 2017-02-19 16:11:57 -05:00
README.md first commit 2017-02-19 16:11:57 -05:00

DNC: Differentiable Neural Computer

Implements DeepMind's third nature paper, Hybrid computing using a neural network with dynamic external memory by Graves et. al.

DNC schema

Based on the paper's appendix, I sketched the computational graph

This is a work in progress

I have a general framework and a couple Jupyter notebooks for debugging. This is not a finished project. It's still very much in the dev stage. I need to:

  1. write unit tests
  2. improve documentation/comments
  3. run it on more difficult tasks
  4. add some nice visualizations

Dependencies

  • All code is written in python 2.7. You will need:
  • Numpy
  • Matplotlib
  • TensorFlow r1.0