TensorFlow implementation of Neural Turing Machines with LSTM controllers, supporting multiple read/write heads.
NTM-tensorflow is a TensorFlow implementation of Neural Turing Machines, a neural network architecture that integrates external memory with neural controllers to learn algorithms and store information. It solves the problem of enabling neural networks to perform complex memory-based tasks like copying sequences, advancing research in machine learning and artificial intelligence.
Machine learning researchers and developers interested in memory-augmented neural networks, sequence learning, or exploring TensorFlow implementations of advanced neural architectures.
Developers choose this project for its open-source TensorFlow implementation of NTMs with support for multiple read/write heads, providing a practical reference for experimenting with memory-augmented models, despite noted limitations in handling variable-length inputs.
"Neural Turing Machine" in Tensorflow
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
Uses LSTM networks as the controller for memory operations, providing a stable and well-understood base for managing NTM dynamics, as specified in the Key Features.
Supports configurations with several read/write heads to enhance memory access and manipulation, enabling more complex memory-based learning tasks.
Includes built-in functionality for training on copy tasks, a standard benchmark for evaluating memory-augmented neural networks, as highlighted in the Key Features.
Built on TensorFlow 1.1.0, leveraging its computational graph and automatic differentiation for efficient gradient computation and model training.
Loss frequently goes to NaN even with gradient clipping, as noted in the README issue #2, making reliable training challenging and prone to failures.
The code is explicitly described as poorly designed for handling inputs with variable lengths, limiting its applicability to fixed-sequence tasks without significant modifications.
Relies on TensorFlow 1.1.0, which is deprecated and incompatible with TensorFlow 2.x, lacking modern features, optimizations, and community support.