A Torch7 package providing extended neural network modules, criterions, and utilities for deep learning research.
dpnn is a Torch7 package that extends the core `nn` library with additional neural network modules, criterions, and training utilities. It provides specialized components for computer vision, reinforcement learning, and efficient model training, addressing gaps in the standard library for research and complex architectures.
Deep learning researchers and practitioners using Torch7 who need advanced modules, reinforcement learning tools, or efficiency optimizations beyond the standard `nn` package.
It offers a curated collection of battle-tested extensions from the dp framework, enabling faster experimentation with state-of-the-art techniques like REINFORCE, NCE, and specialized architectures without reinventing the wheel.
deep extensions to nn
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
The sharedClone method allows cloning modules with shared parameters, drastically reducing memory overhead for recurrent networks, as highlighted in the README for RNNs.
Includes methods like maxParamNorm for regularization and updateGradParameters for momentum learning, providing fine-grained control over optimization beyond core nn.
Offers implementations such as Inception, REINFORCE algorithms, and NCEModule for noise-contrastive estimation, enabling rapid experimentation with state-of-the-art techniques.
Provides built-in modules like ReinforceBernoulli and criterions like VRClassReward, simplifying policy gradient implementations without custom code.
Built exclusively for Torch7, a Lua-based framework largely superseded by PyTorch, limiting long-term maintenance and ecosystem growth.
Requires deep familiarity with Torch7 and Lua, with sparse documentation focused on advanced users, making onboarding difficult for newcomers.
As a research-oriented package, it lacks tools for deployment, serialization optimizations like lightSerial are noted but may not suffice for scalable applications.