Attention Mechanism
Showing 15 of 15 projects
A Python module for easily training character- or word-level text-generating neural networks on any dataset with minimal code.
A deep learning model for machine comprehension that uses bi-directional attention flow to answer questions about text passages.
TensorFlow implementation of an attention-based neural image caption generator that focuses on relevant image parts while generating words.
A pre-trained BERT model designed for DNA sequence analysis, enabling genome understanding tasks like classification and motif discovery.
TensorFlow implementation of R-Net for machine reading comprehension on the SQuAD dataset.
A lightweight encoder-decoder neural network for real-time semantic segmentation on resource-constrained devices.
An AI system that incrementally generates scientific paper drafts by predicting links between concepts and generating text sections.
A FlashAttention 2 implementation for JAX with block-wise document mask optimization and context parallelism for efficient long-sequence training.
A TensorFlow implementation of hierarchical attentive recurrent neural networks for single object tracking in videos.
TensorFlow implementation of hierarchical attention networks for document classification using GRU cells and attention mechanisms.
A TensorFlow implementation of Attend, Infer, Repeat (AIR), a generative model for fast scene understanding by reconstructing objects sequentially.
An attentive bilateral contextual network for efficient semantic segmentation of fine-resolution remote sensing images.
A TensorFlow/TensorLayer implementation of Spatial Transformer Networks for learning image transformations like scaling, cropping, and rotation.
A minimal JAX/Flax implementation of DETR with optimizations like Flash Attention and Sinkhorn solver.
Attention-based GNN model for predicting drug sensitivity and explaining gene contributions using a drug-cell-gene heterogeneous network.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.