All Katas - ML Katas

by: newest upvotes saves

Advanced Indexing with `gather` for NLP

this month medium (<30 mins) | NLP gather indexing

In Natural Language Processing, it's common to work with sequences of varying lengths. A frequent task is to extract the activations of the last token in each sequence from a tensor of shape...
Replicating `torch.nn.Embedding` with `gather`

this month medium (<30 mins) | embeddings NLP gather

The `torch.nn.Embedding` layer is fundamental in many deep learning models, especially in NLP. Your task is to replicate its forward pass functionality using `torch.gather`. You'll create a...