Topic

Natural Language Processing

A collection of 5 issues

The Transformer Architecture

Diving deep into the Transformer architecture and its mathematical underpinnings, covering scaled dot-product attention, multi-head attention, and positional encodings, ... . Exploring how encoder-decoder, encoder-only, and decoder-only models work for NLP, translation and generative AI.

Enhancing HumSet: Improving Humanitarian Crisis Response with AdapterFusion

Exploring ways to leverage NLP and the hierarchical classification framework of HumSet to enhance responses to humanitarian crises beyond baseline results.

Language Models are Few Shot Learners - Meta Learning with GPT-3

Analyzing the paper "Language Models are Few-Shot Learners", exploring GPT-3's meta-learning abilities in Zero, One, and Few-Shot scenarios.

Experimenting with FreeGBDT for NLI Fine-Tuning

Experimenting with "Enhancing Transformers with Gradient Boosted Decision Trees for NLI Fine-Tuning". A deep dive into the FreeGBDT paper.

Disaster Tweet Classification with RoBERTa and PyTorch

Approaching the Disaster Tweet Classification Kaggle challenge with NLP deep learning.