Small Language Models (SLMs): A Survey
on Nlp, Survey, Slm, Small-language-models, Efficiency
Introduction
on Nlp, Survey, Llm, Large-language-models
This post provides an overview and analysis of the survey paper “A Survey of Large Language Models” which comprehensively examines the current state, capabilities, and future directions of large language models.
Reading notes from Devops Handbook.
Reading notes from PMPP.
Gpu Computing Course Notes
Attention Mechanisms
Module 1 : Introduction to NLP
Module 2 : Foundations
Overview
on Nlp, Transformer, Attention
The “Attention is All You Need” paper by Vaswani et al. (2017) introduced the Transformer architecture, which revolutionized natural language processing by dispensing with recurrence and convolutions entirely, relying solely on attention mechanisms. This paper laid the foundation for modern large language models like GPT, BERT, and T5.