Say hello to Gab.

Gab is a 25 million parameter (~100 MiB) small language model that can run locally in your browser. It was built in plain JavaScript as a research project to better understand how LLMs work. Below you'll find a five-part tutorial walking through every step of building the model.

Gab comes with a simple trainer ui, and a chat interface that can test your trained models. There is also a training guide to explain the models hyper-paramaters.