A 9M fish model that forgets after 128 tokens is a pretty clear way to show what a tiny transformer can and can't hold onto. Keeping the stack plain, from tokenizer training to ONNX and browser inference, makes the whole pipeline easier to inspect.

GuppyLM
A ~9M parameter tiny language model that talks like a small fish.
79 ratings3.68
Saves915
CategoryAI
PlatformWeb
PricingFree
GuppyLM is a small language model with 8.7M parameters designed to simulate a fish character named Guppy. It is trained from scratch in about 5 minutes on a single GPU using synthetic conversational data covering 60 different aquarium-related topics. The model runs entirely locally in a browser via WebAssembly or can be interacted with via Python scripts and Colab notebooks. It demonstrates how to build and train a simple transformer LLM to understand foundational transformer architecture and training pipelines without requiring large-scale resources.
Ratings & Reviews
Write a reviewInformation
CategoryAI
PlatformsWeb
PricingFree
AccountNot confirmed
ListedApril 2026
WebVisit
Report a problem
Around the Web
Show HN915 source points · 0 comments