LLMs from Scratch vs
Awesome LLMLLMs from Scratch vs Awesome LLM compared for 2026 — features, license, ease of use, performance and which one to choose. Build a GPT from nothing, line by line vs Papers, models and tools of the LLM era.
Updated regularly · curated by OpenSourceAI.tech
| Spec | LLMs from Scratch | Awesome LLM |
|---|---|---|
| Category | Learn AI & machine learning | Learn AI & machine learning |
| Type | Book + code | Curated list |
| License | Apache-2.0 | CC0-1.0 |
| Runs locally | Yes | Yes |
| Primary language | Python | Markdown |
| Ease of use | Intermediate | Beginner |
| Best for | genuinely understanding how an LLM works | getting your bearings in the LLM landscape |
| GitHub stars | 99k | 27.1k |
| Criterion | LLMs from Scratch | Awesome LLM |
|---|---|---|
| Popularity | 4.5 | 3.5 |
| Maintenance | 5.0 | 3.0 |
| Ease of use | 3.5 | 5.0 |
| Privacy | 5.0 | 5.0 |
| License freedom | 5.0 | 3.5 |
Scores are computed automatically from public signals — GitHub stars (popularity), recent commit activity (maintenance), license type (freedom), local-first design (privacy) and onboarding complexity (ease of use). Indicative, not a verdict.
Sebastian Raschka's companion repository to "Build a Large Language Model (From Scratch)": you implement attention, a transformer, pretraining and fine-tuning yourself, in plain PyTorch.
Awesome LLMA curated index of the LLM landscape: the foundational papers, the open models, the training and serving tools — updated as the field moves.
LLMs from Scratch is book + code, while Awesome LLM is curated list. Their licenses differ (Apache-2.0 vs CC0-1.0), which matters if you ship a commercial product. LLMs from Scratch leans more intermediate-friendly, whereas Awesome LLM is more suited to beginner users. In short, LLMs from Scratch fits genuinely understanding how an LLM works, and Awesome LLM fits getting your bearings in the LLM landscape.
Choose LLMs from Scratch for genuinely understanding how an LLM works. Choose Awesome LLM for getting your bearings in the LLM landscape.
There is rarely one winner — many setups use both. The right pick depends on your hardware, your team's skills, and whether you value simplicity or control.
Awesome LLM is generally the easier of the two to get started with, while LLMs from Scratch rewards more setup with more control.
LLMs from Scratch is free and open source (Apache-2.0), and Awesome LLM is free and open source (CC0-1.0). Neither charges for the core software.
LLMs from Scratch: yes · Awesome LLM: yes. Both can be used without sending your data to a third-party cloud where their setup allows.
Choose LLMs from Scratch for genuinely understanding how an LLM works. Choose Awesome LLM for getting your bearings in the LLM landscape.
Browse thousands of open-source AI tools, models and projects — all curated in one place, updated daily.
Explore the directory →