Home Projects pytorch-original-transformer
pytorch-original-transformer

pytorch-original-transformer

by gordicaleksa · GitHub

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

View on GitHub
⭐ Stars
1.1k
🍴 Forks
187
📜 License
MIT
Commercial use OK
📅 Created
2020
🔄 Last commit
5 yr ago
🏷️ Category
attention
💻 Language
You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
pytorch-original-transformer — GitHub preview card
📈 Star history
1 1101 109
2026-07-202026-07-21
📄 About

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Frequently asked questions

What is pytorch-original-transformer?

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Is pytorch-original-transformer open source?

pytorch-original-transformer is an open-source project. It is released under the MIT license.

Is pytorch-original-transformer free?

Yes. pytorch-original-transformer is free and open source — you can use, modify and self-host it.

🏅 Maintainer of this project?
OpenSourceAI badge — pytorch-original-transformer

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![OpenSourceAI](https://opensourceai.tech/badge.php?tool=gordicaleksa-pytorch-original-transformer)](https://opensourceai.tech/project/gordicaleksa-pytorch-original-transformer.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.