InfiniTransformer
Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
What is InfiniTransformer?
Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
Is InfiniTransformer open source?
InfiniTransformer is an open-source project. It is released under the MIT license.
Is InfiniTransformer free?
Yes. InfiniTransformer is free and open source — you can use, modify and self-host it.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://opensourceai.tech/project/beomi-infinitransformer.html)
