Jamie-Stirling/RetNet
An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"
Language: Python
Stars: 323 Issues: 4 Forks: 29
https://github.com/Jamie-Stirling/RetNet
An implementation of "Retentive Network: A Successor to Transformer for Large Language Models" - GitHub - Jamie-Stirling/RetNet: An implementation of "Retentive Network:...
