kyegomez/LongNet Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens" Language: Python #artificial_intelligence #attention #attention_is_all_you_need #attention_mechanisms #chatgpt #context_length #gpt3 #gpt4 #machine_learning #transformer Stars: 381 Issues: 4 Forks: 55 https://github.com/kyegomez/LongNet