SWAN: An Efficient and Scalable Approach for Long-Context Language Modeling

Krishna C Puvvada | Faisal Ladhak | Santiago Akle Serano | Cheng-Ping Hsieh | Shantanu Acharya | Somshubra Majumdar | Fei Jia | Samuel Kriman | Simeng Sun | Dima Rekesh | Boris Ginsburg |