This repository contains the source code of our work on building efficient sequence models: DeFINE (ICLR'20) and DeLighT (preprint). In this repository, we share the source code of our paper DeLight, ...