ADPTNet: Adaptive with Prescriptive Timescales Non-Linear SSM for Sequence Modelling
A central aim of neuromorphic computing is to provide a viable alternative to highly energy-intensive Transformer-based AI. However, efficient alternatives struggle to capture the set of qualities that have secured the Transformer's status as the de facto standard in sequence modelling. Any realistic contender must be data-adaptive, able to capture long-range dependencies, and GPU-parallelisable,…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.