Note on S4-Efficiently Modeling Long Sequences with Structured State Spaces
[TOC]
Motivation S4 sequence model is rising in the sequence modelling field. It dominates on long sequence modelling over RNN, LSTM and transformers. It’s both mathematically elegant and useful, and it’s trending, so why not write about it.
Jul 17, 2022