Sequence Modeling
The task of processing, understanding, or generating ordered sequences of data, including text, time series, audio, and genomic data.
Architectures
RNNs/LSTMs: Process sequences step by step (now largely superseded). Transformers: Process entire sequences in parallel with attention. State Space Models (Mamba): Linear-time sequence processing.
Applications
Language modeling, machine translation, speech recognition, music generation, protein structure prediction, weather forecasting, and stock price prediction.