On the role of the tokenizer in ECG transformer models
Tokenization determines both the physiological content presented to an ECG Transformer and the sequence over which attention operates. We compare eight tokenization strategies across Transformer, Informer, Reformer, and FEDformer on the nine-label CPSC2018 classification task. The input projection and principal backbone capacity are controlled to isolate the effect of token construction.…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
