Students Professional
JA EN

#patchtst

1 articles

01 ·Time Series·★ MEMBER·PAPER·11 min read Do Transformers Actually Work on Time Series? — The Argument and the Practical Answer In 2022 a single linear layer beat the whole crop of time-series Transformers on the standard benchmarks. The culprit turned out to be tokenization, not attention — a diagnosis PatchTST fixed by patching and iTransformer by transposing the axes. And yet gradient boosting keeps winning the practitioner competitions, for reasons that come down to the shape of real data.