Skip to yearly menu bar Skip to main content


Virtual presentation / top 5% paper

MICN: Multi-scale Local and Global Context Modeling for Long-term Series Forecasting

Huiqiang Wang · Jian Peng · Feihu Huang · Jince Wang · Junhui Chen · Yifei Xiao

Keywords: [ Deep Learning and representational learning ] [ local and global context ] [ multi-branch architecture ] [ long-term forecasting ] [ different potential patterns. ]


Abstract:

Recently, Transformer-based methods have achieved surprising performance in the field of long-term series forecasting, but the attention mechanism for computing global correlations entails high complexity. And they do not allow for targeted modeling of local features as CNN structures do. To solve the above problems, we propose to combine local features and global correlations to capture the overall view of time series (e.g., fluctuations, trends). To fully exploit the underlying information in the time series, a multi-scale branch structure is adopted to model different potential patterns separately. Each pattern is extracted with down-sampled convolution and isometric convolution for local features and global correlations, respectively. In addition to being more effective, our proposed method, termed as Multi-scale Isometric Convolution Network (MICN), is more efficient with linear complexity about the sequence length with suitable convolution kernels. Our experiments on six benchmark datasets show that compared with state-of-the-art methods, MICN yields 17.2% and 21.6% relative improvements for multivariate and univariate time series, respectively.

Chat is not available.