
Research Article
Improving Deep Learning Performance on Small Datasets via Similar Pretraining Data Generation
@INPROCEEDINGS{10.1007/978-3-032-34048-1_5, author={Sheng-Tzong Cheng and Jun-Ting Lin and Chia-Chang Tsou}, title={Improving Deep Learning Performance on Small Datasets via Similar Pretraining Data Generation}, proceedings={Smart Grid and Internet of Things. 9th EAI International Conference, SGIoT 2025, Taichung, Taiwan, December 6--7, 2025, Proceedings}, proceedings_a={SGIOT}, year={2026}, month={10}, keywords={Time Series Forecasting Small-scale Datasets Channel-Independence Pretraining Data Augmentation}, doi={10.1007/978-3-032-34048-1_5} }- Sheng-Tzong Cheng
Jun-Ting Lin
Chia-Chang Tsou
Year: 2026
Improving Deep Learning Performance on Small Datasets via Similar Pretraining Data Generation
SGIOT
Springer
DOI: 10.1007/978-3-032-34048-1_5
Abstract
With the increasing global emphasis on environmental sustainability and renewable energy, solar power has emerged as a prominent method of energy generation. Accurate forecasting of solar energy output is essential for optimizing energy management and grid scheduling. However, in real-world applications, data availability is often limited due to constraints such as equipment costs and time-consuming data collection, making it challenging to train reliable predictive models. This study proposes a data augmentation framework tailored for small-scale time series datasets. The framework generates synthetic time series with similar statistical properties to the target data for model pretraining, overcoming learning limitations from insufficient real data to improve predictive performance. Additionally, this study leverages a channel-independence strategy proposed in prior research, allowing the proposed method to flexibly handle both univariate and multivariate forecasting tasks. A fusion module is also designed to integrate related features, further enhancing the model's ability to capture temporal dynamics. To validate the proposed approach, we conduct experiments on a real-world solar power generation dataset. Results demonstrate that, under data-scarce conditions, the pretraining method significantly improves performance across various model architectures, highlighting its potential and practical value in small-scale time series forecasting scenarios.

