Mathematical Frameworks for Non-Stationary Time-Series Imputation, Spatio-Temporal Generative Dynamics, and Out-of-Distribution Regime Shift Detection.
Real-world physical and econometric sensor streams—such as satellite atmospheric optical depth, meteorological cloud trajectories, and high-frequency market microstructures—violate stationarity and ergodic assumptions. Standard deep sequence models suffer from catastrophic variance under structural breaks and high missingness ratios.
This repository formalizes a unified probabilistic state-estimation framework combining Multivariate Singular Spectrum Analysis (MSSA) for structured matrix imputation, Spatio-Temporal Generative Adversarial Networks (GAN-LSTM) for manifold-constrained trajectory forecasting, and Non-Parametric Regime-Shift Stress Testing for out-of-sample (OOS) robustness verification.
Given a multivariate non-stationary stochastic process $\mathbf{Y}t = [y{1,t}, \dots, y_{M,t}]^\top \in \mathbb{R}^M$ observed over
Under the low-rank dynamical manifold hypothesis, latent state recovery is formulated as a spectral rank-truncation optimization via Singular Value Decomposition (SVD):
where threshold
To capture non-linear turbulent dynamics (e.g., cloud morphological evolution in AIAD), we parameterize the conditional transition density $p_\theta(\mathbf{X}{t+1:t+H} \mid \mathbf{X}{1:t})$ using an adversarial recurrent variational architecture:
where the generator
To prevent in-sample overfitting on non-stationary trajectories, model generalization is evaluated under strict chronological partitioning ($\mathcal{D}{\text{IS}} : \mathcal{D}{\text{OOS}} = 70 : 30$) and synthetic Black-Swan jump-diffusion perturbations:
where
Probabilistic-State-Estimation/
├── core/
│ ├── mssa_imputation.py # Block-Hankel trajectory embedding & truncated SVD recovery
│ ├── gan_lstm_dynamics.py # Spatio-temporal ConvLSTM generator & spectral discriminator
│ └── regime_shift_validator.py # IS/OOS chronological validation & jump-diffusion stress tester
├── benchmarks/
│ ├── satellite_cloud_trajectory.py # AIAD meteorological sequence prediction evaluation
│ └── synthetic_missingness_eval.py # RMSE / Spectral coherence under 10%~70% missing masks
└── docs/
└── spectral_state_bounds.md # Theoretical derivation of singular value truncation bounds
| Evaluation Task / Dataset | Missing / Shock Regime | Baseline (Linear / ARIMA) | Deep Baseline (Vanilla LSTM) | Ours (MSSA + GAN-LSTM) |
|---|---|---|---|---|
| Multivariate Imputation (RMSE |
40% Block Missingness | 0.412 | 0.289 | 0.114 (-60.5%) |
| Cloud Morphology Forecast (SSIM |
|
0.518 | 0.712 | 0.846 (+18.8%) |
| OOS Regime-Shift Stability (Max Drawdown / Error Spike |
|
3.84x degradation | 2.91x degradation | 1.22x (Bounded) |
Seungwon Lee (Simon Lee)
Department of Software (Artificial Intelligence), Chungbuk National University
Research Interests: Probabilistic State-Space Models, Neuro-Symbolic Program Synthesis, Bounded-Compute Systems.