NanoForecast v0.6-HC β€” DART-Norm + High-Cardinality Ablation

Experimental checkpoint β€” DART-Norm (causal mean/std normalization) + HC channel expansion (8 channels for electricity/traffic) + 2x upweighting. Single-session training (100 epochs, ~10h on Colab T4).

Ablation Results

Dataset v0.5 MASE v0.6-HC MASE Change
ETTh1 0.681 0.834 +23% worse
ETTh2 1.110 0.760 -31% better
ETTm1 0.287 1.192 +315% worse
exchange_rate 4.317 14.058 +226% worse
electricity 2.029 0.421 -79% better
traffic 1.805 2.779 +54% worse
Overall 1.704 3.341 +96% worse

Ablation comparison

Key Findings

  • Electricity win is real: 0.421 MASE (79% improvement) β€” beats TimesFM's 0.923
  • ETTh2 improved: 0.760 MASE (31% improvement)
  • But exchange_rate/ETTm1 collapsed: DART-Norm too aggressive for some datasets
  • Released v0.5 remains official β€” adoption gate failed (traffic worsened)

Training Details

Parameter Value
USE_DART_NORM True
HC_MAX_CHANNELS 8
HC_UPWEIGHT 2x
Epochs 100
Best epoch 6
Wall time ~10h (Colab T4)
Loss MultiTaskLoss

Next Steps

Ablation notebooks available:

  • colab_training_v06_dart_only.ipynb β€” DART-Norm only (no HC)
  • colab_training_v06_hc_only.ipynb β€” HC upweighting only (no DART)

Built by Eulogik β€” deployable AI for the real world

Downloads last month
38
Safetensors
Model size
6.52M params
Tensor type
F32
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support