Impermanent Leaderboard

Live time-series forecasting benchmark on GitHub activity signals

Updated weekly Last updated Paper Repo

Ranking based on total points across tasks

Model Performance Over Time

Metric
View
Dataset
Frequency
Sparsity

Click legend items to show/hide models. Hover for details.

Championship Points Race

Points awarded per week: 12 pts for 1st, 11 for 2nd, ... 1 for 12th. Cumulative total shows who leads the overall race.

Metric

Steeper lines = faster point accumulation = more consistent top finishes.

Championship Standings

Final leaderboard based on cumulative championship points. Points bar shows relative standing.

# Model Total Pts Avg Rank Best Wk Worst Wk Points

Rank Stability Heatmap

Average rank per model per week. Deeper violet = better rank. Spot consistency vs. volatility at a glance.

Metric

Detailed Results

Latest cutoff per filter

CRPS evaluates full predictive distributions. In intermittent count data, conservative forecasts (e.g., zero) can perform strongly.