Impermanent Leaderboard

Live time-series forecasting benchmark on GitHub activity signals

Updated weekly Last updated — Paper Repo

Ranking based on total points across tasks

Model Performance Over Time

Metric
View
Dataset
Frequency
Sparsity

Click legend items to show/hide models. Hover for details.

Championship Points Race

Points awarded per week: 12 pts for 1st, 11 for 2nd, ... 1 for 12th. Cumulative total shows who leads the overall race.

Metric

Steeper lines = faster point accumulation = more consistent top finishes.

Championship Standings

Final leaderboard based on cumulative championship points. Points bar shows relative standing.

# Model Total Pts Avg Rank Best Wk Worst Wk Points

Rank Stability Heatmap

Average rank per model per week. Deeper violet = better rank. Spot consistency vs. volatility at a glance.

Metric

Detailed Results

Latest cutoff per filter

CRPS evaluates full predictive distributions. In intermittent count data, conservative forecasts (e.g., zero) can perform strongly.