When will this leaderboard update the evaluations of the new models?

#4
by JaxonJP - opened

thank you

HPAI@BSC (High Performance Artificial Intelligence at Barcelona Supercomputing Center) org

Hi @JaxonJP

We try to update the leaderboard on a monthly basis. Which new models are you interested in seeing added, and on which benchmarks?

Thank you for maintaining this project. I’ve been following it closely, especially because I’m very interested in the application of SOTA models to IC design.

For future updates, I’d especially like to see evaluations of the following models:

Open-source models:

Kimi 2.5

MiniMax 2.5

GLM 5

Step-3.5-Flash

Closed-source models:

GPT-5.4 / 5.3 / 5.2

It would be great to compare their performance on the current benchmark suite in the leaderboard.

Sign up or log in to comment