Inquiry about code sharing for Matbench

Matminer
1

I am planning to participate in the Matbench, however, I have encountered a problem regarding the code sharing requirement. During my experiments, I discovered that transferring learning from a proprietary pre-trained model yielded promising results. Unfortunately, I cannot publicly disclose all source code due to the restriction of the commercial model.

I would like to reach out to the competition administrators to inquire whether there is a possibility to not share all the source code.

Thank you for your attention, and I look forward to your valuable feedback.

2

Hi Wenwen,

For the matbench benchmark, we do require the ability for others to run the models themselves. The full requirements needed are listed here: 3 - Submit to leaderboard - MatBench

Note that we have a newer leaderboard called matbench-discovery:

That one has a section called “non-compliant models” that does allow for closed-source, closed weights models (but users need to click a button to show those models). The best contact for that one is @janosh .

Best,
Anubhav