Contribute
How to contribute
Bring a task, a model baseline, an evaluation adapter, or feedback on the protocol. Small, reproducible contributions can make RSI experiments easier for more people to run and compare. Every run follows the same five steps:
Start
Choose a task and model, then declare the run budget.
Iterate
The agent revises its solution, prompts, or tools over repeated rounds.
Accept
Use validation to check whether a change improves on the starting point.
Stop
End at the declared budget or round limit, and record resources used.
Test
Score the selected final solution once on held-out test data.
Public contribution window
Coming soon
We will open-source the benchmark and open submissions to everyone once its infrastructure is complete. Until then, write to us if you would like to bring a task or a model early.
jingdongz95@gmail.comjionghaow99@gmail.comyuhuaijin36@gmail.com