×
Success! Indicates a successful or positive action.

About robotbenchmark

robotbenchmark offers a series of robot programming challenges that address various topics across a wide range of difficulty levels. These benchmarks are provided for free as online simulations, based on a 100% free open source software stack. The performance achieved by users is recorded and displayed online.

Welcome

Participation is open to anyone, free of charge.

Choose a difficulty level

There are 5 difficulty levels:

Use an online robot simulator

The simulations run in the cloud and are made available to you through this web site. You don't need to install any software on your computer. The documentation of the online robot simulator is available on the help page.

Join our community

Do you have questions about robot programming? Do you need to discuss strategy ideas?

Come and join our Discord live chat channel.

Program robots using different languages (soon)

Currently, robots can be programmed only in Python. However, other programming languages such as C, C++, Java or Blockly will be supported in the future.

Compare performance with others

There are two types of benchmarks: absolute benchmarks and comparative benchmarks. Absolute benchmarks feature a scalar evaluation metric to assess the performance of a robot. It could be for example, the time taken by a humanoid robot to run a 10 meters race. Comparative benchmarks (to be available soon at robotbenchmark) oppose the performance of a robot to another robot without providing a scalar evaluation metric. It could be for example, a robot soccer game. Comparative benchmarks yield to a ranking of the robots, relatively to each other.

Keep your code private

The users keep the intellectual property on the source code they submit to robotbenchmark. robotbenchmark will not publish any user source code nor disclose it to any third party.

Share your achievements

robotbenchmark provides marketing tools to help you communicate about your programming achievements. Your robotbenchmark public user profile page summarises how well you performed on the various benchmarks.

Browser compatibility

This table refers to the latest versions of the browsers.

OS / Browser Chrome Firefox Opera Edge Internet Explorer Safari
Windows
macOS
Linux
Android
iOS

Going further

Our goal at robotbenchmark is to foster a better research in robotics, by providing scientifically challenging benchmarks that users can reproduce to compare their achievements. We are working towards this goal together with a number of partners, including: We are looking for more partners to further develop robotbenchmark. If you have an idea for a new benchmark, inside or outside of robotbenchmark, please drop us a message at info@robotbenchmark.net.

100% Free Open Source Software Stack

The robotbenchmark web service relies on the free open source software Webots. This software runs robot simulations in the cloud and displays the results on the robotbenchmark web site in 3D, interactively. The full source code of the robotbenchmark web site is available here. If you would like to run a similar web service, for any purpose, we will be happy to help you.

Privacy Policy

We are not going to make any commercial exploitation of the data we are collecting from you. More information is available on our Privacy Policy page.

Contact us

You can contact us directly at info@robotbenchmark.net.