A videogame for instruction following

The screenshot shows the initial situation in a warehouse simulation with a robot in the middle. The robot has to follow orders shown on the bottom of the screen. The human player can move the robot with the arrow keys. To fulfill the first task the robot navigates to the blue room

... pickup the box and brings it to room D.

Then a new order is shown on the screen. For each successful executed task the robot gets a score.

There are different order categories available, sometimes the robot has to transport a box and sometimes he simply has to navigate to a room.

The overall idea is that the game eingine decides with a random generator the next task, shows the order in natural language on the screen and the human operator has to execute it. So the warehouse simulator is a text to action videogame.

From a technical perspective it was realized in 350 lines of code in Python with the pygame library. There is a class for the robot navigation, another class for the task manager and some drawing routines for the game.