Participant 1

Initial description: I changed all the shapes to look the same as those in the grey grills

Final description: choose one of the grill size inside the grey grill squire and color it orange


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct

Participant 2

Initial description: An objects color is changed if that same object can be found fully surrounded by gray squares (not cut off by the graph).

Final description: An objects color is changed if that same object can be found fully surrounded by gray squares (not cut off by the graph).


Attempt 1: Correct

Participant 3

Initial description: if the gray box is fully enclosed the symbol swaps colors.

Final description: if the gray box is fully enclosed the symbol swaps colors.


Attempt 1: Correct

Participant 4

Initial description: To make the designs even.

Final description: To enclose each of the designs in the gray squares like the example.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 5

Initial description: If the symbol shows up inside a grey box and there is more than one of the same symbols outside grey boxes, change all symbols of that type to the same color as the one in the grey box.

Final description: At first I thought it was any symbols where there were two or more outside the gray boxes would change to the color of the symbol in the gray box, but example 4 doesn't follow that pattern. I have no idea what the rule was.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 6

Initial description: Match the shape color of the object that is fully boxed in with gray

Final description: Match the shape color of the object that is fully boxed in with gray


Attempt 1: Correct

Participant 7

Initial description: Any shape in a grey box is kept its color and any shapes matching that shape turn the same color as the one in the box.

Final description: Any color in a grey box remains its same color in the output. However, the duplicate shapes not in grey boxes will change their color to the color in the box, but in this case, only if the original shape is COMPLETELY surrounded by grey on all sides.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct

Participant 8

Initial description: very easy and interesting

Final description: very easy and interesting


Attempt 1: Correct

Participant 9

Initial description: The shapes inside the grey boxes signal which ones should be that color outside the boxes.

Final description: The shapes inside the grey boxes tell what shapes should be that color outside. If it's just a partial box it doesn't count.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct

Participant 10

Initial description: Perfect

Final description: Nice


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct

Participant 11

Initial description: Shapes are the same. But the shapes that match the ones in the grey boxes should be changed to the same color

Final description: Copy the shapes as in the first diagram. Then, change the colors of the plus shapes to match the one in the grey box


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct