Participant 1

Initial description: Same color then opposite color in each row

Final description: I could not get the rule


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 2

Initial description: All the shapes that are similar to the top left need to be pink.

Final description: All the shapes that are similar to the top left need to be pink.


Attempt 1: Correct

Participant 3

Initial description: red in the corner and thnen 4 pieces are red

Final description: there willbe 5 reds


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 4

Initial description: I think whatever letter is in the top right becomes red and then all the similar shapes also become red. Maybe this one is supposed to be entirely blue still though on second thought, as the input has no red

Final description: I think whatever letter is in the top right becomes red and then all the similar shapes also become red. Maybe this one is supposed to be entirely blue still though on second thought, as the input has no red


Attempt 1: Correct

Participant 5

Initial description: Change the color of the second object in the top third of the example. Do the same for the first object in the second third and the object in the most bottom right position.

Final description: Change the color of the second object in the top third of the example. Then make the same color change for all other remaining objects that have the same shape.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 6

Initial description: Find the shape in the upper left corner and color each similar shape the same color.

Final description: Find the shape in the upper left corner and color each similar shape the same color.


Attempt 1: Correct

Participant 7

Initial description: I used the corner figure eight as my guide for coloring all of the figure eight patterns red.

Final description: I used the corner figure eight as my guide for coloring all of the figure eight patterns red.


Attempt 1: Correct

Participant 8

Initial description: The same shape as far left are blue, the rest are red.

Final description: Similar shape as the top corner becomes the same color as it.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 9

Initial description: Replicate the overall pattern, but match the color of the shapes similar to the one in the upper left.

Final description: Replicate the overall pattern, except the shape in the upper left and the similar shapes should all be colored in red.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct

Participant 10

Initial description: I changed the shapes that were closed to red and left the open shapes blue.

Final description: I changed the 8's to red and left the others blue.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 11

Initial description: The object in the upper left corner was made red and all objects of the same shape, regardless of size were also turned red.

Final description: The object in the upper left corner was made red and all objects of the same shape, regardless of size were also turned red.


Attempt 1: Correct

Participant 12

Initial description: This rule suggests that the first shape should have the same color as similar ones in the grid.

Final description: I believed the rule wanted not only similar shapes to match the first shape on the upper left side, but also ones that may follow a similar pattern.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 13

Initial description: If there was a red shape in the input, the same shape would be red in the output.

Final description: The shape on the top left and the shapes that appear like it change to a red color in the test output.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct

Participant 14

Initial description: All patterns in the input that start in the top left corner and share the same pattern become red in the output.

Final description: All patterns in the input that start in the top left corner and share the same pattern become red in the output.


Attempt 1: Correct

Participant 15

Initial description: One shape was a different color on the output.

Final description: I am not sure what this one was supposed to be.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 16

Initial description: Change the color of an object at the top left corner to red and do the same with all objects of similar shape.

Final description: Change the color of an object at the top left corner to red and do the same with all objects of similar shape.


Attempt 1: Correct