Participant 1

Initial description: In the Test Input there are Light Blue squares and Black squares. The Light Blue squares form patterns. The patterns comprised of eight Light Blue squares, have their Light Blue squares changed to Red in the Test Output. Patterns consisting of more than or less than eight Light Blue squares have their Light Blue squares changed to Dark Blue.

Final description: Light Blue square patterns consisting of eight squares are changed to Red. Any other number of squares in a pattern are changed to Dark Blue.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 2

Initial description: If the shape touches the right edge of the grid, turn all square in the shape red, otherwise turn all squares in the shape dark blue.

Final description: If the shape is touching the right edge of the grid, turn all squares in the shape red, otherwise turn all squares in the shape dark blue.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 3

Initial description: I thought that the shapes stay the same as the input and I just needed to change the left and bottom shapes to dark blue and the right shape needed to be changed to red.

Final description: I thought that the shapes that were the same needed to be dark blue and the one that was unique needed to be red.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 4

Initial description: Change the colors to blue and red.

Final description: Change the color of matching shapes to the blue and make the other red.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 5

Initial description: Copy the shapes exactly as they are show in the input. Color the shapes that are the same blue and color the square that is different in red.

Final description: Copy the shapes exactly as they are show in the input. Color the shapes that are the same blue and color the square that is different in red.


Attempt 1: Correct

Participant 6

Initial description: I colored the figure that touches right edge, red and two other figures dark blue.

Final description: I colored smaller figure red and two other dark blue.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct

Participant 7

Initial description: Odd number of light blue shapes equals color blue. Even number of light blue shapes equals red.

Final description: I thought the red shape was in the upper right corner while the rest were blue.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 8

Initial description: Copy the test input then color the rightmost shape red and the other shapes dark blue.

Final description: Copy the light blue shapes from the test input. Then color the smallest shape red and the other shapes dark blue.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct

Participant 9

Initial description: The two shapes to the left side are a blue color and the shape to the right side is a red color.

Final description: I though that the two shapes closer to the left side would be a blue color while the shape farthest to right would be a red color.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 10

Initial description: Changed the color of the left and middle bottom shape to blue and the right shape to red.

Final description: Change the colors or the shapes to blue and red.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 11

Initial description: Replicate the two left-most shapes with dark blue, and the right-most shape with red.

Final description: Replicate the two similar shapes with blue, and the different shape with red.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 12

Initial description: the shapes remain in the same position, but the colors are changed to blue for the left ones and red to the top right corner shapes

Final description: I thought the only change was the color pattern, the position of the figures is the same in all puzzles


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 13

Initial description: i give correct input

Final description: i give correct one


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 14

Initial description: Change the color of the filled grids.

Final description: Change the color of the filled grids according to the shapes.


Attempt 1: Incorrect
Attempt 2: Correct