Participant 1

Initial description: In the Test Input there are Light Blue squares and Black squares. The Light Blue squares form patterns. The patterns comprised of eight Light Blue squares, have their Light Blue squares changed to Red in the Test Output. Patterns consisting of more than or less than eight Light Blue squares have their Light Blue squares changed to Dark Blue.

Final description: Light Blue square patterns consisting of eight squares are changed to Red. Any other number of squares in a pattern are changed to Dark Blue.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 2

Initial description: If the shape touches the right edge of the grid, turn all square in the shape red, otherwise turn all squares in the shape dark blue.

Final description: If the shape touches the right edge of the grid, turn all square in the shape red, otherwise turn all squares in the shape dark blue.


Attempt 1: Correct

Participant 3

Initial description: I thought that the shapes stay the same as the input and I just needed to change the left and bottom shapes to dark blue and the right shape needed to be changed to red.

Final description: I thought that the shapes stay the same as the input and I just needed to change the left and bottom shapes to dark blue and the right shape needed to be changed to red.


Attempt 1: Correct

Participant 4

Initial description: Change the colors to blue and red.

Final description: Change the colors to blue and red.


Attempt 1: Correct

Participant 5

Initial description: Copy the shapes exactly as they are show in the input. Color the shapes that are the same blue and color the square that is different in red.

Final description: Copy the shapes exactly as they are show in the input. Color the shapes that are the same blue and color the square that is different in red.


Attempt 1: Correct

Participant 6

Initial description: I colored the figure that touches right edge, red and two other figures dark blue.

Final description: I colored the figure that touches right edge, red and two other figures dark blue.


Attempt 1: Correct

Participant 7

Initial description: Odd number of light blue shapes equals color blue. Even number of light blue shapes equals red.

Final description: I thought the red shape was in the upper right corner while the rest were blue.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 8

Initial description: Copy the test input then color the rightmost shape red and the other shapes dark blue.

Final description: Copy the test input then color the rightmost shape red and the other shapes dark blue.


Attempt 1: Correct

Participant 9

Initial description: The two shapes to the left side are a blue color and the shape to the right side is a red color.

Final description: The two shapes to the left side are a blue color and the shape to the right side is a red color.


Attempt 1: Correct

Participant 10

Initial description: Changed the color of the left and middle bottom shape to blue and the right shape to red.

Final description: Changed the color of the left and middle bottom shape to blue and the right shape to red.


Attempt 1: Correct

Participant 11

Initial description: Replicate the two left-most shapes with dark blue, and the right-most shape with red.

Final description: Replicate the two left-most shapes with dark blue, and the right-most shape with red.


Attempt 1: Correct

Participant 12

Initial description: the shapes remain in the same position, but the colors are changed to blue for the left ones and red to the top right corner shapes

Final description: the shapes remain in the same position, but the colors are changed to blue for the left ones and red to the top right corner shapes


Attempt 1: Correct

Participant 13

Initial description: i give correct input

Final description: i give correct one


Attempt 1: Incorrect
Attempt 2: Correct

Participant 14

Initial description: Change the color of the filled grids.

Final description: Change the color of the filled grids.


Attempt 1: Correct