Participant 1

Initial description: Zoom in on the pattern on the left side of the input

Final description: Zoom in on the pattern on the right side of the input, and color match it to the pattern on the left.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 2

Initial description: leave to black squares in the center bottom

Final description: to match the colors in the grid


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 3

Initial description: The shape on the right stays the same and the grid goes 3x3. The color is determined by how many squares make up the shape

Final description: The shape on the right stays the same and the grid goes 3x3. The color is determined by how many squares make up the shape


Attempt 1: Correct

Participant 4

Initial description: Match the second design from the image by filling in the grey blocks with a color and leaving the remaining blocks in black.

Final description: Match the second design from the image by filling in the grey blocks with a color and leaving the remaining blocks in black.


Attempt 1: Correct

Participant 5

Initial description: I was trying to figure out a pattern with the test input

Final description: I couldn't figure out the rule


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 6

Initial description: I thought the rule was to put 3 up and 3 across and fill with green squares.

Final description: I thought the rule was 3 squares up and 3 squares across filled with blue.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 7

Initial description: Reduce the grid size to 3x3 and duplicate the Output 2 shape (a fat lowercase 'h') using the green color as fill.

Final description: Reduce the grid size to 3x3 and duplicate the Output 2 shape (a fat lowercase 'h') using the green color as fill.


Attempt 1: Correct

Participant 8

Initial description: The output was the shape on the right of each pair fit to fill the 3X3 matrix.

Final description: The output was the shape on the right of each pair fit to fill the 3X3 matrix with the color determined by the shape on the left.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 9

Initial description: The rule was to create a u-shape with a missing block.

Final description: The rule was to create a u-shape with a missing block.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 10

Initial description: The empty space to the right is filled with a random color.

Final description: The letter on the left decides what color to fill the shape on the right. The S corresponds with green.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct

Participant 11

Initial description: Only use the second half of the grid.

Final description: Left side controls the color. Right side is the shape.


Attempt 1: Incorrect
Attempt 2: Correct