Participant 1

Initial description: Create a pattern connecting the 2 given shapes

Final description: Create a pattern stacking the 2 given shapes using the red as a guide for the direction to place shape.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 2

Initial description: The rule was to follow the grid pattern in the output and also change width and height to output sample/format

Final description: The rule was to follow the highlighted colors in the blue box, also change width and height to output sample/format


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 3

Initial description: The dark blue block stays where it is and the last block in the series goes on top or under it depending on where there is enough space.

Final description: The dark blue block stays where it is and the last block in the series goes on top or under it depending on where there is enough space.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 4

Initial description: left piece on bottom, right piece on top, middle piece signifies which goes where

Final description: left piece on bottom right piece on top as long as middle piece points up


Attempt 1: Incorrect
Attempt 2: Correct

Participant 5

Initial description: If there is space, place the third shape in the upper section of the input above the shape in the bottom space of the input. If there is not enough space above the shape, place the third shape below it instead.

Final description: If there is space, place the third shape in the upper section of the input above the shape in the bottom space of the input. If there is not enough space above the shape, place the third shape below it instead.


Attempt 1: Correct

Participant 6

Initial description: to stack the last object on top of the object at the bottom placing it mirroring the bottoms position

Final description: to stack the last object on top of the object at the bottom placing it mirroring the bottoms position


Attempt 1: Correct

Participant 7

Initial description: The orientation of the orange shape determines the orientation of the second shape relative to the first shape (whether it goes on top or bottom). The bottom grid on the test input shows you where the first shape goes on the output.

Final description: The orientation of the orange shape determines the orientation of the second shape relative to the first shape (whether it goes on top or bottom). The bottom grid on the test input shows you where the first shape goes on the output.


Attempt 1: Correct

Participant 8

Initial description: You have to copy the input and paste it on the output

Final description: I thought the rule was to copy and input. Next you were supposed to recreate the picture.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 9

Initial description: I thought figure 3 should be stacked on figure 1

Final description: I though figure 1 shouldn't move and should just be stacked by figure 3.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 10

Initial description: Color the bottom shape in the test input in the exact location and color the shape at the top right on top of that shape.

Final description: Color the bottom shape in the test input in the exact location and color the shape at the top right on top of that shape.


Attempt 1: Correct

Participant 11

Initial description: Stack two of the symbols on top of each other.

Final description: I thought I was supposed to put the two on top of each other.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 12

Initial description: Create a stack of shapes, beginning with the first shape in the input. Start the pattern at a horizontal location equal to that of the original test input plus the width of the shape to be stacked. Then stack the third shape of the input in the center of the shape already reproduced.

Final description: Use the third shape in the output as a base. Position the base horizontally at a location equal to its original distance from the left edge plus the length of the third shape of the output. Place the third shape in the output one unit above the base at the center.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 13

Initial description: I had to start at the bottom picture to know what figure to start with and its exact placement. Then I put the righthand figure either on top or bottom, wherever it would fit. The middle figure was useless.

Final description: I had to start at the bottom picture to know what figure to start with and its exact placement. Then I put the righthand figure either on top or bottom, wherever it would fit. The middle figure was useless.


Attempt 1: Correct

Participant 14

Initial description: Put the third object on top of the first.

Final description: I thought it was to put object 3 over top of object one.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 15

Initial description: Create a checkerboard pattern by alternating between two colors in each row.

Final description: Create a checkerboard pattern by alternating between 2 colors in each row.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 16

Initial description: The rule for this task is that the background needed to be a black 9 by 15 grid and that the shape from the bottom grid in the input needed to remain in the same position while the far right shape in the upper portion of the input needed to aligned with the bottom shape with at least one square of each sharing a border.

Final description: The rule for this task is that the background needed to be a black 9 by 15 grid and that the shape from the bottom grid in the input needed to remain in the same position while the far right shape in the upper portion of the input needed to aligned with the bottom shape with at least one square of each sharing a border.


Attempt 1: Correct