Participant 1

Initial description: Outline all the shapes in red. For the shapes that have an area not colored in, change those areas to pink. For the shapes that have a pink area, change the rest of the area to light blue.

Final description: Outline all the shapes in red. For the shapes that have an area not colored in, change those areas to pink. For the shapes that have a pink area, change the rest of the area to light blue.


Attempt 1: Correct

Participant 2

Initial description: paint inside the shapes into magenta and cover the shapes with red

Final description: paint the empty area in the shapes with magenta and cover them with red


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 3

Initial description: If an island inside a shape exists, color it pink, then transform the tiles in the field around it light blue, outline everything in red.

Final description: If an island inside a shape exists, color it pink, then transform the tiles in the field around it light blue, outline everything in red.


Attempt 1: Correct

Participant 4

Initial description: Outlining the shapes in red. Fill the yellow squares in the shape pink. And the shapes with pink, fill the outer shape with grey.

Final description: Outline shapes in red. Fill yellow squares inside shape with pink. The shapes that have pink fill the outer squares in a teal grey.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 5

Initial description: add a red border around all of the input squares and change the color

Final description: copy an put the colors around the boxes


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 6

Initial description: Create an one cell outline of Red on the outside of the Blue boxes. If a section of Yellow is enclosed by Blue, change the Blue to Light Blue and the Yellow to Pink.

Final description: Create an one cell outline of Red on the outside of the Blue boxes. If a section of Yellow is enclosed by Blue, change the Blue to Light Blue and the Yellow to Pink.


Attempt 1: Correct

Participant 7

Initial description: Put orange border around shapes, fill spaces inside shapes with pink.

Final description: All shapes need to have orange border. Any yellow inside the shape should be turned to pink. If a shape with orange border contains yellow, then turn all the blue into cyan.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 8

Initial description: red outlines and pink fill ins on the yellow. I did that. i don't see what i did wrong.

Final description: I forgot to fill in the center with teal. I noticed that right after the first mistake


Attempt 1: Incorrect
Attempt 2: Correct

Participant 9

Initial description: Outline the dark blue blocks in red.

Final description: Fully outline the preexisting dark blue shapes in red. No dark blue should be touching yellow even at the corners. If the shape had a hole in it, recolor the shape to light blue and fill in the hole with pink.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 10

Initial description: Matched 4 object grid

Final description: 4 object matched those with openings colored pink


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Correct

Participant 11

Initial description: Outline each shape in red while changing shapes with yellow spaces inside to a light blue color and changing yellow spaces to purple.

Final description: Outline each shape in red while changing shapes with yellow spaces inside to a light blue color and changing yellow spaces to purple.


Attempt 1: Correct

Participant 12

Initial description: Outline the blue shapes in red, fill the top left shape with light blue and add 9 pink squares in the top right corner.

Final description: Outline blue shapes with red and add 3 pink squares in a row to lower left shape.


Attempt 1: Incorrect
Attempt 2: Incorrect
Attempt 3: Incorrect

Participant 13

Initial description: Outline the blue shapes in red. If the blue shape has a hole, fill it in magenta and make the blue lighter.

Final description: Outline the blue shapes in red. If the blue shape has a hole, fill it in with magenta and make the blue light blue.


Attempt 1: Incorrect
Attempt 2: Correct

Participant 14

Initial description: The groups of blue boxes are surrounded by red boxes in output. If there is a yellow area inside, they get turned to violet and the surrounding blue boxes become light blue.

Final description: The groups of blue boxes are surrounded by red boxes in output. If there is a yellow area inside, they get turned to violet and the surrounding blue boxes become light blue.


Attempt 1: Correct