Place the eggs in a large pan in a single layer and cover with an inch of water. Bring to a boil. Turn off the heat, cover the pan, and let sit for 12 minutes. Run the eggs under cold water and peel. Cut in half lengthwise.

Scoop the yolks from the eggs into a mixing bowl and mash with a fork. Add the mayonnaise, mustard, vinegar, salt, and pepper and mix well. Spoon or pipe the yolk mixture into the whites.

Dry the olives well and cut them in half lengthwise. Place 1 half on top of each deviled egg. Cut the remaining halves crosswise into 4 slices. Place 4 slices on each side of the olive half to resemble the legs of a spider. Refrigerate until serving.