Drain the olives and place in a small saucepan. Add the rest of the ingredients and heat over low heat until warm and fragrant. Take off the heat and let sit at room temperature. The longer they sit, the better.

Transfer to a serving dish with a slotted spoon and serve. Can be made several days ahead. Store covered in the refrigerator. Can be served warm or at room temperature.