Put cauliflower florets into a sterilized 1-quart jar.
Bring vinegar, water, oregano, peppercorns, chili flakes, mustard seeds, and celery seeds to a boil. Pour over cauliflower. Let cool to room temperature, cover, and refrigerate for up to 2 weeks.