Does that mean that on the other 364 days this year, you won't be wearing underwear (asking for a friend)?

No. A fever is normal part of your immune response. Your body can survive just fine at a higher temperature than bacteria and/or viruses can. Let them cook.

It might be uncomfortable but keep away from the antipyretics unless your temperature reaches 40C (104F). Also, keep yourself hydrated.