An exception would be someone who uses it ironically. My son would sometimes refer to himself as a soy boy because he's not interested in conforming to traditional masculinity and drives a Prius.