Denji definitely has issues with men (which stems from the men in his childhood), they just haven't been explored as much as his mommy issues. Fujimoto might go deeper into it at some point, but I feel like that won't be for a while.