From what I understand, biological systems regulated by sex hormones require one or the other to work at all. For example, you get one pattern of post-puberty bone growth with estrogen, a different pattern with testosterone, and no bone growth at all if you have neither. These systems also have some counterbalancing factor, like your bones constantly being slowly dissolved to keep calcium in your bloodstream, so if you have no gonads and no supplementary hormones, you essentially speedrun osteoporosis over the course of a few years.
I'm not too clear on other effects, but a lot of things are downstream of "your bones slowly melt," and lots of other parts of your body rely on sex hormones to regulate them and will have long-term issues without them.
It doesn't have to be a full on quest marker HUD overlay, just being able to glance at a mirror of your phone's map display in your peripheral vision without taking it out of your pocket would be great.