Transgender women using the ladies loo? (Trunks)

This is a bit of a political hot potato in the US. Some are likening it to blacks not being allowed to use toilets for whites in the 1950's. Would it bother you much? Would you feel your wives, mothers, girlfriends, daughters would be put at risk by sexua..