trouble with women; woman trouble
Refers to romantic or personal difficulties, misfortunes, or scandals caused by involvement with a woman, typically from a man's perspective. Often used in set phrases like 女難の相 (a physiognomic sign of woman trouble).
See also: 女難の相
They say he has the physiognomy of a man destined for woman trouble.
That actor ruined his career because of trouble with women.