Cross the Line
= to overstep a boundary, rule, or limit; to go too far or do something unacceptable
Ex: I know he was trying to tell a joke, but what he said “crossed the line.”
Ex: I don’t have a problem with you talking to my girlfriend, but taking her out for coffee is “crossing the line.”
