The previously planned cuts will lead to $50 million in severance charges for the Tommy Hilfiger and Calvin Klein parent.