The former PVH executive will work with founders Tom Patterson and Erin Fujimoto to grow the underwear and loungewear brand.