The International Association of Department Stores said office wear now accounts for 24 percent of the business.