Smaller, newer brands — and those with lower price points — are expected to be hit the hardest.