With recent tariffs targeting imports from China and Mexico, U.S. retailers and manufacturers in textiles and apparel face significant challenges.