The actor is embracing wide-leg trousers