Relaxed and refined, the actor’s look was a fun take on gender agnostic dressing