The eyeglass brand grew sales solidly in the fourth quarter and year, but Wall Street wants more growth.