A proposal to add a dozen retail stores, luxury apartments and affordable housing to the hotel has local residents divided.