The island retreat has hosted everyone from supermodels to Vogue editors.