The nearly 7-acre property in East Hampton has been owned by several style-setters.