My father has been able to make the connection between our family, that is now predominantly white, and the Suriname Ellises, some of whom are living in the Netherlands, who are colored. Our family was of Dutch origin, originally called Elles, and settled in Curacao around the time that you mentioned. They were "planters" and thus probably slave owners.

But the connection intrigues me, because some of the details you mention are very accurate (1690).