Hi Toria,
Your best bet in tracing his family is by using the tithables (tax records) along with estate records. You should also check for area histories and local memoirs, & diaries which sometimes mention free Negros in the area. If he bought his freedom - there should be a record.
Denise