I am beginning to search for the slave owner of my great great grandmother, Lucy Ann Madison. She was in the 1870 census for Pike County, GA with my great great grandfather - Isom Caldwell.

There were no white Madison's in the 1870 or 1860 census for Pike County, GA. There was a Plat Madison in the 1860 slave schedule, but he was from Warren Co, GA. Should I do research on him.