An interesting comparison. The number of Slaveholders in the 1860 census in relation to the number of Families in the 1860 census.

It appears that at least 25% of the Families in the South were Slaveholders, with a high in some States nearing 45% Slaveholding Families.

For State by State details check the Historical Census Browser at this link shown. Enter Slaveholders & Slaveholding Families

http://mapserver.lib.virginia.edu/

Art Thomas