Hello. I am looking for an ancestor whose name was Isham Smith married to Penelope Smith in Virginia.

According to the marriage records of the children, Isham and Penny were the parents. I find Penny easily but without Isham in 1870 with the children. I do see an Isham Smith in 1860(free)in James City, Virginia which fits, and another Isham Smith in 1850, owner of 3 slaves in Chesterfield, VA.

My question: Is the Isham Smith in 1850 Black? Thanks in advance for your help.