I found these records concerning marriages of freed persons formerly residing in Caroline County, VA:

Alexander Ray m. Millet Shepphard. Original marriage date: 1847. Former residence: Caroline County, Virginia. No children.

Edward Shepphard m. Ellen Wing. Original marriage date: 1847. Former residence: Caroline County, Virginia. Four children.

Source: Freedmen's Bureau Online, Register of Marriages in Washington, DC