Your Emily Taliaferro could be the same as Emiline T. Mathews.

In 1870 census Emily Taliaferro is counted in a Port Royal, Caroline, VA household that includes:

MATHEWS, William, 28, farm laborer
Molly, 26, cook
Sallie, 6
Susan, 4
Phillis, 3
Henry, 2 months
TALIAFERRO, Emily, 10

In 1880 Emiline T. Mathews is counted in a Port Royal, Caroline, VA household including:

MATHEWS, William H., 37, laborer
dau--Sallie, 15, laborer
dau--Emiline T., 19, domestic servant
dau--Susan, 14, at home
son--Cyrus, 5
other--JONES, Lutisha, 18, servant