Here's a possible:

EDWARDS, JESSIE (1900 U.S. Census)
North Carolina , CLEVELAND, SHELBY 6-TWP, Age 35, Male, Race: Black, Born: SC
Series: T623 Roll: 1189 Page: 155

I think that since you have quite a few females listed - you first need to find out who they married. Same for the boys who are young - who have fairly commen first names - like Robert.

Have you examined birth, death, marriage and tax records for Union and York counties? You could then determine how long some stayed.

DEnise