I originally thought the surname was 'unique enough' to attempt to do a surname search.
After an initial attempt, beginning in the 1870 census, I found close to 50 Percivals (and various spellings). Probably too many to search, without additional information.
[Interesting initial findings, even if no obvious ties were found to James.]
--------------
1870 Census:
Nancy Percival - Cross Keys, Macon, AL - bn abt 1810 SC, black, female

Alf Percival - Cross Keys, Macon, AL - bn abt 1830 SC, black, male

Mariah Pursifull, black female, born about 1821 in SC - living in Kentucky in 1870, with 14 yr old David Pursiful, black male (b. abt 1856).

1870 - Millie Percifull (b. abt 1800 in AL), living in Perry, Arkansas with "Tol" Percifull (1810, KY).

1870 - David Persefield (b. abt 1853) in Stoddard, MO

There are even some Percivals in Louisiana, in Jefferson Parish (new New Orleans).
May was born in 1798 (VA)!

Tidbits:
There is a Percival Road in Richland County (Columbia area), South Carolina. What is the significance of "Percival" in that area?

- 1850 Slave Schedules
Charlotte E Percival of Columbia, Richland SC
Neville Percival - Richland, SC
William F. Percival - Richland, SC

- There were Percivals in Richland County from 1797.

- There were also a few Percivals in Lynchburg, Virginia.

- Missouri had its share of Percivals - especially Howard and Buchanan counties - with birth years from 1828 through 1848 (last searched).

- Kentucky had its "Persiful / Perciful" familiies.

- Quite a few Percivals were noted in the Indian Census Rolls (1885-1930)

- Some in the NY / NJ area had birthplaces listed as "Ireland":
1850: Parcival / Perceval (bp Ireland)
------------------------
Don't forget that South Carolina and Georgia border each other.

The Wrights were in Lincoln county, GA - which shares a border with McCormick county, SC, as does neighboring Columbia County, GA. Look at when these counties were formed.

One additional note:
Review the spouses of the Wrights, who may have inherited 'servants' and/or brought them into the marriage.