What type of help do you need? I am near Charles County. There has been extensive writings on the Proctor family of Southern Maryland. You may want to ask for help on the Free People of Color forum also.
Do you know the names of any of his family that did stay? What did he do that enabled him to buy and hold onto property?