I also recommend book called The Slaves' War: The Civil War in the Words of Former Slaves by Andrew Ward. It's mostly about those who stayed.
Large cache of original records of escaped slaves 2015-03-21
A treasure trove of original accounts of how and why slaves escaped, who assisted them, and more.