Henry Barnett’s grandfather, B. J. Barnett, emigrated from Estonia in the 1830s or ’40s and settled in Manville, South Carolina. He fought for the Confederacy in the Civil War and, around 1880, moved to Sumter where he opened a dry goods store and became a landowner and cotton farmer. Henry married Patty Levi, also of Sumter, and a descendant of Moses Levi, who had emigrated from Bavaria and settled in Manning, South Carolina.