Swan was born in Knoxville, Tennessee. Her served as a state circuit judge and as Tennessee Attorney General in 1851. He was mayor of Knoxville, Tennessee, from 1855 to 1856. He was an officer in the Confederate States Army at the start of the Civil War. He represented the state in the First Confederate Congress and the Second Confederate Congress from 1862 to 1865.