Born: August 11, 1832, Rutherford County, Tennessee.
Died: April 29, 1895, Eureka Springs, Arkansas.
Buried: Eureka Springs Cemetery, Eureka Springs, Arkansas.
Penn was the husband of Corilla Frances Sayle.
He was educated at the Male Academy in Trenton, Tennessee, and at Union University, Murfreesboro, Tennessee.
After reading law at the firm of Williams and Wright, he became an attorney and opened a law office in Lexington, Tennessee, around 1852.
He was an officer in the American civil war, spending over a year as a prisoner. After the war, he moved his family to Jefferson, Texas, where he returned to the practice of law.
Active in the church, he served as president of the Texas Baptist Sunday School and Colportage Convention, 1873–74. He was later ordained a Baptist minister, and was a well known evangelist in Texas, other American states, Scotland, and England.