Horace Memorial Hall was erected during the summer of 1885 by Thomas Martin. It memorialized his oldest son, Horace Burley Martin, who died March 13, 1885 at the age of 20. The building was occupied as a Baptist church for over 100 years until congregation numbers dwindled. The property was vacant for a number of years.
In 2017, the building was thoughtfully repurposed as 10 residential condominiums. Many original features remain including hardwood flooring, stained glass windows and components of the pipe organ.