The Lyme Center Academy building was built in 1839. For all but seven years up until 1994, it remained in service as a school and social center for Lyme Center. Through a public-private partnership, extensive renovations and restorations of the facility commenced in 1997 and were completed in 2002. The purpose of these was to convert the structure into a historical museum and modern community building while maintaining its historic character.