Zion Baptist Church was constituted on August 5, 1826 with ten charter members. Conference was called for the purpose of electing delegates to the Yellow River Association and the election of two deacons. A pastor was called to serve one Sunday each month. During the early years of ZBC, slaves were received into the church. The minutes recorded:
"The following joined our church by experience from September 4, 1826 till September 14, 1826: 30 Caucasians and 3 African Americans. One African American, Sam Persall, felt the call to preach. After examination and hearing him preach from Zion’s pulpit, he was licensed to preach."
In 1840, Zion joined the Rock Mountain Association, which merged with Appalachia at a later date. A letter to the Stone Mountain Association is mentioned in 1872. No definite date is given when joining this Association. Always a Missionary Baptist church, the record shows donations being sent to Mercer University, and yearly support was sent to Foreign, Home, and Indian Missions.