The First National Exchange Bank was organized in 1899 and for the first five years, was located with the Peoples Savings and Loan Association in the Robertson Block (south side of the square). In 1904, they bought this three-story, Neo-Classical Revival one-bay building at 114 East Poplar Street on the north side of the square. This bank had been established due to an outgrowth of a law that required savings and loans associations to deposit their funds in national banks.

The center portion of this block, including this building, was destroyed by fire in 1914. The facility was immediately reconstructed on the same site and completed in 1915. In 1975, the First National Exchange Bank again moved to the south side of the square, this time into a newly-constructed building at 119 East Court Street.

Banking concerns have always vied for space fronting the courthouse square. Ten structures within the district presently house, or once housed, banking facilities. The First National Bank, while currently at the same location, has since changed names and is now known as Star Bank.