Read this blog post for an overview of the Atlanta Atlases from 1878 and 1928.
Many cities have renumbered their houses and businesses. The 1892 and 1926 Atlanta directories give both old and new house numbers because they were renumbered in those years. From Documenting Property in Atlanta
Many of Atlanta's City Directories are available via the Internet Archive and HathiTrust.