Why did Talmadge seemingly overwhelmingly win rural blacks then?
He was Chairman of the Senate Agriculture Committee. I would assume he certainly did better with rural black voters (and rural voters generally, controlling for race) – this was also the case in the primary against Miller. Rural blacks had a much stronger interest in his re-election than urban blacks.
Remember, I'm not arguing that Mattingly did win black Atlanta. But it's within the realm of imagination, and it's certainly true that his relative success there won him the race. You can see very clearly how the nomination of a liberal with support from black Atlantans (Wyche Fowler) in 1986 forced Mattingly to rely on more suburban votes and ultimately led to his loss.
I am currently doing more research into the 1980 and '86 races and will update if I find anything of interest.