Why do we have state capitols?

What is the point of state capitols? It doesn't really designate anything, capitols aren't the largest city in the state (i.e. NYC versus Albany), it isn't the economic/governmental home of the state... so why do we have them?