It just says Buddha visited the "town" not the university. The town was a centre of Buddhism even before the University came into place.
Wikipedia says the following, "According to the Kevatta Sutta[13], in the Buddha's time N%u0101land%u0101 was already an influential and prosperous town, thickly populated, though it was not till later that it became the centre of learning for which it afterwards became famous."
