Having been a mage prior to arriving in Crystallis would allow him to be more familiar with his Job and magic in general, and so easilly get used to it and how to cast spells, elemental weaknesses and the likes; but wouldn't affect the potential/might of his magic. However, the Summoner Job would boost his magical abilities as a Red Mage quite a bit indeed and bring him closer to the level of a White Mage.