Veteranunits are those that have won three victories in battle or were produced in a city with a Barracks. A veteran unit gains +50% attack and defense and becomes an elite unit after winning three more battles.
All units except Settlers and Militia can achieve veteran status.
Civilization Wiki