Square tiles are the basic quantum of location in Civilization IV. All units and cities are located in a particular tile. You can see tile boundaries clearly if you turn on the "Show Grid Lines" feature.
Tiles have terrain, and may have any number of units present. They may also have a city. Tiles have culture infusing them, and will be owned by no more than one civilization: the one with the most culture present.