Tokyo is divided into 23 special wards, 26 cities, five towns and eight villages. Each of these will have it's own city hall. Services such as police are handled at the prefecture level.
This is the official answer. However, most Japanese people (and international observers) consider Tokyo to be a city. For example, everyone calls the Tokyo prefecture office ~ Tokyo City Hall.