if you like visiting towns, then you definitely missed a lot. ibiza town is lovely.
go there in the early evening, before it gets dark, walk up to "dalt villa" (the old town on top, actually it says "high town" not old town) and enjoy the medieval feeling. then walk back down, have a nice dinner in town and then have some drinks in the port, in sa penya or plaza de parque.