Normally independent castles are due to magic sites of the non-magic variety.  Inside you usually find whatever independent units that the province can make, there's usually nothing special in there.
Although, in one of my games recently I attacked a province with 60ish Lion Tribe guys and when the turn came back Bogus and his merry band of heroes was there defending it.  So you never really know, right?  
