Im just learning most of whats good or not in viking conquest right now too.
Problem is in late game everybody got max tier units, and the generic merc guys only advance up to one or two tiers less than specialized units (like nord veteran/nobles). Like you said, they are good for filling in right now and being decent fighters. The merc/bandits are good for early to mid game.