Honestly the skill seems only psychologically slower than the others, since you're getting a steady stream of tiny gains as opposed to the more sporadic, randomized chunks you get from fishing, mining, and woodcutting. I don't recall getting 30 fishing in a few minutes, either. In fact I'm sure it took longer than divination did.