do you need a anti fire for them?

Nope, but you'll maybe need an antifire shield/pot to get to them, as you'll have to go at least through a cave full of the adults (asuming you'll use a safe spot -not 'safespot'- in the Taverley dungeon where there are Babies and no adults). But as for the babies alone, they have no breath weapon.

I would suggest you stick to the baby blues near the gate that requires the key because the adult drags don't spawn over there.