In Fable III you can have only two per wife. Plus you can adopt as many as you can find homes for.
In Fable II you can have around 5 to 7 per household. There have even been claims of having eight with the same spouse. None of them are the unborn child mentioned in The Vision.