We had cats before I got pregnant. My husband changed the litter box, so I wasn't at risk of toxoplasmosis. Just keep her away from the litter box, that should be fine. She doesn't need to handle the litter at all.
As far as cats being territorial, I think it depends on the cat. We had a Siamese cat when my oldest son was born. The cat came over, sniffed him, then curled up at the end of the carseat. After that, he often sat by the baby, but he never tried to hurt him, never tried to lick him in the face. He was great. I think if you got a kitten, you'd be fine. Besides you might need the practice.
I would suggest, however, that if you do get a cat and plan on keeping it in the house, that you have it declawed (at least on the front feet). That would alleviate any chance of "Cat Scratch Fever."