How is it that Co2 is such a deadly gas ?

I recall quite vividly from school that plants take in carbon dioxide, use it in photosynthesis, and release it as oxygen. Now if I'm recalling this correctly, why are people running scared of co2 suddenly ? Every breathing animal exhales carbon dioxide. Should we all be regulated on how much we are allowed to exhale ? These are serious questions, by the way.