Toxicity is about dosage, not the substance. Water is toxic if you drink too much, as is salt. Too much of a good thing, and all that. Organic oils are chemical, but are extracted rather than manufactured.
I would certainly endorse not spraying anything overly fragrant in a common area (shared...