If you think you need to change your feelings depending on whether on not someone can handle them, please stop. Your feelings are your feelings. They are not symbiotic with another person’s pain or happiness.
Your feelings are just that: how you feel. They do not have to involve blame or cause (‘you made me feel this way’).
They are just your experience, and your responsibility. How someone else responds to those feelings is theirs.