What you describe is typical of the unlearned. Allow me to relieve you some of your burdensome ignorance.
https://en.wikipedia.org/wiki/Maitr%C4%AB
>In Buddhist belief, this is a Brahma-vihara (divine abode) or an immeasurable that leads to a meditative state by being a counter to ill-will. It removes clinging to negative state of mind, by cultivating kindness unto all beings.[16]
Such cultivation does yourself a favor first and foremost.
>The "far enemy" of Metta is hate or ill-will, a mind-state in obvious opposition. The "near enemy" (quality which superficially resembles Metta but is in fact more subtly in opposition to it), is (attached) greed: here too one likes seeing a virtue, but for the wrong reason.[17][18]
Emphasis added to show how unskilled practices tend to increase, rather than decrease, your angst. You're manipulated by your attachment to an outcome.