I remember reading something, possibly from the 19th century, about the look of a chronic masturbator. Sallow cheeks, pallid complexion, and a posture and demeanor suggestive of shame.
Author might have been John Harvey Kellogg, but I can't say for sure because current year internet is completely useless for finding anything other than propaganda from the (((usual suspects.)))
Point being, this notion has existed for quite a while. Seems like the kind of placebo effect kind of thing that becomes true because you believe it.