Listening to hams (particularly local ragchewing nets) can be a <cough> mixed experience, yes.
However, if some Dave is rambling on about his prostate in Alaska, 7,000 kilometers away from me and (due to the same high latitude) a difficult to receive spot on the planet here -- the first thing I may experience is happiness, because I never managed to hear a ham from Alaska in 40 years of SWLing! During these years I also learned why exactly that particular connection is difficult and that's why I don't really hear what Dave's has to say about his prostate, what I hear is how his voice gets bullied by aurora on its way over the pole*, I can literally hear the big generator in our planet interacting with the space weather it's flying through and I try to imagine what way the signal may have taken along the grayline. Nerdy stuff, I know.
Also, since so many countries have given up on shortwave services of all sorts, hams are the last sources of signals from many spots on the planet, and they have always been activating spots far beyond the reach of civilization. It can be fun to collect "ham radio countries" and a rewarding challenge to log (and be it just in your brain) the rare and distant ones. I've collected quite a few but the best thing is - there's always more to hunt!
Sometimes you may catch things that are a bit out of the ordinary, stuff like the FO (and licensed ham) of a Lufthansa flight over the North Atlantic getting bored and tuning one of their 2 HF transmitters to have a little chat on 20m, guys transmitting off bicycles, a guy with a 25W backpack radio standing with both feet in the Atlantic ocean talking to someone in France, or just a lady on a yacht with a 100W radio mooring on some godforsaken South Pacific island on (almost) the antipodal spot on the globe 17,000km away, reporting back home to their ham friends. I could read her longer than the hams she was talking to - using super thin enamel wire harvested from an old transformator, connected to an old tube receiver I got for free.
Admittedly, this kind of fun is derived from the rather technical/physical and high performance side of shortwave radio but you don't have to dig really deep into anything to understand, master and enjoy the challenges it brings. And occasionally, hams do talk about interesting things too!
* Here's an example:
That's not "Dave" and luckily he's not talking about his prostate but if you listen carefully you can hear the warbling sound caused by the earth's magnetic field concentrating charged particles from the solar wind over the north pole. That was recorded in a "quiet" phase though, when there's solar storm conditions causing visible aurora things can get really crazy.