Excellent question Zeh. Excellent follow-up comments too. Many years I've used SDRs. Noise knows no boundaries and it can come from many sources. Sometimes noise cannot be completely eliminated but can only be mitigated to a tolerable level.
I just got an AirSpy HF+ Discovery myself, a great receiver. Your Airspy HF+ Discovery will come with a USB cable that has a few in-line chokes installed so that's a good start. Check to make sure that still is the case when/if you buy one.
First off, your computer and it's power supply can generate noise. Depending on the band I've found that unplugging the power cord from the laptop helps sometimes.
Household appliances can generate noise too. Hardest cases are those that cycle on and off (e.g. heat pumps, central a/c units). For example, my pellet stove generates terrible noise on the AM broadcast band when it turns on and I lessened (not eliminated) that by wrapping an extension cord around two huge toroid cores and plugging the stove power cord into it.
If you suspect a household-generated noise source you can do this: have someone by the SDR and go to the electrical panel box and switch suspect breakers on and off. Or just unplug the suspect appliance(s) to see if it's the culprit.
Antennas are a source of noise. I use an outside vertical antenna that picks up noise from all directions. They're notorious for that but it's also omnidirectional on receiving so that's my choice. You could try using a loop (I've used the W6LVP with excellent results) to null out the noise. I mounted mine a rotator for best results. Note that it's for receive only and requires a power source. But I sold mine last year; what was I thinking? Also, when choosing a site for your antenna installation you may find that noise varies depending on the location too.
Palomar-Engineers has some good tips on noise reduction, Google them for info. Hope this helps and enjoy SDR.