No, I do it all the time.
In the terminals on both sides of the Security checkpoints feel free to listen all you want, but use an earphone and be discreet. If you are flying you can bring the scanner on the airplane but most airlines do not allow you to use it in flight. (dozens of threads on this subject, search them out....)