There are PC programs that will unscramble voice inversion scrambling. The catch is, it has to be simple "fixed" inversion, where the inversion frequency doesn't hop around. There are at least two free programs out there that will unscramble it. Speech inversion wouldn't be considered encryption, except maybe if it used a hopping/rolling code system.
Now, AES or DES encryption is another story, and is illegal to listen to decrypted, if you ever get that far.