X30's are a little esoteric. I'm doing this by memory so we'll see how it goes.
First scan. you have channels added in software? Ok, you need to have at least two channels and a group added to envoke scan. There are two triangles above the alpha display. The left one is group add and the right one is channel add. To add or delete channels from the radio, press and hold the scan button then press the A/D button. To add or delete groups, press and hold the scan button, then press the group up or down button. Off hook scan is good and make sure both triangles are in the display.
Now for OST. I thought when it was set correctly, when you press the OPT button, it would flash " CODE XX" (XX= 1 to 16) for a second then go back to the display with the "OPT" lit. To change the OST, you would press and hold the scan button (???) and then press OPT. "CODE XX" would stay in the display and you could spin the rotary knob to change. Pressing OPT a second time would bring you back to the channel display with OPT (OST) enabled.
Not sure if I'm all correct, but try those and see where you get. If there is still probs, I'll dig into it further.