Find a used commercial UHF radio that has Part 95 certification.
Back when I was active on GMRS, I used mostly Icom commercial radios.
Most Kenwood mobiles have Part 95, so they are a good option, also.
You'll have to program them yourself, but with Icom and Kenwood, that's pretty inexpensive. You'll need the radio specific software and cables.
If you haven't programmed commercial radios before, it can have a bit of a learning curve, but as radios go, the older Icom and Kenwood's are pretty easy.
For the base, just get a 15 amp 12 volt power supply.
Make sure you consider your antenna system. It'll make the biggest difference in how well your system performs.