I use an HP T5720 that I got off of Ebay. I think i Paid right around $100.
yes, you can install remote management software. Most people use some version of VNC.
Check out this thread for more details on the thin client setup.
I would recommend search for "thin client". There are many threads on what to look for and some tips.