Wheather or not CB is or is not fun depends upon individual personality - let me explain from my own personal perspective on this. As a licensed amateur radio person (AA1MN) I'll do my best to provide as much of an unbiased view on the pros and cons of both CB and amateur radio operations as possible and there will, I'm sure, be those who have conflicting or additional views on what I have to say.
CB can provide an informative and entertaining source of communications and listening pleasure in the sense that, as has been indicated by previous posts, those who are on the airwaves are willing to provide assistance regarding traveling directions. If that's all you're getting it for keep in mind that GPS unit serves the same purpose. CB can be entertaining in the sense that there are some interesting characters out there who, at times, provide some rather racy opinions - if this doesn't bother you (it doesn't bother me at all) it is possible to partake of these conversations, maybe even stir up the pot so to speak, or just listen in on them. If however, such "wild and wooly" conversations are not your thing then CB might not be for you. Keep in mind though, that this is not by any means always the norm and that there is a channel selection and on/off switch which are there for the purpose of individual discretion when one finds or needs the ability to change the channel or switch off the unit when circumstances dictate.
Amateur radio, requiring a bit more initial investment than CB even when purchasing used equipment, tends to bill itself as being a "gentleman's" form of communications with people being more "polite" than those of CBers. Most of the people on the amateur bands I've heard and spoken to are polite and make every attempt to be of assistance whenever possible. However, due in part to the requirement of a license being required many - though not all - amateurs tend to be snobby regarding CB which is unwarranted as an amateur radio licensce does not in any way give the holder in any way shape or form the right to look down on those who do not hold an amateur license.
Also, my experience has also shown that there are many amateur license holders who feel that having said license makes them "professionals" when it comes to either operating on-air or being able to qualified to make, repair, build or putting a station together - this is not always the case as many, such as myself, are not proficient in the area of electronics; there are those who are, however, licensed electrical engineers or are proficient in other fields relating to electronics and radio broadcasting. Also, be aware that there are amateur radio operators on both the HF and VHF/UHF bands that do not practice courteous behavior on the amateur bands by talking over others, hogging frequencies and such - in other words, practices which many amateurs criticize CBers of doing.
In addition, there is some controversy amongst amateurs criticizing those who are not into CW (morse code) while those who do not often criticize those who are. This is not, by any stretch of the imagination, a constant but it does exist. Likewise, there are those who are also very protective of the modes they prefer to use (be it voice, digital, morse code, etc) versus those who don't - again, it does exist but is not entirely prevelant.
Lastly, regarding amateur bands, they can be very quiet as compared to CB unless there is a contest going or and when skip conditions are poor. In spite of the above, please understand that the amateur bands offers something for everyone and one can find their own interests groups of operators to spend time with as they can with CB.
In short, take some time and listen to and explore both CB and amateur bands before making a decision which is best for you. You just may find there's something in each which is appealing to you and you can enjoy the best - and worst - of both.