Did you use an amplified speaker? The headphone output cannot drive a speaker directly. Needs to be an amplified speaker.
Well, in part that, but mainly that the earphone output only puts out very low wattage (sorry I don't know the number offhand, but likely around 250 mW).