1510s, "itinerant apple-seller" from coster (see costard) + monger. Sense extended from "apple-seller" to any salesman who plied his wares from a street-cart. Contemptuous use is from Shakespeare ("2 Henry IV"), but reason is unclear.