I seem to recall building small AM transmitters in elementary school. I don't remember if I used a transistor or not. I think it was easy to construct the capacitor and the inductor. (I build it in the early 70's and don't really remember how.)
We also made crystal diode radios, but I have no idea how to construct a diode from scratch, so maybe those are not simple.