Elemental lead is bad but not that bad. It will mostly pass through the digestive system undigested. Especially something with a small surface area like a bullet.

Obviously still not something you want to do. But swallowing a bullet of any kind is probably not something you want to do anyways.

As I understand it, touching lead is actually worse than swallowing it because your skin is better at absorbing it than your digestive tract is. Also the toxicity comes from accumulation over time rather than accute exposure.