It's not a brightness thing, after all car headlights are probably 1000x brighter than anything you may have on your bike.

It's because 99% of bike lights are basically just flashlights, spraying light everywhere. The solution is the same as for cars — lights with horizontal cut-offs.