It makes me shudder as well, the first thing that comes to mind is the paperclip maximizer - https://terbium.io/2020/05/paperclip-maximizer/.