I can give you a real answer. If you use go's image and color interfaces then boxing can stress the allocator if you process pixel by pixel.

But assuming you represent and process your image as a packed slice of rgba or something, the gc wont be in your way at all.

Source: led team that built production go image resizing and conversion services at walmartlabs.