AWS sells a $100k 1u encoder box to broadcast companies. They buy that because there's hardly a 2nd best to speak of.
Encoding 15min of 8k source material on i9 9900k (that was 2019 and THE fastest CPU on the market) took me 19h.
Same for decoding, any mobile device will drink battery like it's water on Sahara.
Video is unusable without HW acceleration.
If thats your experience, then something is off with your setup.
Hardware decoding on a modern computer might seem equally fast as software until you look at power usage where hw decode is a hard win. Even so, the resources used to decode modern high end codecs like x265 or av1 will be major and hard to miss.
but anyway discussed are encoding &decoding.
And video encoding goes from like 3 fps in software to 100s of fps in hardware, making it possible at all with any resolution and quality to speak of.
You need encoding to stream your video, like in a video meeting.
Soft: ffmpeg -i {src} -map 0:v -f null -
Hard: ffmpeg -hwaccel cuda -i {src} -map 0:v -f null -
Source Hard Soft
1080p-h264 25.1x 37.1x
1080p-h265 26.4x 36.5x
4k-h264 5.5x 7.1x
4k-h265 5.5x 6.5x
See ffmpeg docs for the hw decoding name, like nvdec iirc for nvidia cards.
I've been working with video transcoding/broadcasts a lot and software decoding was still worth it in large amount of cases - mostly because the CPUs these days (threadrippers & co) can handle significantly more concurrent encodes than the HW decoders.
HW decoders are built to play video on your PC so you can watch a movie and usually don't supoprt all that many concurrent streams and aren't all that fast (they "just" need to be realtime, after all). That's amazing on playback devices (pretty much mandatory for H.265/AV1), but for "2U racks at Amazon" that's not very useful and large cored CPUs are still kings. Especially since software encdoders are still massively winning on visual quality per second per MB of video.
(Why am I talking about servers? Because this thread has started with AWS 2U video racks, not Apple TV boxes.)