> Not sure how often I’d like to try uploading multi gigabyte files from a consumer internet connection with narrow upload bandwidth
It's 2023... this is a fairly standard use case (e.g. YouTubers uploading videos, etc).
It's 2023... this is a fairly standard use case (e.g. YouTubers uploading videos, etc).
If it were standard practice for many people, we might finally get symmetric cable. But most people aren't YouTubers. In my experience, people who aren't into tech usually have no idea their upload speeds are any slower than their download speeds, much less 25 times slower. They usually just let their phone upload their photos in the background, and it just works. Hell, I can't even find my upload speed on the consumer section of my ISP's site, only in a pdf for their business plans. Not even in legalese.
As a society we have something like a 20% CAGR on upstream speeds over the past few years. It may get better even faster, because DOCSIS 4 is coming soon and is full duplex over the same channels.
But even at 20mbps, uploading a 70B model might take you 12 hours... after you spent many hours fine-tuning it. It's annoying but not an unmanageable problem.
People who aren’t into tech aren’t trying to fine tune Llama2 and then upload it to a cloud machine
It's not that big of a deal as long as you don't sit there and stare at the progress bar the entire time.