533 karma · joined May 24, 2017
An easy way (napkin math) to know if you can run a model based on it's parameter size is to consider the parameter size as GB that need to fit in GPU RAM. 35B model needs atleast 35gb of GPU RAM. This is a very simplified way of looking at it and YES, someone is going to say you can offload to CPU, but no one wants to wait 5 seconds for 1 token.
> The policy change is separate and unrelated to Anthropic’s discussions with the Pentagon, according to a source familiar with the matter.
Here's Sundar talking about doing it by 2027: https://www.businessinsider.com/google-project-suncatcher-su...
That's the biggest difference I can tell.
I didn't find any more on that comment below. Is there a list of supported LLMs?
Olive Garden isn't given access to something it requires to operate at the pleasure of the government. Broadcast TV on the other hand...
All of broadcast TV is allowed because the government says it is. ABC/CBS/NBC/FOX don't own the radio spectrum they are operating on, the government does and they grant the right to use it to those companies. There's a long list of things that the government requires them to do in order to keep this pleasure. One of them used to be the Saturday morning cartoons. I miss those.
*edit Case in point, downvotes in less than 30 seconds
Copy in copyright is a term for the actual writing that gets published on ads, or magazines, or in a news paper. "I need to get the copy from marketing for this campaign." "The editor hasn't approved the copy for the article yet."
Typically, people not in/around the industry aren't familiar with the term, which leads to the confusion.