Apple releases MGIE, an AI-based image editing model
appleinsider.com
appleinsider.com
Meta is the real wildcard here. They're betting on "commoditize your compliment" and hoping by making GenAI training nearly free (by doing it for you) that none of their competitors can use GenAI models to gain an advantage over them.
Even Meta's ML research has a history of open sourcing everything, hello PyTorch. So Llama is just a continuation
But you're right they do have a good history of open source, and they should get credit for that.
They don't want to be left behind with a "everyone with an Nvidia GPU can play" world. Open-source is the best counter to that right now.
https://instances.vantage.sh/?min_gpus=1 (wait for it to finish loading to filter)
You could try running these in Google Collab (though tweaks would have to be made to load the files), or you might try something like runpod.io, as well, which gets you GPU instances for a lot less than you'd pay with AWS - for example, a Tesla V100 (16GB) community cloud instance runs you $0.24/hr vs the g5g.xlarge which runs you $0.42/hr.
It's research code, not a product. I don't think Apple would ever productionize anything with data lineage from Stable Diffusion.
https://huggingface.co/spaces/tsujuifu/ml-mgie
(Long queue, I could not test it)
If I had to guess, I think Apple Research may have some institutional obstacles to getting research work out there. Perhaps this could indicate those walls are continuing to dissolve bit by bit?
It seems like they are biding their time and avoiding the hype knowing that they don't need to get their first. If they can produce a superior product their brand will let them dominate those markets whenever they decide to release.
My interest in VR is basically solely for gaming, so the Vision Pro for me is a complete miss and I have no plans to purchase one. That being said, in the realm of productivity VR, I'd say they are dominating in that they're the sole entrant to the market that I'm aware of and their offering is extremely compelling.
So, the question is this. If you know anyone who actually got VP. Are they using it obsessively? I got occulus rift a while ago and so did many of my friends. We bought it but never really used it. Like probably a few times in a year to show friends.
I've also used it for reading, watching movies, and reminiscing over old photos. Something I don't think that has really been captured well in reviews is how incredible it is to look at life-size recreations of photos you took on your phone, even plain old 2D ones. There's something really special about seeing a photo at life-size scale wherever you want, even if you technically can achieve this with a massive projector. And that's to say nothing of the bittersweet nostalgic nature of spatial video / photos, which has, if anything, been profoundly understated.
It is not my first headset. Previous to the AVP, I owned Quests 1, 2, and 3, and I experienced the Rift before that. I tried, hard, to work all day in each of the Quests as that was my primary use case for them, but flamed out after a couple of hours every time.
Or, if you are using virtual desktop, you can use your mouse and keyboard to control VP natively as well. The only drawback is that this may not work if you are on VPN (even if the desktop comes through OK). I'm hoping this is a software issue that will get straightened out soon.
On the weight front, it's significantly lighter than a Valve Index, by roughly 20%, and that's just the unit I'm pretty sure, the Index has an umbilical cord that is not-insubstantial in mass by itself that dangles off the back of your head, so already the Vision Pro is quite far ahead on comfort.
VAC is of course a factor in any headset and this really comes down to the per-user situation: I personally got my "VR legs" in about thirty minutes way back when I got started, and am able to use full motion movement pretty well now with only minimal vertigo when things go up and down too fast for my brain's liking. However, the VP is going to have a distinct advantage here with it's big complicated camera system that allows it to operate both in VR and in AR, with most applications seeming to live in the latter realm. I think that's going to lend itself to big comfort gains for people who aren't as blessed as me in that regard.
Isolation also is much improved with the VP, what with it employing again, the camera system, and also the fact that the Vision Pro (much like my Valve Index) doesn't cover or obstruct the ears. And you get those weird CG eyes you can plaster on the front of the thing, haha.
Like again, I don't know if this will work out long term, I'm interested to see if it will really. But I see people keep comparing it to other headsets and as a fervent enjoyer of many of these headsets, I really cannot overemphasize how bad that comparison is.
Wearing a headset / computer on your face is a cost (vs wearing nothing) that the value prop gotta offset. We’ll see if it is a net positive, worth the tradeoff for a significant amount of people. Previous evidence indicates it isn’t.
This might sound trivial but it determines how long the user is able to use the device exclusively without relying on their phone, computer, etc which is a major factor in it being used at all.
A graphics card could make your spreadsheets go faster, but that's not really why they bought them.
It's plausible, however improbable, that a VR headset targeted at Serious Business Reasons could open doors that entertainment has not. And in particular, slightly unwieldy price points that can be rationalized a bit easier.
A decade of crappy Palm, WinCE, and easily forgotten Java based mobile devices came and went before iPhone.
They know what software people refuse to accept; it’s the hardware experience that matters and they’ll wait until the hardware is there.
Modern hardware is responsible for AI, more reliable networks, and the rest of modern compute. Has little to do with the bloated software stacks we git pull into the data center
Edit: Also consider that Intel and Apple don’t just make a consumer device. They design an advanced manufacturing pipeline. The difference between print(“hello world”) and for index in array: print(contents of index)
That’s the basis of their value and why they are propped up by government and why software focused startups will always just be pump and dump schemes.
The first mover advantage gives you a chance to get most of the market share, but with Apple's walled garden, they don't need the first mover advantage to do that.
Other MP3 players existed, but flash media was too small. Other hard drive players existed, they were too big. And both had bad interfaces (by Apple standards).
Apple didn’t show up until they could meet all their goals.
They could have made a phone sooner, it wouldn’t have been the iPhone. They could have made a headset sooner, it wouldn’t be the Vision Pro.
They set their standards for what’s necessary and wait to be able to deliver that.
The first mover rarely wins in the long run.
It's a bit like Debian*, but closed source.
*: It's ready when it's ready.
>> Because of the iPod Nano unveiling on the same day, relations between Motorola and Apple were strained and Motorola CEO Ed Zander later accused Apple of purposely undercutting the Rokr.
Apple probably saw it as an opportunity for free iTunes and Nano advertising.
They (whoever ‘they’ is) caused the phone to be terrible even though it had the iTunes name on it. So Jobs got revenge, as he always did if he could.
Perhaps they agreed to a partnership and didn’t realize that Motorola and the carriers would ruin it? Or perhaps it was some sort of “we’ll do this to learn some of the business” kind of a thing?
I’d love to know more of the story behind how it started and it’s development.
Hmm I guess. Vision Pro seems rushed from vantage point. Odd battery pack … only 2 hour charge … limited field of vision. Also the screens that show a picture of your eyes are off putting and strange.
Think Apple may have rushed here too quickly. We need more battery life.. think we may be looking more for an Augmented Reality mode which works on top of what you see with your actual eyes rather than your eyes just looking at high def screens inside of a headset that is relaying a video captured from cameras of what is in front of you.
Looks more like a Prototype IMO
Six hours of connected battery [1] (compared to days for the competition), no copy paste [2], no third-party apps.
[1] https://everymac.com/systems/apple/iphone/iphone-faq/iphone-...
[2] https://9to5mac.com/2022/06/20/apple-engineer-first-iphone-c...
I agree that 3 would be nice, since it would get you through pretty much any movie, but I feel like when I'm watching a movie I don't mind plugging in. After all, I'm not likely moving around a whole bunch. I have USB-C plugs by my bed and near my couches, so it doesn't seem like this is a huge inconvenience (though it would be great if there were a "you're plugged in" warning if you start getting up while you're plugged to a wall).
But if the tradeoff is a heavier battery (or a more expensive device), I'm fine with 2 hours. No hot-swapping, that seems like a bigger miss! People don't want to shut down just to change battery packs.
What I meant is they didn’t need chips as powerful. They didn’t need screens as high resolution or bright. They didn’t need so many cameras.
They could have released something closer to a Quest model in specs years earlier.
They waited for this.
There are always tradeoffs. First gen Apple stuff is often weak in some way (CPU, memory, battery, software) because they like to be at the edge of what’s possible. Then they improve from there.
Apple can afford to be a much later mover, even against very well-resourced competitors, now that they have a huge walled garden. If they didn't have the walled garden, it would be very difficult for them to catch up.
The iPod wasn’t a success because of the walled garden. They didn’t have one (once they released on Windows).
If MS had released a player that was good enough they could have stolen the market, yes. But that’s the point. No one did because everyone released something akin to a flash-based CD player. They didn’t rethink the interface much. The interface is why the iPod grabbed the hold it did.
Yeah it became cool over time.
But I contend an iPod with the interface of a Creative Nomad Jukebox wouldn’t have succeeded the way it did.
My reading of the upthread comments is that people are saying a walled garden isn't necessary, and using the iPod as an example of Apple's success before it had a walled garden. No one is saying that they had a walled garden back then. They did have a built-in audience (Mac users), but that is different from a walled garden. On iOS, they can prevent app devs from accessing their hardware in the same way they can, effectively neutering their efficiency.
Not enough patents, tbh. It's so hard to innovate and scrap things together, that this gets left as an afterthought.
Then the giants move in and steal your lunch, leaving you with nothing.
I think the second mover will have a huge disadvantage here as companies integrate the first mover into their products.
Apple will be able to do on-device AI, but I can't see that being a game changer unless paired with AR or some other new tech.
i.e. you convinced yourself Vision Pro was great before ever using it
But, having used a borrowed mac product in the past, I do recognize that using them is just... pleasant. Not enough to justify the higher price point, but the superior user experience isn't just marketing.
Strage to point out white males in your statement.
[0] https://www.apple.com/apple-vision-pro/
https://web.archive.org/web/20240207021726/https://www.apple...
> Modern hardware is responsible for AI
No, again, it's the hardware and software. Tensorflow is what formally sparked the AI boom that we're still rolling on, and of course it needed the underlying hardware.
The hardware does nothing without the software. Python and Linux are good software, to name two.
Including the Apple Newton, arguably the first handheld device.
The iPod classic was $349 (for many more songs, admittedly), but the prices were comparable.
I anticipate that Apple's Pro devices (iPhone, MacBooks) will have beefier hardware designed specifically for this use case. My guess is they will sell a much higher proportion of Pro iPhones as a result. They'll probably also sell a lot more new devices overall, contra the trend toward slower upgrade cycles.
At the same time, I think third-party companies will find a way to do pretty decent on-device (and very good cloud-based) AI, so it will be a tradeoff in terms of speed and privacy. If you want the best speed and no data being shared with a cloud-based AI provider, the Pro devices will be aimed at you.
This idea that Apple gets to things late to "perfect them" is an artifact of the iPod/iPhone era. Nothing Apple put out since then has met this bar.
Apple does things low-key these days because it has to. Remember the Apple Maps fiasco? A few memes was all it took to send everyone scurrying back to GMaps for a decade.
Apple must have got to him...
Apple's been accused of copycatting practically since the beginning. But if you only copycat, you don't typically last this long. They can always offshore somewhere cheaper if you stand still long enough.
Even chatgpt says they are the best company of all time at marketing.
Also, AFAIK, it won’t say anything specific until you ask it a question, and the away you phrase that can hugely affect its reply.
Even if it didn’t, its response still assumes (more or less) that the Internet is always right, and that is questionable.
To use a few examples that have happened after Apple Maps:
* The Apple Watch — Apple was at least 2 years behind other smartwatches when it launched in 2015 and now it basically owns the category. The first version wasn’t quite there but they nailed it with the series 2 and the pivot from fashion to fitness.
* AirPods - tons of companies had been trying truly wireless headphones for years. I know, I had tested basically every option commercially available. Although imperfect at launch (and the software got better over time for once here), AirPods from the moment I first used them in September of 2016 was category defining and the absolute best truly wireless earbuds you could get on the market, at any price point — even tho the quality was mid. Even now, you can do better than standard AirPods for the price/performance, but it’s hard to top AirPods Pro 2s unless you want to spend significantly more money and sacrifice ecosystem niceties (assuming you’re an iOS user. And the Venn diagram between people who are willing to spend over $250 on truly wireless earbuds and iPhone users is basically a circle).
What I do think is instructive about the Apple Maps example is that when it does come to services, and I put generative AI in the services camp much more than hardware, is that Apple is not best-in class at services at all. As a package, Apple services can be beneficial, especially if you’re part of the ecosystem - but even tho I pay Apple $38 a month for Apple One Premier, I’m still paying separately for Spotify, Dropbox, OneDrive (part of Office 365 but still), and Netflix (and a bunch of other video services) and I don’t think I could reasonably drop any of those services in-place of just using iCloud/Apple TV/Apple Music, etc. My parents can (except for Netflix/prime video), and Apple services are definitely “good enough” for a lot of people in the ecosystem, but none are best-in-class.
Unclear if they’d be able to be “good enough” to displace other generative AI services here or not, but to your point, Apple Maps still hasn’t gotten over its bad launch. And Siri on the phone is still dog shit. Siri is so bad that I won’t even use it on platforms where it is objectively good, like Apple TV, unless I specifically remember to.
Apple came in quite late and slurped up much of the market. If their watch was Android-compatible, it'd be even more.
I don't know if they've been able to pull this off with AVP, as most people are just ignoring it.
I think if you personally are ignoring it, you probably don't notice how much other people aren't.
That said, I can't think of any of my friends who I would recommend to buy one at this stage, but I see Apple having no trouble selling as many as they can make.
So right now, the entire AR/VR category is expected to ship 1/3 of the number of units of just the Apple Watch. Even if Apple sells 180,000 AVPs all with an MSRP of $4000 (so I'm being extra generous here), that's only $720m in revenue, or less than 3.7% of Apple Watch sales.
And that doesn't even factor in all the Apple Watch units that are in use, which realistically, is probably 125 - 150 million units.
Does that mean AVP or headsets like it won't ever achieve Apple Watch-like sales or adoption? Not at all. But it certainly isn't now and it's probably doing the category a disservice to expect it to reach those heights anytime soon, let alone pretend that just because awareness is super high that sales are guaranteed to follow.
[1]: https://www.idc.com/promo/arvr [2]: https://medium.com/@mingchikuo/apple-watch-estimates-and-pre...
But right now, supply-chain analysts suggest that they can only make 160,000 or something this year. Apple could sell literal boxes of dog shit to 160,000 people, so I don't think we really know what the size of the market is.(And incidentally, although shipping is now two or three weeks out (an improvement from two weeks ago), I can pick up an AVP from a number of stores in my area today and at another store on Saturday. I don't think we can make any assessments as to the market size/demand right now, but I will say that in-store availability one-week post release was not something we saw for the first iPad or Apple Watch. The iPad 2 was consistently out of stock its first few months, even -- and not because they were supply constrained but because Apple sold every device they got in-store.)
Is interest/intrigue/vauge knowledge super high -- yes -- it's a new Apple product, that's a given. But prodct awareness != product success.
WatchOS until like fall 2016 really wasn't that great. The third-party apps were all garbage and we didn't even get "native" apps until six months after the device launched and that original Apple Watch (the Series 0) was woefully underpowered for what it needed to be. I bought one and don't regret spending $800 on the stainless steel variant with the modern buckle combo, but it also got like two years of software support, and even the support was limited compared to even the low-cost Series 1 released a year later.
The Apple Watch has a big advantage: it's one of the cheapest things they sell. It is the iPod Shuffle of its time. But as it doesn't work without an iPhone, I cannot agree that it owns the market.
https://www.statista.com/statistics/910862/worldwide-smartwa...
AirPods...I have about 6 different "true wireless headphones". AirPods IMO worse than cheap version of Pixel Buds that google give away for free just for existing. Max and Pro are alright, but the original and 2nd gen AirPods are my least favorite headphones.
Their nice seamless device migration is nice, but only possible because they control all sides of it. Also, doesn't work well if connected to Apple TV for some reason - doesn't automatically switch when you pickup the phone.
For Airpods I fell for the hype in a moment of need and weakness: I needed new earbuds for a travel because they couldn't swap my old ones that needed a warranty return. I regreted it pretty fast after the honeymoon period. Sure, they wouldn't drop too much and the 2 buds were perfectly in sync (but that's a low bar to clear for earbuds...) but most of the rest sucked big time. In fact, their poor battery life made me regret the wire pretty fast and their mild sound quality doesn't really help being more forgiving of its shortcomings. Nowadays they make no sense for their price, and the "Pro" version is alright, but to get half decent battery life they had to increased case size wich was basically the only useful difference and in the end, they perform like buds half their price for sure. I think the iCloud sync bullshit to be unreliable and a stupid "feature" at that because it guarantees that it will only be useful with other Apple products when I definitely do not want to limit my tech to only one brand especially when said brand only sells at luxury pricing... What you really want is Bluetooth multipoint, a feature that many earbuds at this price have anyway.
I bought the Watch to track swimming because it seemed like the thing that would integrate easier with iOS and it seemed not too bad quality tracking. But in the end after years of using an Apple Watch for sports tracking (including thousands kms of running) I don't think the Watch is really good and most will get it to show off or because it's actually the only that can properly integrate with iOS thanks to limitations put in place by Apple themselves. Considering the price, the only really useful features (health/sports tracking) is extremely lacking, especially if you do not spend time looking for 3rd party solutions. The only reason it got such success is because of Apple brand recognition and other secondary factors like social status. In the end it's not a completely terrible product but if evaluated on its own at its price point its really not great...
Suffise to say I'm rather disenchanted with today's Apple gear and I feel they really need to make their products MUCH better for the price or lower pricing across the board. In the long term something will have to give because people won't be captivated by the brand forever and désillusion has already started.
They do, but not as good as within apple ecosystem. My only gripe is how it works together with ATV.
Fitness tracking, I think it's a subset of what I said before: it isn't a fitness tracker, but an iPhone wearable that can be used to track some fitness things. Yeah, Ultra has some niche features, but I got just because it has bigger screen.
I also wonder why they broke with their naming scheme ("Pro" is not the Pro of any smaller model)
Or maybe someone thinks they're managing expectations on price by putting Pro in the name, since it's on par with their other Pro products.
Spend a few thousand dollars to get provisionals. Then if your idea works and grows, file the full patents.
Don't let the giants steal your blood, sweat, and tears finding the gradients.
Apple stock has taken a beating as of late, in part because analysts have loudly proclaimed that the company is behind Meta, Google, and Microsoft in generative AI implementation. It's not clear why this wasn't a problem when it wasn't first to a mobile phone, a tablet, a smartwatch, or a VR headset, but is with generative AI.
somebody is hurting
If you are only looking at objective metrics, Apple is always going to perform at B and C levels.
If you are looking at fanaticism, they are A++.