Adobe Firefly: AI Art Generator
adobe.com
adobe.com
I attribute the speed at which incumbents are integrating AI into their products to a couple things:
* Whereas AI was a hand-wavey marketing term in the past, it's now the real deal and provides actual value to the end user.
* The technology and DX with integrating w/products from OpenAPI, SD, is good.
* AI and LLMs are capturing a lot of attention right now (as seen easily by how often they pop up on HN these days). It's in the zeigeist so you get a marketing boost for free.
That is, these companies are largely not doing the hard part, which is creating and training these models in the first place. The examples you gave of of cloud and iPhone have both huge capital barriers to entry, and in iPhones case other phone companies just didn't have the unique design talent combination of Jobs and Ive.
fyi, for Adobe Firefly, we are training or models. From the FAQ:
"What was the training data for Firefly?
Firefly was trained on Adobe Stock images, openly licensed content and public domain content, where copyright has expired."
(I work for Adobe)
No, there is no real "hard part" to AI current. Training is simply "the expensive part".
It seems "the bitter lesson" has gone from reflection to paradigm[1] and with that as paradigm, the primary barrier to entering AI is cash for cpu cycles, other things matter but recipes is relatively simple and relatively available.
[1] http://www.incompleteideas.net/IncIdeas/BitterLesson.html
Are they the hard parts though? The short time it took from the first waves of public excitment around DALL-E to stable diffusion being the well established baseline looks more like the class quantity of problems that can be reliably solved by shoving enough resources at it. What I consider hard problems are those full of non-obvious dead ends are where no matter how much you invest, you might just dig yourself in deeper.
But this phrase from GP is pretty darn salient:
>>"They are aggressively integrating it into their products which (1) provides a relatively cheap step function upgrade and (2) keeps the barrier high for startups to use AI as their wedge."
People seem to take offense at this idea, but the proof is in the pudding. Every week there's a new company with a new model coming out. What good did Google's "AI Talent" do for them when OpenAI leapfrogged them with only a few hundred people?
It's difficult to achieve high margins when barrier to entry is low. These AI companies are going to be moreso deflationary for society rather than high margin cash cows as the SaaS wave was
It's too early to say how hard this is, for all we know no one but OpenAI will match it before 2024.
Ehhh.... Sometimes. It's still a hand-wavey marketing term today. Almost every sales call I'm in either the prospect is asking about AI, or more likely the vendor is saying something like "We use our AI module to help you [do some function not at all related to AI]". Also, even when it's "real" AI (in the sense that we're talking about here), it's not always providing actual value to the end user. Sometimes it is, and sometimes it isn't.
However, with AI in general, we have very decidedly passed the point where it Works (image generation probably being the most obvious example of it)
Even if, starting now, the underlying technology did not improve in the slightest, while adoption rises as it is going to with any new technology that provides value, anyone who does not adopt is going to be increasingly uncompetitive. It quite simply is too good already, to not to be used to challenge what a lot of average humans are paid to do in these fields.
And also it's something many companies have been working on for a big part of the last decade. Kevin Kelly in particular has been talking about it for at least the past 7 years. In 2016 he released a book titled "The Inevitable: Understanding the 12 Technological Forces That Will Shape Our Future" and the addition of AI to everything is covered in that book.
I imagine a lot conversations with in-house AI folks is around deploying these methods.
People are already using these plugins to do inpainting etc with Stable Diffusion. Adobe is trying to provide official support simply to keep up.
To me, the most novel thing is the data source being free of licensing concerns.
But that, too, will be eroded as more models appear based on datasets with straightforward licensing for derived works.
Image stock collections (and prior deals around them) seem more valuable now than they did before all this.
The skeptic in me thinks it's more:
* The market is rewarding companies for doing X (integrating AI), so companies are doing X (integrating AI).
Song as old as time.
As pretty much everyone on HN is aware, AI is a broad term for a variety of technologies.
AI has been in our everyday lives for quite some time, but not in a way that generated (no pun intended) such buzz.
Having my iphone scan emails and pre-populate my calendar with invite suggestions is far less newsworthy as the ability to generate a script for an Avengers film where all the members are as in articulate as the Incredible Hulk.
If anything, with generative AI being so buzzy, this latest round of AI integration is more marketing.
And no reason to suspect that it won't spectacularly backfire. Not that they're integrating (or more correctly slapping it on with some hot glue) transformative technology they barely understand into legacy products which are themselves likely to go defunct. Why even use a spreadsheet when you can get GPT-4 to write a whole data analysis pipeline and summarize everything? Or why bother with word documents when GPT-4 can generate, spell/grammar check, translate (if necessary), format and output into any format you want?
If my company already uses spreadsheets and teams of people skilled at manipulating them, it might not be very hard to convince my manager that good AI use cases (quick formatting, intelligent auto-completes, intention detection from sheet structure) could probably speed us up by 20% - but convincing management of the value of a full system re-design by comparison would likely be a very tough sell, if not viewed as an insult or sign that I'm not a team player.
Just because the future may prove these methods antiquated doesn't mean management is liable or likely to change their tune today.
Companies have to get involved in this field because it's all the buzz, while everything else you said is true, this means companies have no choice to get involved.
If someone like Adobe, google etc, doesn't get into the game, they are sure going to be a lot of questions on there next investment / financial calls.
The incumbents need to keep up appearances and not look like they are behind / unaware of AI, else investors will be worried that they will simply be sidelined/replaced at some point in the future.
However this landingpage looks amazing.
Any good other tips?
You don't see the value in effectively not needing any art/design skills to make aesthetically pleasing logos/mockups/memes? Even just for "playing around" - I bet there's a large market of people who want to add "fun edits" to their existing personal photo library.
Focus less on landing pages and more on the implications a technology brings. Then you'll see where things are headed.
Yes, because they are already technology companies who understand tech. In the disruptive times of the Internet, then iPhone (mobile Internet), the companies being disrupted were not tech companies, so they didn’t know how to catch up.
This time this is a massive tech improvement, but in a market already saturated by key tech power players who are in prime position to implement these improvements into their existing competitive advantage.
My own startup is https://inventai.xyz. Subscriptions aren't ready, so you can't actually generate anything yet, just trying to move quickly.
Adobe had a whole bunch of smart people including Dave Abrahams helping transition to iPhone and iPad, and to build for the cloud, so I'm not sure what you're thinking here.
Wasn’t “cloud” also added to major products? Even Adobe relies on that heavily. Similarly, most big companies (including Adobe) offer an App Store app.
That’s something I almost forgot about. This was not a forgone conclusion - there was a pretty big divide between people who thought AI would have real value and staying power and those that didnt.
I never thought about it that way, but now that you mention it, it makes so much sense.
Didn't the incumbents come together for Android as a group?
> trained on a dataset of Adobe Stock, along with openly licensed work and public domain content where copyright has expired
> We do not train on any Creative Cloud subscribers’ personal content. For Adobe Stock contributors, the content is part of the Firefly training dataset, in accordance with Stock Contributor license agreements. The first model did not train on Behance.
Not sure what "first model" means there.
Also interesting: https://helpx.adobe.com/stock/contributor/help/firefly-faq-f...
> During the beta phase of Adobe Firefly, any Adobe Firefly generated assets cannot be used for commercial purposes.
> Can I opt [my Adobe Stock content] of the dataset training?
> No, there is no option to opt-out of data set training for content submitted to Stock. However, Adobe is continuing to explore the possibility of an opt-out.
If they can properly compensate the stock contributors based on usage then I think this is a very fair approach.
[1] https://www.reddit.com/r/photoshop/comments/11xgft4/discussi...
I dont have any confidence they can create a fair compensation method.
I am catastrophically unhappy at the prospect of a corporation ingesting a copy of my work and stuffing it into a for-profit machine without my permission. If my work ends up significantly influencing a generated image you love, nobody will ever know. You will never become a fan of my work through this. You will never contribute to my Patreon. You will never run into me at a convention and tell me how influential my work was to something in your life. Instead, the corporation will get another few pennies, and that is all.
Also, if anything, being included in a training set means you are already notorious. The big ones are usually trained on stock art or famous professionals/classics, and the ones trained by random people are going to use quality filters to get the best images of a specific subject. If you aren't already notorious, you simply will not make it into a set. The other possible motivation is spite, but that'll only happen if you participate in internet slapfights.
And...Patreon? Fans? Influence? "younger PRO" (so a non-pro doesn't count even if they are trying their best?) I sincerely recommend you choose sentences more carefully. Makes you sound phony and using art as a social strategy. When there's so much talk about art and its "soul" you really don't want to make yourself sound like art is a mere means to an end or you risk making the cold, calculating machine seem "purer".
Personally, art should be its own goal. I had plenty of time to stomach one isn't entitled to anything just because effort, so I just want to make my art better. And saves me from the trouble of chasing trends to stay relevant.
companies stealing your work isn't a thing that just happened to become possible because AI can make it easier to imitate. The real world scenario is much rather: _they just steal your existing work_
ever since I've been publishing my own illustrations I've always ran an image search on the stuff I've got on my homepage once or twice a year, and almost every time i did this I've found multiple individuals or companies who just used my illustrations for something without ever contacting me.
On the other hand, if my style was ever to become known and sought after enough for people prompting AIs with my name, I'm pretty confident that this would mean that:
A) I've grown big enough to have more inquiries than i could serve anyway and
B) The ones doing this are neither people or companies I'd liked to have as clients, nor would they have booked my services for the price I ask if it weren't for AI.
Big agencies with interesting clients couldn't allow themselves to risk their reputation with faking original work, and other large corporations that just don't give a fuck because they are ready to litigate if i challenge their usage are likely to have such reach that they'll end up still contributing to the desirability of my original artwork if they appropriate it. And the smaller ones, they fulfill premise B) on the one hand and would also feed the hype.
So I truly feel what actually bothers you, forever I've been drawing first and foremost because i want to inspire people to express themselves and make experience the same experiences I've had when loosing myself in a drawing. And i do think the bittersweetness of imaging AI remains that while some people will gain the confidence to DO try to express themselves creatively, others will at the same time never want to seek achieving this by their own physical skill and raw will.
But when it comes to myself and my art, I actually see only benefit and progression, regardless of what current dystopic scenarios might manifest :)
Most customers currently paying an artist will just slap some quick AI stuff and call it a day.
Big customers might still make it a matter of prestige or pride or "quality" differentiator to use "real human art" from some famous graphic designers, but that is like 1/1000 of the commercial gigs going on today.
We are making huge steps to promoting ourselves in last decades.
I think this is incredibly cool technology, but using other people's property without their consent is stealing (I'm not talking about legality, but morality here).
The second reason why it's not the same is that people can't look at X million pictures and become proficient in thousands of different art styles. So, again its not legality but more about ethics.
I guess different people have lower moral standards than others, and that's always been part of the human condition.
With all that out of the way, I think artists won't get replaced, because these tools don't really produce anything... Substantial on their own. An artist still needs to compose them to tell a story. So, all this nonsense about how it will replace artists is misguided. It can only replace some parts of an artist's workflow.
I know there was an art competition where someone won with a piece that was AI-aided, but honestly it looked like colour sludge. The only thing that was really well executed in it was the drama created by the contrast from sharp changes in values near the centre of that work, and something vaguely resembling a humanoid silhouette against it. You could've called it abstract art if you squinted.
Do you think ChatGPT should not be allowed to read books and join ideas across them without paying the original authors for their contribution to the thought?
If you don't like it, don't sign the contract.
Are you saying all those art styles are original? They are not. Artists influence artists. Sometimes the influence is strong, other times just a glimmer.
Perhaps the burden of responsibility shouldn't be on Ai machine learning, but the human prompt author who chooses the instruction: "...in the style of Jo Blow". Who owns the ethical dilemma in that case? Who is being unfair to Jo Blow in that case? I'm quite certain whoever wrote the prompt is 100% responsible.
Instead of lower morality, I'd say it's selective morality.
I bet quite a few artists (rightfully) feeling threatened by this phenomenon would have absolutely no problem watching a pirated movie, using an ad blocker, read paywall-stripped articles, the like....whilst this is principally the same thing: taking the work of others without consent or compensation.
I’m pretty sure that would be a death knell for art. Where are these mythical artists who have never looked at anyone else’s art?
It's about actually being able to use that content legally (and commercially) that matters to most in this conversation.
As someone who has contributed stock to Adobe Stock I'm not sure how I feel about this. I'm sure they have language in their TOS that covers this, but I'm guessing all contributors will see nothing out of this. Fine if this is free forever, but this is Adobe.
I hope it's fair to say that they do train on your work.
>The insights obtained through content analysis will not be used to re-create your content or lead to identifying any personal information.
https://helpx.adobe.com/manage-account/using/machine-learnin...
I hope you do continue doing so. I'm all but disappointed in others' approaches in this area, and it paints a very bad image for the potential of AI as tools.
We got access to this in beta a week ago and it was an instant hit across the whole company.
This is just the tip of the iceberg and there is a lot of really cool, in-house products around generative AI. The team is going to great lengths to make this ethical and fair (try and generate a photo of a copyrighted character like Hello Kitty or Darth Vader). I'm excited to see the final product of all the internal work that has been going on for so long.
are you saying it won't work? if that's the case, that seems really silly. actually, it goes against everything I believe in (as well as my understanding of even the kindest meaning of the word "hacker"). it drives me up the wall, it makes my blood boil
who is going to stop me from drawing hello kitty myself?
it's not the tool's job to regulate my creativity. the law exists to regulate the use of my art, not the act of creating the art. I can draw hello kitty all I want and leave it in my drawer, if it floats my boat
limiting the tool just makes me never want to use it. you're like Sony fighting digital music in the 2000s. the future is right in front of you but you just can't see it.
⠀⠀⠀⠀⢀⣀⣀⡀⠀⠀⠀⠀⠀⠀⠀⣠⠾⠛⠶⣄⢀⣠⣤⠴⢦⡀⠀⠀⠀⠀
⠀⠀⠀⢠⡿⠉⠉⠉⠛⠶⠶⠖⠒⠒⣾⠋⠀⢀⣀⣙⣯⡁⠀⠀⠀⣿⠀⠀⠀⠀
⠀⠀⠀⢸⡇⠀⠀⠀⠀⠀⠀⠀⠀⢸⡏⠀⠀⢯⣼⠋⠉⠙⢶⠞⠛⠻⣆⠀⠀⠀
⠀⠀⠀⢸⣧⠆⠀⠀⠀⠀⠀⠀⠀⠀⠻⣦⣤⡤⢿⡀⠀⢀⣼⣷⠀⠀⣽⠀⠀⠀
⠀⠀⠀⣼⠃⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠉⠙⢏⡉⠁⣠⡾⣇⠀⠀⠀
⠀⠀⢰⡏⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠙⠋⠉⠀⢻⡀⠀⠀
⣀⣠⣼⣧⣤⠀⠀⠀⣀⡀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣀⡀⠀⠀⠐⠖⢻⡟⠓⠒
⠀⠀⠈⣷⣀⡀⠀⠘⠿⠇⠀⠀⠀⢀⣀⣀⠀⠀⠀⠀⠿⠟⠀⠀⠀⠲⣾⠦⢤⠀
⠀⠀⠋⠙⣧⣀⡀⠀⠀⠀⠀⠀⠀⠘⠦⠼⠃⠀⠀⠀⠀⠀⠀⠀⢤⣼⣏⠀⠀⠀
⠀⠀⢀⠴⠚⠻⢧⣄⣀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣀⣤⠞⠉⠉⠓⠀⠀
⠀⠀⠀⠀⠀⠀⠀⠈⠉⠛⠛⠶⠶⠶⣶⣤⣴⡶⠶⠶⠟⠛⠉⠀⠀⠀⠀⠀⠀⠀This is very well said. Thank you!
It's not a good look for the tech industry and the ESG corporate culture. It is destroying the very hacker culture that made them.
Thanks airstrike, for dropping this truth bomb.
And just like that, Adobe expands its ministry of creativity powers. In the beginning, it was dollar bills on the no-can-do list. Now it's pictures of Darth Vader and hello kitty.
Let's say you take your hello kitty dot art, and make a poster promoting a commercial event. You then take it to FedEx Kinkos and use a self-service copy machine to make 1000 copies. You could reasonable argue that you are violation of copyright infringement, and the photocopier / FedEx kinkos isn't.
Now instead, you have AI generate a poster, and it generates a very similar image to hello-kitty. It's arguably so similar than a reasonable person would say it's a copy. You take that poster and again make 1000 copies. Is there copyright infringement? If so, who if anyone, is liable for damages?
The counter is always, “Well, we can see our way forward to doing it, which means someone else can also do it. So… we better beat them to the punch.”
“Draw a Disney logo but for adults”
That image now lives on Adobe.com
No, you don’t want Disney to sue Adobe.
I want to see Disney sue Faber-Castell for making great pencils I used for my deviant art
Also IANAL but even then there's probably fair use rights in parodying their logo
It's not clear that the quality will be exactly the same (in fact it will very likely be worse), but working generators are essentially ways to quickly generate training data. And I can't think of a legal argument for why generated output from a model would be less legal to use as training data than an unlicensed photo off of DeviantArt.
Nobody has really called out OpenAI on this, but OpenAI has a clause in it's TOS that you won't use output to build a competing model. But that's... just in it's TOS. If you don't have an OpenAI account, it's not immediately clear to me (IANAL) why you can't use any of the leaked training sets that other people have generated with ChatGPT to help align a commercial model.
Certainly if someone makes the argument that generators like Copilot/Midjourney aren't violating copyright by learning from their sources, it's very hard to make the argument that Midjourney/Copilot output is somehow different than that and their output can't be used to help generate training datasets.
You just have to, you know, draw it.
“How dare you not let me copy your stuff for free woth zero effort!”
… entitled much?
"draw it" in this context means "use AI to draw it for you"
am I being entitled or are they acting like they are The Law?
imagine doing something as unethical as drawing hello kitty
Last time I canceled a subscription (can't do it through your website, only by talking to support) when I finally got in touch with someone it took several hours to actually convince them to cancel.
Does your inpainting model work with every style? Or is it going to have trouble matching the content for e.g. specific fanart?
One of the primary goals for Firefly is to provide a model that can generate output that respects creators and is safe for commercial use.
(I work for Adobe)
And I'm extremely eager to get my hands on AI tools that let me extend my capacities based on _my own_ styles & context, and that is focused enough on this scope to evade future legal obstacles when used in production
Very excited to try this tool!
From the wording on the page it sounds like these may be mockups:
> With the beta version of the first Firefly model, you can use everyday language to generate extraordinary new content. Looking forward, Firefly has the potential to do much, much more. Explore the possibilities below.
> Imagine generating custom vectors, brushes, and textures from just a few words or even a sketch. We plan to build this into Firefly.
> We’re exploring the potential of text-based video editing with Firefly.
> Get ready to create unique posters, banners, social posts, and more with a simple text prompt. With Firefly, the plan is to do this and more.
> In the future, we hope to enable Firefly to do amazing work with 3D.
This is just one tool. It doesn't need to be fully general.
Makes me think that we haven’t seen what true innovation looks like in this space. Right now, AI is a feature, not a product.
Edit: Not talking about the models themselves (stability, mid journey, GPT-x), talking about what is built on those models.
Part of the reason for this is that very often the best applications of AI are really invisible to the user, making everything a little bit better, quietly behind the scenes.
The same is true for software in general. The best software products automate loads of stuff behind the scenes so from the user perspective they just click a button and the thing they want to happen, happens.
Perhaps the most successful and important AI product is a great example of this: the spam filter. I bet most younger email users don't even realize how much value this old AI tool provides them unseen.
But the trouble is making effective AI products is not "sexy" right now, and if your team ships one it won't get any credit in a big company. I've had my PM instantly shoot down plenty of interesting applications of AI that wouldn't be very visible to the customer or larger product-org.
A spam filter:
- Is provided historic information about the problem
- Learns from this information to construct a basic model of language
- Is then provided unseen information
- Then makes a probabilistic decision based on a degree of uncertainty.
The exact model behind the spam filtering can be extremely simple (naive Bayes) but could easily (and probably will without you even realizing it) expand to include things like GPT.
A spam filter is making decisions under uncertainty with new information based on patterns it learned from previous information. If this doesn't fit your definition of "AI" then I think if you understood what was happening under the hood I don't think you would consider GPT to be AI either.
If you toaster does learn your toast preference over time from your toasting behavior (unlike mine) then I would consider that AI as well.
Seems like all these big companies are pushing amazing looking concept videos more than anything.
Not talking about LLMs/underlying model. I don’t think adobe makes their own either. Talking about the interface to it.
This is an indicative signal. It's amazing how easily it is ignored.
> Makes me think that we haven’t seen what true innovation looks like in this space.
It's interesting that a bunch of product add-ons could be considered "innovation" in the first place.
My reaction to seeing any announcement from them is, yeah whatever Adobe.
BUT, when prior art will be AI-assisted if not 99% generated art, from a pool of prior human art ever so slowly diminishing… where is this going?
For one, "art" can only lessen in value. Perhaps physical art will grow in value as digital art’s "made by without AI" tag becomes unprovable and meaningless.
I think it’s bad. Whomever provides these tools is not refilling the pool of prior human art, only muddying it up. Therefore everything will converge. It was quite obvious already the way eg. most webapps nowadays have the same boring design… but this is worse.
But I don’t know it must be the inevitable evolution, perhaps this is how we will end our differences… as human’s "collective mind" becomes more and more evident.
This AI trend will turn our attention back to what it truly means to be an artist. From the muddy waters of AI art will shine the true works of art that only humans are capable of producing. This will raise the barrier to entry and increase true arts value. This imo will be a good thing.
What's the worst that can happen? AI art becomes too boring? That will just benefit human artists who can do something new and interesting.
Online art getting "muddied up" with AI art is only a problem for companies seeking to train a new model. But I trust they'll figure it out just fine.
Lots of arts/craft are kept alive because they form the basis for more automated processes and this may well continue with simple painting and photography.
Art was done with Pencils, or Adobe Photoshop. Now, it's done with an AI. It's all random bits but to the humans visualizing them.
(I also wonder who is powering this or if it's an in-house solution -- that should be telling...)
Edit: Why, they've trained this on Adobe stock images. OK, this may be very interesting for publications worried about copyright.
[1] https://blog.adobe.com/en/publish/2023/03/21/responsible-inn...
The Elements versions of Photoshop and Premiere are paid for with a one-off purchase and are not part of a cloud subscription.
I use Creative Cloud photoshop but a while ago purchased a separate Premiere Elements license for video editing - this was cheaper than extending my CC subscription to include Premiere Pro. But I switched to (the awesome) Davinci Resolve for video editing when my copy of Premiere elements wasn't able to open video clips from just-released cameras and phones.
I think it will decrease iteration time during an exploration phase for new artists or when you're not quite sure what you want and want to explore your idea space more quickly (and maybe even get new ideas as you iterate).
It's similar with these coding AIs. A lot of the time it's great for the "blank page" phase of a project where you have to do all the "boring" stuff out of the way. Another great example (I think it was a blog post here) where the AI recommended a method the author didn't know about that yielded a crazy performance boost.
I tried to get some help from copilot on writing a shader the other day, and it was really an amazing experience. One still needs to have a pretty deep understanding of what needs to be done to use these tools.
I imagine it's similar for writers. Maybe they want some help to reword a sentence to be more succinct, but the ideas will still come from their heads.
I can't predict if this will one day be so sophisticated that you can have it do both low level and high level "thinking" when exploring ideas, but if that day comes I don't think it will mean an end to jobs, just that some jobs will become more accessible, or that it won't be so much about nitty-gritty work and more about higher level idea-level work (which to me sound good, not bad).
Obviously there's people who enjoy the nitty gritty (as a developer, and amateur painter who does enjoythe process), and I don't think that will fully go away, just become more of a creative/artisan field maybe. Who knows, though? I may be way off, but I don't think it's as bleak as some people fear.
For instance, I'd like to make a game. But I don't have enough money to even hire an artist to help with concept art. So I don't get to the point where I can raise money off that art, and hire an artist to make game assets.
Now I can generate all the concept art I want for free, and I can raise money off of that (wallets open faster with pretty pictures than with words). What am I going to do with it? Hire artists! They will probably be better at using AI art generators than I am, and they have the skills to actually work with the generated results, unlike me.
I guess a better way to rephrase that: would it make them more profitable to produce more art? Or to keep producing the same amount but paying fewer people to do so?
Honestly, I'm an artist myself. I'm competent enough to be reposted and plagiarized (to my amusement) in places, and I have influenced people with my designs or style, even unwillingly. I mean, I can say anything on the internets, but I've been through all of the "artist's phases of grief" and nobody can take that from me.
Let's humor this thought for the sake of discussion: What if, maybe, just maybe, the artists that get replaced by an stable diffusion instance...deserve to be replaced?
People keeps talking business and not enough people is talking about ART. Something which is baffling to me as an artist. A lot of artists have a lot of technical skill obtained through grinding (and learning from others) but have zero passion to improve further or have any real distinctive traits to stand out. It's double baffling coming from places such as Hacker News, where a majority, being tech workers, know that you need to keep improving and recycling yourself to stay relevant to employers. We know that pressure very well. You think art is not a competitive field? Every day 10 people can just pop out of nowhere to compete in your niche and take your audience away, with a much lower barrier of entry. That other person just needs their art to look good, no need for qualifications. Some people are just gifted, too.
If your art stagnates and all you do is sexy ladies for overblown prices, then, yes, you failed to keep up and someone else will replace you. If it was not the AI, it would have been another human being, as always.
Besides, corporate entities usually use custom photographs with photogenic actors, carefully staged for maximum engagement, or generic, parametric, inclusive-yet-bland art in the lines of Alegria. The whole notion of megacorps purposely stealing from indie artists (when their models are usually curated, or going to have to be curated for maximum advertiser friendliness, and a lot of indies draw cheesecake because it's what people commissions...) paints a pretty tale of David vs Goliath, but it's completely absurd in practice. And the risk of some random dude "stealing" your style has existed always.
The AI can have pretty dark uses in the wrong hands, but a lot of the situations described say more about the lack of passion or excess of ego of the one crying foul, than actual reality. And, take it from an artist, we do have an issue with inflated egos. All of this sounds to me like a huge case of "Do not steal", when making it into any huge training set in any significant capacity should be a badge of honor to wear. If even The Algorithm© recognizes the value of your art then you are already pretty well established anyway. I really can't wrap my head around the strange perspective of other artists.
People should really put all those strong emotions onto the canvas instead of internet kerfuffles, is what I'm saying.
Also there are people who really don't care about quality. There have always been different tiers of art: it's one thing to have clip art for a throwaway blog post (royalty free stock), it's another thing to base a marketing campaign around images (rights managed stock) because you don't to have all your competitors choose the same image.
https://cxl.com/blog/stock-photography-vs-real-photos-cant-u...
The bottom feeders will be very happy to accept the problems of A.I. art and in fact you might not have the embarrassing dogpiling problem that the above blog post describes.
Although in this case, it’s an adobe product, the only people who will use it are artists.
Airdrops can be very lucrative (5, 6 figures with market depth supported by VCs allowing easy conversion to cash)
I suspect the example they used might have been cherry-picked
I wonder if generative models will become such a commodity that they cease to be a revenue driver or differentiator.
And it remains to be seen how long it will take until there is an open-source model on the level of GPT-4. It may be harder than many expect, and the commercial offerings may be on yet another level by then.
Big AI's advantage is still being made. Every time a user hits "Feedback" they're fine-tuning this proprietary model. You can absolutely make an Open Source model with enough compute, but if it is only e.g. "95%" good relative to the paid one at "97%" or "98%" are you going to prioritize it? How many of you use Google because it is 2% better than Bing for example?
There are plenty of proprietary technologies that are better than say Postgres, or JPEG, or JSON. And some businesses need that marginal edge. But if the open source option is free, standardized, has great tooling, and is 95% as good, that's a real problem for OpenAI and their peers.
dall-e for example never gets faces right and good luck trying to have the same character look the same between generated images. Feeding it a seed image sometimes got something similar but always with major uncanny valley vibes.
Anyone know how to get around this?
You'd use what's available as "good enough", and manually modify it when needed.
Then you'd wait a few years until it does get faces right (haven't seen much issue with faces to be frank. Hands, yes).
From the page:
> Looking forward, Firefly has the potential to do much, much more. Explore the possibilities below ... We plan to build ... We’re exploring the potential of ... the plan is to do this and more ... in the future, we hope to enable.
All that being said, shut-up-and-take-my-money.jpg!
It's mainly just text to image, but the results are extremely impressive IMO. Probably best in class for a lot of usecases.
Currently in the beta, there is text to image, and text effects, and will have vector recoloring in the next couple of weeks.
And so far, that's been true! Despite the ubiquity of 3d services in low-wage areas of the world -- and good ones! I've been able to build a career that I'm proud of.
I'm the millionth person to say it, but this is like watching a predator you know you can't avoid, slowly gaining on you.
I'll find another job, I'm sure. But it won't be the one I love and that I worked hard for.
I hope someday y'all get to the point where we can change a video's season, time of day, etc. and have things work seamlessly. That would be quite incredible!
Photoshop is used to produce a ton of porn, but Adobe doesn’t try to stop that.
In terms of “safety”, models Photoshopped to impossible standards have helped create impossible beauty standards causing depression and even life threatening eating disorders in teenage girls.
Yet, Adobe and all the others will carefully censor the output of these generative models.
With the race to the bottom for generating high-quality, scalable, rich and colorful illustrations at almost no cost in massive quantities, I'm envisioning the world is about to get even more colorful and vibrant.
[0] https://cdn.shopify.com/s/files/1/0050/4252/files/carros_ant...
[1] https://3.bp.blogspot.com/-MzMrYtY_Ooo/US_iZSd3noI/AAAAAAABC...
[0]: https://api.time.com/wp-content/uploads/2014/04/bytecover.jp...
[1]: https://upload.wikimedia.org/wikipedia/commons/thumb/e/ee/Co...
Now the pendulum is swinging back.
Companies are making profits not seen before.
We had a blip in the history where everyone could participate in the economy - from building prototype in a garage to becoming relatively wealthy.
Now we have wage slavery and access to market gatekeeped by VC and banks.
Not a great future.
Nowadays, we have Corporate Memphis (https://en.wikipedia.org/wiki/Corporate_Memphis).
Funny really. Despite creative tooling opening up new possibilities, I see the end result as a net loss in quality. Cheap generally wins out over great.
Ever the optimist, I like remind myself that in a world where good loses out to mediocre every single time, it's easier to stand out for being great.
These older advertisements might have as much color, but they're pleasing in their simplicity. Even a solid color can be bright and beautiful, but it's not nearly as busy as a collection of overlapping gradients. I walk back my use of the word color in favor of the word busy. Thank you for pointing that out.
Counterpoint: The world may get "more colorful and vibrant", but also it will go toward uniform styles as AI will take all the commercial high-paying jobs and leave all but zero opportunities for actual artists.
At least initially, the impact will probably be more on the type of thing that even a junior designer can do in their sleep but is a lot harder for someone who isn't a designer to do.
The us copyright office has made it clear that elements of designs that lack human authorship cannot be copyrighted. A prompt is not enough - the same way if you provided a prompt to an artist while commissioning a work does not grant you copyright to that work. The results (including specific elements) of these ai models cannot be copyrighted which has extreme implications to commerical art in general. If you have your ai models come up with a character you cannot claim copyright of that character. If your ai models comes up with a composition you cannot claim copyright on that composition.
If you use the ai to generate an idea and then have a human develop the idea, the elements of the design that the ai came up with cannot be copyrighted because they lack human authorship.
Commercial operations that care about ip beware.
AI generated content is about to sprint so far ahead of the existing legal framework that something will just have to give.
using ml is already powerful and fast. protecting ideas from mass corporate ownership so that your grandchildren will be allowed to think freely is more important than chat gpt or stable diffusion or whatever algorithm replaces them next week.
Source: I was on Adobe's container infrastructure team 2017-2021, most of that time as a lead.
Think Clippy, for Code... "I see you're trying to write a recursive function to compute finocacci. Would you like help?"
Or Code Reviews / Static-Code-Analysis: "Hey Visual Studio. I've written a RESTful API for my application. What do you think of the approach, architecture, and adherence to best practices? What can I do to improve it?"
Or instead of scratching your head going "why doesn't this work?", just typing that question directly into your IDE....
Is anyone aware of any similar open source or services that handle text-to-vector generative AI?
I think I used one...maybe Kittl or Illustroke. Not FOSS though. In the FOSS world there are some really brilliant tools like potrace at the very least. That one is still built into Inkscape, I believe.
1. Are the AI systems violating the copyright protections of the images they were trained on? If so, are users of such AI systems also in violation of those copyrights when they create works derived from those training images?
Answer: That's not yet settled.
2. If you make an image with an AI system, is your new image eligible for copyright protection, or is it ineligible due to the "human authorship requirement"?
Answer: The US Copyright Office recently wrote[1] that your work is eligible for copyright if you altered it afterwards in a meaningful way. Here's a quote:
>When an AI technology determines the expressive elements of its output, the generated material is not the product of human authorship. As a result, that material is not protected by copyright and must be disclaimed in a registration application.
>In other cases, however, a work containing AI-generated material will also contain sufficient human authorship to support a copyright claim. For example, a human may select or arrange AI-generated material in a sufficiently creative way that “the resulting work as a whole constitutes an original work of authorship.” Or an artist may modify material originally generated by AI technology to such a degree that the modifications meet the standard for copyright protection.
[1]: https://www.federalregister.gov/documents/2023/03/16/2023-05...
https://news.ycombinator.com/item?id=35247377
Will say that post you linked to also states, “17 U.S.C. 101 (definition of “compilation”). In the case of a compilation including AI-generated material, the computer-generated material will not be protected outside of the compilation.” — the problem is that unlike say for example a compilation of recipes, where the individual recipes are not protected, but the compilation is, there is no clear delineation within a singular work of art such delineation. As such, injecting such delineations is counterproductive and shows no understanding of the nature and spirit of the rule of law. Further, while their opinion appears to be a prompt is somehow a recipe and not a novel expression that merits copyright, clearly photographs of the output of a recipes are commonly photographed and given copyright protection.
Sure others have made far more compelling arguments against the ruling, but to me, the ruling lacks merit as is.
Because if they stifle this is will basically cement China is the world's AI powerhouse who will give zero shits about copyright.
This is gonna be interesting times for copyright because this is the first time copyrighted works are actually useful in building tools. I think it's a very neat real-world example of how universities are actually right to make engineers take humanities courses because your code writing AI is actually better for having read Vonnegut.
A Rule by the Copyright Office, Library of Congress on 03/16/2023 ```
https://www.federalregister.gov/documents/2023/03/16/2023-05...
As is, landscape photographers for example, control camera angle, timing of photograph, camera type, lens type, etc — but they rarely create the landscape itself or for that matter the equipment and related technologies.
Even “found object” art is covered by copyright:
https://wikipedia.org/wiki/Found_object
At this point, to me, it’s unclear author of that ruling even understands technology used to create the outputs that were the subject of that ruling.
No more waiting 30 days for the next episode, hurray
Simple question. Just make it and post here the link to the result.
Or will I receive a message that this prompt is not permitted and any attempt to get around the block will result in my account being suspended - like in Midjourney?
On this last point, we have really only shared about the model and "playground" which is a web based interface to play around with Firefly. We are working on initial integrations in the tools, and will have more info on that in the coming weeks / months (particularly for Adobe Express and Photoshop).
While you can do a LOT with plugins in tools like Photoshop (which may be enough for some users), we can do much deeper integration into the tool, and integrate it in ways not otherwise possible.
(I work for Adobe)
Discovering an artist using AI generated images won’t be different.
Someone's going to have a slick and extremely powerful product where all the tools for creating and editing work seamlessly with all the tools for generating and other ML-assisted processes.
* get rights to the training data * keep artists and illustrators in the loop
Could've saved a lot of pain.
Adobe does have a legal edge here, which is interesting and perhaps actually worth a subscription if needed.
It will be interesting to watch the entire Hollywood and associated creative industries lose control to AI. Entire movies will be created in small basements. Same with AAA video games.
Who dreamed of cleaning bathrooms or flipping burgers? Too bad, that's still done by manual humans.
But who dreamed of being an artist or a writer? Great, we've figured out how to replace you with a generative algorithm!
For comparison, despite making professional music is even easier (a copy of Ableton Live Lite and a few hours of studio recording for the vocals makes for less than 300$) every single music chart is still dominated by music made by corporations (Universal Sony / Time Warner, mainly).
On the other hand, music is less valuable than ever. From 20$/unit (the price of a CD) to 0.0004c for stream. Or you get lucky and somehow someone buys your music during bandcamp friday.
Just a subset of Musicians are still around because they're famous enough to get an audience for their tours and/or dj sets. Visual artists have nothing comparable to sustain themselves.
Gamedev example: If NPCs lines can be generated quickly, maybe it's possible to develop open world games that change their character throughout the game.
Way to often addons and expansions are carefully cordoned off from the main game because no one wants to redo all that work.
Clicking through the available pages it seems like a lot of 'coming soon' talk, so there's not really any detail about any of the underlying process.
https://www.adobe.com/sensei/generative-ai/firefly.html#faqs
https://helpx.adobe.com/manage-account/using/machine-learnin...
"The insights obtained through content analysis will not be used to re-create your content or lead to identifying any personal information."
Or if they have an API it’s too expensive or crippled to be useful.
That’s Adobes 1980s DNA…. everything is a client application.
It’s a pity cause it looks like it would be fun to build with.
>Also Adobe: HOLD MY BEER!
Nothing to see here.
https://www.youtube.com/watch?v=BkTXyY9cnEs
and there is a live stream later today here:
No complaints so far really, that's always subject to change, but so far it's been a nice place to work.
Thanks!
The reason this sentence exists is because Adobe wants to create the impression among readers that it owns the output and that it's Adobe's choice how creators use those images. But under current copyright interpretation, Adobe doesn't own those images. So it's nice that it's giving permission, but that's not Adobe's permission to give -- so thanks but also heck off Adobe, nobody needed to ask you for permission in the first place. You can use any AI image commercially because AI images are not under copyright.
Of course, Adobe would love to have a world where most art is generated algorithmically and Adobe is in charge of deciding how that art gets used and what gets generated because it controls the tool. So it's in Adobe's best interest to pretend that it's granting artists a permissive right, rather than recognizing that it doesn't have any real legal argument to make that artwork generated through Firefly is owned by Adobe (or by anyone for that matter).
And that's good! It's not anti-AI to say that, because what you have to realize is that what companies want from AI image generation is a model where every single artist goes through them in order to build or generate anything. They want a model where creative tools are a service, for the same reason why Adobe wants its tools to all be subscription based. No SaaS company is getting into generative AI with the goal of increasing accessibility of art. They are (Adobe especially) interested in closing down that accessibility. They are all drooling at the opportunity to turn your workflow into a SaaS business that can only be run on extremely expensive hardware clusters.
So yes, the denial of copyright for AI-generated images does make it trickier to monetize those images, but denying that copyright has the much more important effect of making harder for these companies to lock out competitors and build services where they control/monopolize an entire creative market. You can still use AI during a creative process and end up with a thing that can be copyrighted. But Adobe can't release a tool and later on start to argue that nobody else can train competing generators using that tool, or that the tool can only be used in a particular way, or that everything the tool can generate is owned by Adobe. That matters.
It means that competitors can use Adobe Firefly output to train their own models (including locally run models like stable diffusion). It means that there's a limiting factor in place that keeps Adobe from making lazy grabs to assert ownership over large numbers of images. It means that you can pull images generated by Firefly into other pipelines without asking Adobe permission.
You can see the same thing playing out with ChatGPT. OpenAI's TOS states that you're not allowed to use OpenAI to help build something that competes with OpenAI. That's going largely unquestioned, but my strong suspicion is that it's only a TOS violation to break that rule, because again, OpenAI does not own the copyright on anything that GPT generates. So if you're not signing that EULA, it's not clear to me that OpenAI has any legal right at all to restrict you from using output that you find online as training data. As far as I can tell, current copyright consensus in the US is that the text that comes out of ChatGPT is public domain. But that's not what OpenAI wants, because if anyone can build anything using ChatGPT's output, then how is OpenAI going to build a moat around their service to block competitors? How are they going to eventually turn profitable by closing off access and raising prices once people start to rely on their service? So just like Adobe, they stick the language in and hope nobody calls them out on it.
I did that once. Never again. What a shit company. Cancelling the subscription was a total drag. Fuck you Adobe, I hope you go bankrupt sooner rather than later.
Substance Designer used to have a platform called substance share where anyone could share and open source knowledge of complex parametric textures for free to anyone with a substance account, obviously the first draft for how Adobe would get the money back from their purchase is to monetize the entire learning processes by shutting down that website and adding pay walls to near every single interaction to even learn the software, it is just so horribly shortsighted and these ideas can only be approved and implemented by sheer rentiers managers
Open source creative alternatives have a even harder time (Blender, inkscape, krita, Gnu Image Manipulation Program)...
Since Adobe lack of Linux support holds it back significantly with creatives, this makes opens source more of a challenge.
Either way, competition is always good for the market as a whole.
Sorry, couldn’t resist.