I'm also in my early 20s. Don't quit your job. Your job is stability.

If building/starting something doesn't work out then you'll be in a bad position.

Build/start something on the side, then if it becomes successful you can safely quit your job.

You might also find inspiration, collaborators or opportunities from your job. It's not all bad.