From personal experience (I've been in the market for coffee shop businesses of all types in Los Angeles for a couple years - from family owned tiny mom and pop stores to franchises), it's all about the location unless you have a lot of hype and if you have both even better. Anyone can start a coffee shop and stock their display cases with local/well known bakeries and coffee providers, but you need all kinds of customers (both the people who occupy a table with only a $1 cup of coffee all day long and the people who rush in and out, both something you can't get if you are badly-situated) and not just a little something extra. The latter is typically a way to get people to come to your store rather than another close by, or a little perk for your customers so they'll return later.
Plus, there's always Starbucks and Coffee Bean and Peet's to deal with...sigh.