aprilledaughn

Interesting! Could be. Our analysis is based on what we know about our users' behavior but certainly not definitive. All the data here is open to interpretation.

Thanks for reporting this bug! Yup, Instabug has bugs too.

Is there anything specific you'd like to know more about? It would be great to understand what kind of info people are looking for to know what to publish in the future.

- You’re absolutely right, not all the 100M bug reports are actually bugs. However, we highlighted this under the "Time to Close" section: "These are most likely not programmatic bugs, but could be support issues or spam." How do you think we should highlight this more to avoid confusion?

- About bug resolution time, Instabug is used by many companies as their main bug reporting tool or they forward these bugs to another bug tracker like Jira and we have a two-way sync so whenever it gets resolved over there, it’s resolved at Instabug as well. That’s why we used the word "resolved" not "fixed" because each company has their own definition. I hope this makes sense.

- About the quality and reliability of the data: Oh, we didn’t mean to be protective about this! On the contrary, we’d love to get your feedback. What would you like to know?

- About your third point, I respectfully disagree. As the person who spent the most hours working on this report, I can tell you honestly that it was not for PR. We just wanted to put something out there that would hopefully be valuable to the people in our community. We initially shared this with our own users for them to have benchmarks. This is the first time we’ve released anything like it, so it was an experiment for us to be honest and I’m loving all these comments because it helps us know what to do better next time around.

Right, we're definitely not saying the iPhone is buggier than others. I guess the issue is with the wording of the claim. It would be more accurate to say "Most bugs reported through Instabug are from iPhones"

That's also why we included the bugs/user data since it shows a completely different distribution across devices.

Yes, you’re right! The report covers data from Instabug users only. We extracted data from 30K apps with a range of user base sizes, locales, devices, etc. I definitely agree with you, it’s not a definitive representation of the market, but we believe we have a good enough sample and that the findings are valuable for app developers.

We couldn’t find any other data on mobile bugs like this, so we decided to share what we have for the app dev community to have some benchmarks and insights.

Thanks for checking out the report! I'm part of the team who put it together :)

Yeah, we thought LG was interesting too. When it comes to Android, we expected Samsung to take first place tbh, but we found more bugs/user reported from LG and Google devices (Fig. 9). This could be explained by our technical user base and the popularity of Nexus devices with Android developers. So the higher proportion of bugs/user we see reported is most likely due to internal beta testing by devs.

We went into this with some expectations and were surprised by some other findings as well... like Danish being the top locale where bugs/user are reported from :D

Yikes! Sorry you had to go through that. Thanks for the heads up...