HNHacker News
TopNewBestAskShowJobs

dsiroker

2,126 karma · joined October 17, 2008

Founder & CEO of Scribe AI Founder & CEO of Mind Emulation Foundation (YC W18) Co-Founder of Optimizely (YC W10)
submissionscomments
dsiroker··on Mind Emulation Foundation
The connectome includes the weights.
dsiroker··on Mind Emulation Foundation
When you wake up in the morning billions of your cells have changed from the night before. Are you any less you?

It is possible one day you will go to sleep biologically and wake up non-biologically. It’s just a matter of sufficiently emulating the processes that were present when you were the biological you.

dsiroker··on Mind Emulation Foundation
I’ve posed this claim to dozens of neuroscientists. If you consider the connectome just the static connections then you might be right. If you include the dynamics of the brain (the biochemical processes) as part of the connectome then most neuroscientists would agree that is sufficient to produce the emergent property of mind. The honest answer is we don’t know yet. That said, it’s likely not necessary to model every atom’s interaction with one another so there must be a level of abstraction sufficient enough to emulate a mind. Our foundation is trying to identify what is the minimal level of abstraction necessary to emulate a mind.
dsiroker··on Mind Emulation Foundation
(I’m the founder & CEO of the Mind Emulation Foundation)

Flattered to see this hit the front page! This is a project I’ve been passionate about for a while and been keeping it mostly under the radar.

Now that it’s public, I’m happy to answer any questions the HN community has.

dsiroker··on Nova AutoML: A New Architecture for Predictive Insights
What a great addition to an already great product!
dsiroker··on Stop Launching. Start Rolling Out
I am really proud of our free rollouts offering and welcome your feedback or questions!
dsiroker··on Optimizely’s decision to ditch its free plan
When I started Optimizely with my co-founder, Pete Koomen, our goal was to enable anyone in the world to do website A/B testing. I believed then, as I do now, that we are democratizing the scientific method. That said, when a company doesn’t consider experimentation a business critical process, they are unlikely to dedicate the internal resources necessary to make it successful. We experimented (ha!) with a free plan to see if it would be a good model for getting customers to dip their toe into A/B testing. Turns out, the data showed it wasn’t as effective as a robust free trial, which we continue to offer for all products.

Also, A/B testing is far from dead. Companies that have a culture of experimentation have grown their market cap by 756% in the last five years. See our Opticon keynote for more context: https://www.optimizely.com/opticon/

dsiroker··on Launch HN: ClearBrain (YC W18) – predictive models for app conversions and churn
This is a great team and product!
dsiroker··on A Knock at the Door
You make a great point and I should have done a better job defending my vilification of the ICE agents. They violated his rights by even entering his home without a warrant. Not only that but as a student and being married to a citizen, he had rights that were violated. I don't think the ICE agents were merely "following orders" and do deserve some of the blame for the situation. I don't have great answers to your questions but I do think it starts by adhering to our constitution in situations like this (namely the 4th, 5th, and 14th amendments which apply to non-citizens) and then we can go from there.
dsiroker··on ‘Hamilton’ and History: Are They in Sync?
I watched the musical in January and I just finished the audiobook version of the Chernow biography of Hamilton (pro tip: listen at 2x speed to save 19 hours) and I have to say the musical stuck VERY close to the biography. A few embellishments for dramatic effect but the substance is all spot on. Unless the biography is flawed, I'd say that ‘Hamilton’ and History are very much in sync.

In case you want to learn more, I posted "Three Timeless Truths Entrepreneurs Can Learn from Alexander Hamilton" earlier today based on what I learned from the biography: https://news.ycombinator.com/item?id=11475047

dsiroker··on Optimizely (YC W10) lays off 10%
This was a hard day for us at Optimizely but it was even harder for the individuals directly impacted. I want to reiterate that I chose to share this publicly because I care deeply about the individuals affected and believe the world should know that this decision was driven by factors outside their control and shouldn’t be viewed as a reflection of their performance.
dsiroker··on Ask HN: Who is hiring? (October 2014)
Optimizely - San Francisco, CA - Fulltime, Permanant. Intern/H1-B okay as well.

Optimizely is a website optimization platform. We enable businesses to show the right thing to the right person at the right time. Our first product makes A/B Testing easy. In 5 years we’ve grown to become #1 in the category with 8,000+ paying customers including Starbucks, Disney, and Salesforce. We're profitable and our revenue is growing 400% year-over-year. Last May, we raised 58 million dollars to allow us to continue building great new products. Join us in our mission to empower businesses to make better data-driven decisions.

About the Job: We have scale: 7,000+ customers (including 100 of the top websites in the world); 120 billion server requests/month You’ll work on our amazing visual editor - a cutting edge tool that is the core of our product - and will enable it to do even more awesome things for our customers Work in small teams, in a continuous integration environment; we’re fast and nimble: 1-2 deployments every day

About Us: You’ll work on our amazing visual editor - a cutting edge tool that is the core of our product - and will enable it to do even more awesome things for our customers. We are also building a mobile SDK for both iOS and Android and are working on some great new products.

Requirements: A track record of being able to ship product, independently and/or as part of a small team. We will leave out the long list of languages because we would prefer a great engineer to someone who knows some Ruby.

Bonus Points: Passionate about front end technologies, you have a curiosity that motivates you to experiment and keep on top of technical trends Practitioner of progressive enhancement, and responsive UI design Good at debugging using dev consoles, firebug, firecookie, or any of your favorite tools Fearless - you’ll tackle a massive JavaScript codebase, and are willing to prototype crazy, awesome ideas

Perks: Free city-wide Gym membership at any Crunch Fitness. Free Clipper Card to pay for your commute from anywhere in the bay area. Catered in-office lunch and dinner on weekdays. Full medical insurance with very low co-pay and deductible. HMO, PPO, and HSA options available. Full dental coverage including orthodontics. Full vision coverage including contacts. Dependents 100% covered for medical, dental, and vision. Unlimited vacation policy. 401k benefit. Top-of-the-line MacBook Pro or MacBook Air and 30" monitor. Working with a great team and having a huge impact!

If you're interested, please shoot me an email at Ryan.Jordan@optimizely.com!

dsiroker··on Winning A/B results were not translating into improved user acquisition
Hi pmiller, Dan from Optimizely here. Thanks for your thoughtful response. This is a really important issue for us, so I wanted to set the record straight on a couple of points:

#1 - “Optimizely encourages you to stop the test as soon as it reaches ‘statistical significance.’” - This actually isn’t true. We recommend you calculate your sample size before you start your test using a statistical significance calculator and waiting until you reach that sample size before stopping your test. We wrote a detailed article about how long to run a test, here: https://help.optimizely.com/hc/en-us/articles/200133789-How-...

We also have a sample size calculator you can use, here: https://www.optimizely.com/resources/sample-size-calculator

#2 - Optimizely uses a one-tailed test, rather than a 2-tailed test. - This is a point the article makes and it came up in our customer community a few weeks ago. One of our statisticians wrote a detailed reply, and here’s the TL;DR:

- Optimizely actually uses two 1-tailed tests, not one.

- There is no mathematical difference between a 2-tailed test at 95% confidence and two 1-tailed tests at 97.5% confidence.

- There is a difference in the way you describe error, and we believe we define error in a way that is most natural within the context of A/B testing.

- You can achieve the same result as a 2-tailed test at 95% confidence in Optimizely by requiring the Chance to Beat Baseline to exceed 97.5%.

- We’re working on some exciting enhancements to our methodologies to make results even easier to interpret and more meaningfully actionable for those with no formal Statistics background. Stay tuned!

Here’s the full response if you’re interested in reading more: http://community.optimizely.com/t5/Strategy-Culture/Let-s-ta...

Overall I think it’s great that we’re having this conversation in a public forum because it draws attention to the fact that statistics matter in interpreting test results accurately. All too often, I see people running A/B tests without thinking about how to ensure their results are statistically valid.

Dan

dsiroker··on Ask HN: Who is hiring? (August 2014)
Optimizely - San Francisco, CA - Fulltime, Permanant. Intern/H1-B okay as well.

Optimizely is a website optimization platform. We enable businesses to show the right thing to the right person at the right time.

Our first product makes A/B Testing easy. In 4 years we’ve grown to become #1 in the category with 7,000+ paying customers including Starbucks, Disney, and Salesforce. We're profitable and our revenue is growing 400% year-over-year. Last May, we raised 58 million dollars to allow us to continue building great new products.

Join us in our mission to empower businesses to make better data-driven decisions.

About the Job:

We have scale: 7,000+ customers (including 100 of the top websites in the world); 120 billion server requests/month You’ll work on our amazing visual editor - a cutting edge tool that is the core of our product - and will enable it to do even more awesome things for our customers Work in small teams, in a continuous integration environment; we’re fast and nimble: 1-2 deployments every day

About Us:

You’ll work on our amazing visual editor - a cutting edge tool that is the core of our product - and will enable it to do even more awesome things for our customers. We are also building a mobile SDK for both iOS and Android and are working on some great new products.

Requirements:

A track record of being able to ship product, independently and/or as part of a small team. We will leave out the long list of languages because we would prefer a great engineer to someone who knows some Ruby.

Bonus Points:

Passionate about front end technologies, you have a curiosity that motivates you to experiment and keep on top of technical trends Practitioner of progressive enhancement, and responsive UI design Good at debugging using dev consoles, firebug, firecookie, or any of your favorite tools Fearless - you’ll tackle a massive JavaScript codebase, and are willing to prototype crazy, awesome ideas

Perks:

Free city-wide Gym membership at any Crunch Fitness. Free Clipper Card to pay for your commute from anywhere in the bay area. Catered in-office lunch and dinner on weekdays. Full medical insurance with very low co-pay and deductible. HMO, PPO, and HSA options available. Full dental coverage including orthodontics. Full vision coverage including contacts. Dependents 100% covered for medical, dental, and vision. Unlimited vacation policy. 401k benefit. Top-of-the-line MacBook Pro or MacBook Air and 30" monitor. Working with a great team and having a huge impact!

If you're interested, please shoot me an email at Ryan.Jordan@optimizely.com!

dsiroker··on Optimizely Raises $57 Million
You are generally right. The vast majority of our customers don't need help and hence our homepage is basically just a text box to enter a URL and get started.

That said, there are other folks who do need a little extra help so we built them an academy.

dsiroker··on Optimizely Raises $57 Million
Sorry to hear that! Our goal is to make Optimizely so easy to use it just works. Clearly we've failed in this case. I'd love your feedback on what we could have done better to improve your experience.

FWIW, two weeks ago we launched our Optimizely Academy to help folks like you go from zero to hero: https://learn.optimizely.com/hc/en-us

dsiroker··on The Most Misleading Measure of Response Time: Average
You are exactly right and this presentation is spot on.
dsiroker··on The Most Misleading Measure of Response Time: Average
You are right that if one variation takes longer to load and is noticeable it is likely to cause a lower conversion rate. However with Optimizely the response time (on average and 99th percentile) is the same between control and test variations since our implementation is a single snippet of code regardless of what bucket you are put into.

What we are optimizing here for is end-user experience and minimizing the chance they have a higher-than-tolerable response time regardless of the variation they see.

dsiroker··on The Most Misleading Measure of Response Time: Average
You are exactly right. The goal here isn't to optimally describe the entire distribution but to improve the end-user experience for higher-than-tolerable response times. The difference between 80ms and 100ms isn't noticeable. Between 100ms and 1000ms it certainly is.
dsiroker··on The Most Misleading Measure of Response Time: Average
Check out the whitepaper, it has a lot of details about that. :)

Direct link: http://pages.optimizely.com/CDNBalancingWhitepaper_GeneralLP...

dsiroker··on Optimizely Raises $28 Million to Go Global
We're thrilled to have opened our first international office in Amsterdam! We have a phenomenal team of sales and support folks who speak many of the languages out there. Our hope is to delight our European customers as much as we've delighted customers back here in the U.S.

Here is a video of the office in Amsterdam: https://vimeo.com/63432751 Come by and visit!

dsiroker··on Optimizely Raises $28 Million to Go Global
Hi Jacques, we have pulled together the same data in terms of adoption for the top 100k and top million and they look very similar.

A great source for this data if you are looking to dive into it is http://trends.builtwith.com/analytics/Optimizely

dsiroker··on Optimizely Raises $28 Million to Go Global
You got it! Any questions in particular you'd like me to address?
dsiroker··on First they ignore you, then they laugh at you, then they fight you, then you win
Obviously features are important but it turns out that most businesses simply want an easy to use platform that "just works." Most of the customers who switch from T&T to Optimizely start off by trying both concurrently and evaluating whether Optimizely has what it takes to supplant T&T. When their T&T contract comes up for renewal, they shift their entire budget to Optimizely.
dsiroker··on First they ignore you, then they laugh at you, then they fight you, then you win
Thanks for the long and thoughtful comment. I'll try to answer all of your questions point by point.

Regarding the 1.3 billion visitors: we define this as the sum of all the unique visitors to each experiment that have been run through Optimizely. We purposely avoided calling them 1.3 billion "unique" visitors because some people will be bucketed into multiple experiments and across multiple customers. We purposely do NOT include people who were not bucketed as part of the experiment/control groups. If we did, this number would likely be much higher since many of our customers use our traffic allocation feature that let's them only sample a small fraction of their traffic to include in the experiment: http://support.optimizely.com/customer/portal/articles/58196...

I wholeheartedly agree with your point that many of the players who started after 2008 have far superior implementations due to the advancements in browser technologies which T&T failed to capitalize. We certainly stand on the shoulders of giants. We would not exist as a company without jQuery, Akamai, Google App Engine, and Amazon Web Services. Not to mention the fact that browsers are much faster and can execute JavaScript in real-time to manipulate the DOM before the page is rendered in the browser and shown to the user.

As for revenue numbers: one of the advantages we have as a startup is that we are not required to publicly tell the world how big we are. If Omniture knew how big we were they might actually allocate resources to try to improve their products.

You are right that many of our 2,800+ customers pay us far more than our highest listed price of $399.

As for top customers in the categories you mentioned we are thrilled to have Disney, Starbucks, Salesforce, Crate&Barrel, GoDaddy, Footlocker, Electronic Arts, CareerBuilder, and more. It's refreshing to see companies that are traditionally "sold to" using a enterprise sales approach who are eager to embrace the shift to more nimble products that "just work." Old school sales tactics are falling on deaf ears as companies shift toward purchasing more like consumers. The vast majority of our customers come to us through word-of-mouth. We are riding the wave of the consumerization of enterprise.

dsiroker··on Optimizely Surpasses Omniture Test&Target
See my comment earlier. A couple of reasons including press, announcing our funding, and better SEO.
dsiroker··on Optimizely Surpasses Omniture Test&Target
Thanks!

If you look back you can see we've been growing at a pretty steady clip every since we launched: http://trends.builtwith.com/analytics/Optimizely

However you are right that there does seem to be an inflection point in May 2012. I can only speculate why this happened. Here are a few possible reasons:

1. We got really lucky with a bunch of great press at the end of April including a phenomenal piece in Wired: http://www.wired.com/business/2012/04/ff_abtesting/ and a piece on CNN: http://www.youtube.com/watch?v=TEpsfQHNUxU

2. We announced our funding: http://blog.optimizely.com/2012/05/30/optimizely-surpasses-g...

3. Probably in some part because of #1 we started ranking very high for organic search terms. For example we are now the first ranked result for "website a/b testing" on Google.

Hope that answers your question!

dsiroker··on Bootstrapped Wingify moves to a bigger office and hits 1600+ customers
Good point and we'll clarify the terms of service and make our SLA more prominent.
dsiroker··on Bootstrapped Wingify moves to a bigger office and hits 1600+ customers
It's great to see multiple products in the market trying to solve this problem and I admire your ability to do so without a large team or any funding. It's unclear how the market will grow in the future but we're thrilled to see Optimizely grow +397% amongst the top 10,000 websites in the last year to over 2,500 happy customers.

I'm glad to see you are focusing on improving your response time. Unfortunately hitting live servers serving dynamic content in 5 locations is never going to be able to beat 100,000 edge-cached nodes in 75 countries serving static content when it comes to response time and reliability.

According to the link you provided it looks like Pingdom reports VWO response times as:

VWO Slowest Average: 352ms

VWO Overall Average: 207ms

VWO Fastest Average: 45ms

According to Pingdom, Optimizely response times are:

Optimizely Slowest Average: 95ms

Optimizely Average: 65ms

Optimizely Fastest Average: 19ms

Here is a head-to-head comparison of Optimizely vs. VWO including response time and feature differentiation: http://i.imgur.com/BRTxC.png

To clarify some of the points you might have misunderstood:

- Here is a demo showing the Optimizely visual mobile editor: http://www.youtube.com/watch?v=HucXw_egPRs

- Documentation of Optimizely one-click integrations: http://support.optimizely.com/customer/portal/articles/58188...

- The Optimizely API is publicly available at: https://www.optimizely.com/docs/api

You are right we don't currently offer ancillary features like heatmaps and usability testing. We've been focused on offering the best possible experience for A/B and multivariate testing.

dsiroker··on Bootstrapped Wingify moves to a bigger office and hits 1600+ customers
We offer our 100% money-back satisfaction guarantee prominently on our pricing page located at https://www.optimizely.com/pricing

All plans come with a 30 day FREE trial and a 100% Satisfaction Money Back Guarantee.

Our SLA is part of the Mutual Services Agreement contract we have with customers.

← PreviousPage 3 of 5Next →