Hacker News Reader

krgon Web Framework Benchmarks Round 5

Round 1 used Passenger, but the feedback we got was that Unicorn performed better so we switched to that. Currently, we're aiming to show each framework in the best possible production configuration. In the future we plan to show multiple web/app servers per framework so that you could compare Ruby on Passenger vs. Ruby on Unicorn.

krgon [dead]

I look forward to similar documentation of all the other HTTP response codes.

krgon Web Framework Benchmarks Round 4

I created a Github issue to address the upgrade to 3.2.13, and pfalls is working on getting this done.

https://github.com/TechEmpower/FrameworkBenchmarks/issues/24...

I encourage you to benchmark Rails 4 yourself and see if there is a measurable difference from the latest 3.2.x, to get a preview of the impact it will have. When Rails 4 is released we'll definitely want to upgrade to that.

Edit: pfalls is too fast for me, and just completed the upgrade to 3.2.13 and closed the issue. The next round will use Rails 3.2.13.

krgon Linode Manager Two-Step Authentication

This isn't proof of anything, but a few days after this incident the CC I use for Linode got a fraudulent charge, the first such in years. I cancelled the card, so no big deal, but this makes me strongly suspect that the attacker ended up with actual card numbers, regardless of the passphrase.

krgon Web Framework Benchmarks Round 4

At this point, most of the tests were contributed/improved by the community. Not all have been reviewed by experts in that framework, and I agree that an "expert reviewed" marker would be nice.

That said, we have tried to not run anything in the "default" configs, but rather the "production deployment" configs if we could find documentation on that. Unfortunately there is a huge variability across frameworks in how good the "production deployment" documentation is.

krgon Web Framework Benchmarks Round 4

If you have improvements to the test (that would be realistic for a production deployment) then please submit a pull request. We definitely want to show each framework doing the best it can do.

A few frameworks have a "stripped" version (just Django and Rails so far) to try to show the best that can be achieved when typical functionality is stripped out. Essentially optimizing for this test, which is interesting even if it isn't the point of these benchmarks. If you think Symfony2 would benefit from a separate "stripped" test then please consider a submitting a pull request with that.

krgon Web Framework Benchmarks Round 4

Raw PHP (with no framework, no ORM) does well in the 20 query test, but unfortunately you have to go down pretty far before any of the PHP frameworks show up on that list.

If I filter to just show PHP, the 20 query test shows that the first framework is less than 50% the performance of raw PHP.

krgon Web Framework Benchmarks Round 4

We are using opcode caching.

"PHP 5.4.13 with APC, PHP-FPM, nginx"

http://www.techempower.com/benchmarks/#section=environment

We've had a lot of input from the PHP community about setting up the PHP tests properly, but if you have a suggestion for an improvement we'd appreciate it.

Memcache isn't used because none of the tests are caching database results. A later test will use caching.

We'd be happy to include Yii. Submit a pull request. :)

krgon Web Framework Benchmarks Round 4

Ruby 2.0.0-p0

http://www.techempower.com/benchmarks/#section=environment

krgon Frameworks Round 3

Wt was suggested before, and we'd love to include it. Care to submit a pull request?

https://github.com/TechEmpower/FrameworkBenchmarks/issues/92

krgon Frameworks Round 3

All the PHP tests were done with the APC opcode cache, running within PHP-FPM.

http://www.techempower.com/benchmarks/#section=environment

If this can be improved, please let us know. A pull request would be ideal.

krgon Frameworks Round 3

All the PHP tests were done with PHP 5.4.13 with APC, PHP-FPM, running behind nginx because previous feedback suggested this was optimal.

http://www.techempower.com/benchmarks/#section=environment

krgon Frameworks Round 3

It's our internal framework.

From our first benchmarks post: http://www.techempower.com/blog/2013/03/28/framework-benchma... "Why include this Gemini framework I've never heard of?" We have included our in-house Java web framework, Gemini, in our tests. We've done so because it's of interest to us. You can consider it a stand-in for any relatively lightweight minimal-locking Java framework. While we're proud of how it performs among the well-established field, this exercise is not about Gemini. We routinely use other frameworks on client projects and we want this data to inform our recommendations for new projects.

krgon Requests per second vs. concurrent connections

You can click "stop animation" at the bottom right to turn that off.

krgon Web Framework Benchmarks Round 2

Just ignore Gemini. In fact, you can click the "hide" link on the charts to remove it.

krgon Web Framework Benchmarks Round 2

Ok, help us out: Given that we have Wrk set to max out at 256 concurrent requests, what would the ideal tuning for php-fpm? A pull request would be ideal, but you can also just tell us. :)

krgon Web Framework Benchmarks Round 2

In fact we've already got a pull request that includes Cowboy and Elli: https://github.com/TechEmpower/FrameworkBenchmarks/pull/50

We'll be including this in the next round.

krgon Web Framework Benchmarks Round 2

Where possible on the tests, we tried to use something other than raw SQL because we wouldn't expect someone to use raw SQL everywhere when writing a real application. We chose Korma because it seemed decently popular for Clojure, but we're certainly open to a "compojure-raw" test that uses clojure/java.jdbc. Feel free to submit a pull request. :)

krgon Web Framework Benchmarks Round 2

PHP was tested behind nginx this time due to community feedback we received, not Apache.

krgon Web Framework Benchmarks Round 2

https://github.com/TechEmpower/FrameworkBenchmarks/tree/mast...

See php.ini, php-fpm.conf.

krgon Web Framework Benchmarks Round 2

We're interested in that, too. In progress is the onion http library pull request from davidmoreno:

https://github.com/TechEmpower/FrameworkBenchmarks/pull/43

We hope to get more as well.

krgon Web Framework Benchmarks Round 2

Note that the results data is available as JSON if you want to play with different sorting yourself: https://github.com/TechEmpower/FrameworkBenchmarks/blob/mast...

As pfalls said, we're definitely open to different ways to present the data. More sorting would be cool.

krgon Web Framework Benchmarks Round 2

We did. PHP 5.4.13 with APC, using PHP-FPM, running behind nginx.

krgon Web Framework Benchmarks Round 2

The contributions from the community have been great. To those who submitted pull requests that didn't make it into this blog post: We've been overwhelmed (in a good way) with the response and we're working to include as much as we can. Thank you!

krgon PostgreSQL 9.2.4, 9.1.9, 9.0.13 and 8.4.17 released

I'm surprised this is so common. I've never set up any database accessible to the public-- I've already got to worry about securing the public-facing web server, why add another vector for attack?

krgon Web Framework Benchmarks

There is a huge difference between raw PHP and CakePHP. I'd be curious to see other PHP frameworks (such as Zend, or Slim) in there-- is Cake just particularly slow, or is that simply what happens when you have a PHP framework?

krgon 129 new Taskforce sites launched

That location selector is very nice looking, and intuitive.

krgon Everything about Java 8

I'm not sure what you mean exactly, but as mentioned in the article they've built a new JavaScript engine (to replace Rhino) to be included in Java8: http://openjdk.java.net/jeps/174

krgon Everything about Java 8

This looks very thorough. I appreciate the detailed coverage of lambdas as well-- this is already helping my understanding.

krgon FreedomBox Version 0.1 Released

This preliminary release is just for developers to try out, but I support the aims of FreedomBox and I hope they can keep up the momentum.