Ask HN: What are the best technologies you've worked with this year?
edit I'd also love to hear what you love about it and why.
edit I'd also love to hear what you love about it and why.
Earlier this year I got tasked with implementing a system which involved multiple mobile clients talking to a rendering server. The mobile devices had a fairly beefy browser (Nokia N900), so the client was clearly suitable to be delivered as a web app. On the server side, we already had a realtime graphics system I had written earlier, to which the web clients would need to talk over a bidirectional connection with near-realtime responsiveness.
Being a C/desktop guy with little network experience, my first intuition was to do the simplest thing I knew how to handle: linking a small embeddable web server (e.g. libmicrohttpd) into the render server, and devising some cheesy custom application-specific protocol over HTTP.
Luckily, my work partner is not as stuck in the 1990s as I am, and he suggested we use XMPP. I was sceptical at first (XML? A server written in Erlang? Do we really need to go there? I just want to tinker with my pointers...)
He showed me some demos of realtime XMPP web apps built with Strophe.js, and I was rather impressed. Then we went over our system's client/server design and how it would map to XMPP, and I was sold.
We ended up using many more XMPP features than I had initially imagined, including publish/subscribe and multi-user chat rooms. Had we gone with my original approach, these concepts would have been implemented in some haphazard way in the render server itself. Now the rendering system just talks to the XMPP server like any other client. It's stable, scalable and fast.
Still, while BOSH in the browser is pretty amazing in practice, it does feel like a hack that's stretching the reasonable limits of what web apps should be doing over HTTP. Hopefully this time next year I'll be able to say that one of the best technologies I've worked with in 2010 was HTML 5 web sockets...
Everytime I see XMPP in print, it makes me think of that media player I use to use in fvwm way back when.
The paradigm wars will rage on, but in the meantime, the rest of us have a language that has a rich library set and a very rewarding programming experience. The usefulness of applicative monads, functors and typeclasses have convinced me that there's something much, much bigger out there with regards to these so-called design patterns, something that we have not even begun to explore and discover.
My C++ process creates a queue, and binds it to the key "yummyfajitastasks". My python process (a django webapp, in this case) sends messages with the key "yummyfajitastasks". My c++ process receives them, does work, sends messages back.
Combine this with JSON or some serialization method and you've almost got erlang style messaging, except you can write part of your code in python, part in C++, part in ruby, etc.
In fact, my C++ code doesn't listen to a single queue, but many. So that simple messaging piece is equivalent to either having many separate sockets open or multiplexing many communication channels over a single socket. I also don't need to worry about message boundaries, AMQP handles that for me. Instead of building a state machine with boost::asio that parses messages, I just call "get_next_message". [1]
Also, I can have one-to-many communication if I want with no code change on the part of the sender. Suppose I have a third ruby process which is also interested in "yummyfajitastasks". I can create a queue, and listen for messages with the key "yummyfajitastasks".
The ruby process might also be interested in "sorbitstasks" (which the c++ process is not), so it could then bind it's queue to the key "sorbitstasks. So now, "yummyfajitastasks" -> c++, ruby. "sorbitstasks" -> ruby.
Messages are persistent (if you want them to be) as well.
[1] The c bindings are a bit ugly, but you can wrap it fairly easily.
It's the first Lisp that, to me, is both fun _and_ practical.
Java libraries aren't as simple as the Python counterparts but the maturity of the JVM vs. Python VM kind of balances that out.
I did buy Programming Clojure: while it offered nothing new with regard to what was available on clojure.org it was, nevertheless, a good introduction. However, it greatly helped to have experience in functional programming and other Lisps so I'm not sure how it fits to a Python programmer's experience.
I've been studying Clojure and it seems to be impressive. But I have yet to see some really impressive open source software that was written in it.
A bunch of various throwaway programs or clones of small utilities I had already written in other languages. An utility to update metadata in my oggs, a command that finds similar files, a little solver to answer questions about a given set of different relations (I actually needed such a solver to make some decisions at work so I programmed myself one), bunch of other file/text based unixish tools. Conclusion: 1) Java's I/O APIs are from hell. 2) Clojure can do a lot in only a few words of code.
Some GTK applications via libjava-gnome-java. Works much better than AWT/Swing used in many sample applications, and is much Linux friendly. Lots of Java interop training there :) Will try out LWJGL soon, in an attempt to port a small OpenGL game to Clojure: the game is mostly about experimenting some gameplay ideas so the OpenGL implementation is rather straight-forward and anything but time-critical, thus, the OpenGL backend is great candidate for porting to a new language. I've already learned that Clojure is a great help in transforming my thoughts into code so I prefer to do any prototyping in it these days.
A simple gravity simulation: a friendly way for experimenting with parallel features and transactional memory, agents etc. as you have lots of dependent things moving independently, and I got to "optimize" some Clojure number-crunching as well. And there's ants.clj and other parallel sample programs already so I could compare myself to others.
An evolutionary algorithm aimed at the travelling salesman problem, one of the very first Clojure programs I wrote that introduced me nicely to basic data structures and abstractions in Clojure such as the ubiquitous seqs. I used Swing for the GUI -- crap.
A small Reddit clone. I actually wanted to prototype a few nice ideas I had with regard to news aggregators like HN and Reddit in general so it was mostly not about Clojure. But it offered me a very welcome chance to experiment maintaining global state in an efficient and functional way (server application), got to think about how would I create a live disk-backed database hopefully mostly in Clojure, wrote some basic html generator macros in Clojure, and got some taste of Java interop by hooking the thing up to Java's http server. Excellent project and still ongoing whenever I feel like it.
A simple attempt at Casino (the card game) AI. I probably wrote a sudoku solver too although the most recent I can recall was in Haskell. But I always write a sudoku solver in a new language so I probably did one in Clojure as well.
Oh, and a small layout library for GUIs. I have a thing for those. It's rather incomplete as it was one of the very first Clojure programs I ever wrote; I could rewrite it now and make it much more shorter, faster and idiomatic should I actually come up with a _need_ to have a layout library of my own :)
That's about it, more or less. Might have forgotten something.
I've been investing quite a bit of time into Clojure and to motivate me to go further I'd like to find some software (not code snippets) I can download and see the power Clojure provides (that other tools like Ruby or C don't) in a real application.
Similar to what Rails did for Ruby.
Its also cool due to all of the other great technologies that are taking advantage of it (Mono, Parrot, Adobe CS4, Apple)
I think once llvm and clang become mature enough, the FOSS community will completely supplant gcc with this technology.
There are basic URL dispatchers and template systems, but nothing as battle-tested as Django (yet).
Easy access to streaming data was pretty nice! As is the event system but I'm afraid as a mostly client-side programmer I take that for granted.
Rails - again, not new, but I've really enjoyed it. I've built web apps in COBOL (had to at my previous employer), so being able to work with Rails has been a joy in comparison. I actually started playing around with Rails last year, but I never really did anything with it until this year. I like Ruby, although I'm not entirely sure I like it more than Python yet. It's growing on me, though. I like that I can have a basic prototype up and running in basically no time at all. When I was learning it, it was also nice that I only really had to learn one piece at a time. I tried out Django shortly before I began using Rails, being more comfortable with Python, but I felt that the learning curve was a bit steeper with Django.
Google Chrome - I'm not sure if this is the type of response you're after, but Chrome quickly supplanted Safari as my favorite browser. It's faster, the UI is slightly better, and my gripes are few and far between.
The second best is Mako. A month or two ago I switched from using Django for templating to Mako. Depending on the composition of the pages there was a 2-6x speed improvement, the code got significantly cleaner since special tags/filters weren't needed for basic opertions like less-than or modulo. Also, the ease of creating custom tags in Mako made me more willing to create them and drastically reduced code complexity.
The best technology I first used this year was jQuery. As someone who knew ECMAScript extremely well and JavaScript a bit it made me an order of magnitude more productive and made things possible that I would have been too frustrated to complete otherwise. It immediately seemed natural to work with the DOM using set operations. And it has tons of plugins which are just as easy to use. This is one of the best designed libraries I've ever used. I hope using it will act as an introduction to functional programming to people who might have otherwise been scared of it.
I've also liked working with Rails, because it has made things like i18n, testing, and implementing new features so much easier.
Finally, I've enjoyed using beanstalkd for my message queue. It's tiny and fast and it just stays out of the way. I'm using a new library I made called Peon (based off of an AMQP-based library called Minion) and it's a really easy, scalable way to bring long running tasks into the background.
Tornado: If you are going to develop on GAE, Tornado is the way to go. It is fast, well written, and only includes the core features needed for a web app.
I can't highlight how much easier it has made things for me since switching from Django. Debugging Tornado's source code was a breath of fresh air compared to Django's monkey-patched bird's nest of dependencies.
- Redis - the fastest NoSQL engine around. Easy and elegant.
- Solr - Indexing for the masses. If it only had real time search...
EDIT: Genuine curiosity, not trying to make a point.
Also, GIT. Best source control hands down.
Switching from Subversion to Git was like seeing for the first time. No more nightmare merges!
MongoDB and others NoSQL dbs, I don't have words to describe my feelings.
Jquery, well, I began to use this framework in November I was a heavy Mootools user, but jquery is just amazing, it's so simple, I don't have to write things like "x.get('value')" (annoying!).
These days I'm playing with Node.js which looks pretty amazing, in fact it's very possible I use it in a game I'm planning to do.
I also find Clojure very cool :)
http://www.amazon.com/Programming-Erlang-Software-Concurrent...
Sinatra - Very fast/easy ruby framework. (Similar to Cherry.py in the Python world).
Jquery - Can't imagine using any other framework after a year working with this.
Facebook Connect - Much more robust than I thought possible due to things like FQL and FBML.
Heroku - Super simple ruby hosting
using opencl isn't that much harder than c. obviously you need to understand a little about how gpus work, and there are all the same issues about allocating memory, segmentation faults, etc. but the compiler and runtime are quite solid, and the docs more than adequate. now that i am past the worst of the learning curve i'm looking around for more slow code, because it's an easy way to get more speed.
also, django, but others have mentioned that (it's such a breath of fresh air if you're used to using java...). next year, i hope to play with llvm some (although it will have to be on my own time - can't see how to do that at work...)
jQuery. A great javascript library.
I learned F# and built a DSL in about a week using it.
I love the way Apple doesn't care what anyone else thinks about their language and has ridiculously verbose 40 character long method names to make code clearer.
Love it!
Haskell isn't really new, but it still is the best programming language I've worked with (yes, "best" is personal in this case). I don't think any other language allows me to write programs that are more concise.
The other thing that 2009 brought me was iPhone Development. Although I don't like Objective-C that much, the Cocoa Touch framework is excellent. Once you get a grip on it and on the design patterns your code tends to get very small, too.
With both these technologies I shared the same experience: at the start they look incomprehensible and working with them made me less productive. However, only after really learning them I started to full appreciate all the things.
Not a software technology: http://www.c-thru-music.com/cgi/?page=prod_axis-49
This thing is amazing, especially if you aren't already an experienced keyboardist; it makes all the note relationships easier to learn so you get to the "fun" part of playing faster.
Javascript. This year, the full potential (and diversity) of this language has truly revealed itself to me, especially with the maturing of frameworks like Cappuccino (which is a testament to what can be done with JS).
Using Git is the first time I've properly been able to integrate source control into my workflow, without it being a pain!
VPS (cloud hosting). Being able to spin up a server quickly and cheaply has really facilitated my ability to experiment and is highly conducive to learning about these new technologies.
I think it's been a great year for innovation. 2010 should be pretty exciting too. New Years Resolution: explore server side Javascript (i.e node.js) and build something awesome with Rails!
'Open' is the best way to innovate (small steps of improvement) on something.
Zynga (the company and the concept) proved to be successful with enough leverage and network effects Facebook provided.
Easy to get started, fast, stable, the community is helpful and it is easy to read their source code if you get stuck somewhere.
The ability to create custom Linux spins and even full system software thumbdrives make drive failures / system recovery much less impacting. It also makes "ready to go" installations a snap.
A more one-sided review goes to Evernote :-)
GWT: code for the browser like it's 1984.
- dynamic languages: ruby/rails/merb/sinatra,, python/django/twisted/tornado, groovy/grails (nobody mentioned scala very much)
- FP, erlang, clojure, F#, haskell;
- noSQL: KV store, doc-oriented db, ..
- message queues and brokers: AMQP, rabbitMQ, XMPP,
- javascript/ browser capabilities: jquery, node.js, BOSH, other libs
- hosting, deploy, VCS: VPS, EC2, git,
This is in AS3, used in flex. It's a joy to process xml with it.
It has transformed my thinking about data (i'm a postgres guy), and just made Rails more fun now. The sites I did are also blazing fast.