HNHacker News
TopNewBestAskShowJobs

the_real_r2d2

33 karma · joined July 17, 2009

Web Page: http://arturo.servin.googlepages.com/ http://www.google.com/profiles/arturo.servin

Blogs: http://arturo-servin.blogspot.com/ http://arturo-servin-research.blogspot.com/

Twitter: http://www.twitter.com/the_real_r2d2

FriendFeed: http://friendfeed.com/arturoservin

E-mail: arturo.servin _at_remove_this gmail dot com

submissionscomments
the_real_r2d2··on Reinforcement Learning: An Introduction
In theory yes you could. RL is based on trial and error. The agent senses the environment in the form of states (ligh=state1, dark=state2) and it performs actions according to a policy to receive positive or negative rewards. For example your goal is to have a room always lighten, the agent will sense the environment (it is dark) it will turn the lights on and it will receive a positive reward. Eventually the agent will learn that in order to receive positive rewards it needs to turn on the light when it is dark and turn it off when it is light. Actually RL it is more complex than that but that is the basic idea. If you are interested go to scholar.google.com and search for papers about reinforcement learning. Important authors are Barto, Sutton, Watkins (Q-Learning), Littman, Kudenko, Stone, Clauss, etc.
the_real_r2d2··on Dropbox has an IANA port number now
So bad nobody will use it. Many enterprise firewalls only allow port 80 today and a bunch of well know applications.
the_real_r2d2··on Google Living Stories
Thanks and good luck!
the_real_r2d2··on Google Living Stories
Same question (as I posted in the main thread), if it possible to you to answer. Are you using machine learning, human editoring or both?
the_real_r2d2··on Google Living Stories
I wonder if they are using machine learning, humans editors or both.
the_real_r2d2··on Apple's Mistake
For me it is much simpler, Apple became much greedier that it was. They saw the opportunity to monopolize the market and they took it without any remorse.
the_real_r2d2··on Want to cross the border illegally? There's an app for that
Probably this would be illegal, but crowsourcing the position of border patrols is another use. It would add social network capabilities to the app.
the_real_r2d2··on The History of the Internet in a Nutshell
Google was important but I agree that the first search engine should have been there. IPv6 was also missed there, still not fully operational but it has been there for a while. Internet worms (i.e. Code Red) were also important, they raised some alarms related to security practices in OSs and applications.
the_real_r2d2··on The Problem with Twitter Lists
I agree with some of the statements of the blog. However it misses one important point in how people use lists. For example I follow around 300 people, some of them are very noisy some times but eventually they post something interesting, so I feel that the noisy is an acceptable price to pay. Nevertheless, because of the overflow of information, many times I miss posts of quiet people that generally have something important to say. Then, lists come to the rescue. I just put those very interesting people in a list that I can check for time to time. If people follow my list(s), they give the authority that I created it(them)or whatever I do not really care. For me that is just marketing trying to convince of the value of twitter. For me, the value is finding good content with less effort; and I think the lists are helping on it.

Note: I use also tweetdeck that has a similar concept, which I found very useful. Perhaps that is why I liked the lists concept.

the_real_r2d2··on Arduino pop3 email checker
If you are in the UK I would recommend:

http://oomlout.co.uk/?blog

I personally know the guys running the store.

the_real_r2d2··on Arduino pop3 email checker
What about bluetooth?
the_real_r2d2··on Arduino pop3 email checker
Arduinos are very good to hack projects. They programming language is very similar to C.
the_real_r2d2··on [dead]
Yep, that normally happens. In my case I did not know about Go! until I read about Go.
the_real_r2d2··on Python in the Scientific World
For beginners there is also an on-line book:

http://www.nltk.org/book

the_real_r2d2··on Python in the Scientific World
Have you tried R?
the_real_r2d2··on How to get automatically rejected by an angel investor
But as a entrepreneur, Do you really know that data? What are your sources? What are your tools to make the forecast? Yes, generally you do not have any of them and they know that. Your forecast is just a very empirical calculation with a large margin of error.
the_real_r2d2··on How to get automatically rejected by an angel investor
I think there are different monsters. One thing is to project what are you going to do in the next five years and another completely different is to forecast what are you going to "sell". I think the post implies that the later is crap. For the former I imagine that all of us know that things are going to change (as I think you imply too about a PhD program).
the_real_r2d2··on Google Dashboard
I used to check some of this information on "Account Settings" but this is much more complete.
the_real_r2d2··on WaveSandbox.com: Federate This
Never mind, I found it.

http://www.waveprotocol.org/draft-protocol-specs/draft-proto...

the_real_r2d2··on WaveSandbox.com: Federate This
Is there a document explaining the protocol, something such as the RFCs of the IETF?
the_real_r2d2··on Traffic Server is finally here (Y's http proxy/cache server)
Wow, Inktomi. I had years without listening that word.
the_real_r2d2··on No new IP adresses by next year?
You cannot sell them, at least openly. If they cached you, you could lost all your allocations.
the_real_r2d2··on MLComp - The Best Method for your Data
There are many applications that do not require unique algorithms and can be solved using simple regressions. Also not everybody has access to a ML expert to code a solution (even if this only requires a simple ANN using an opensource library).
the_real_r2d2··on MLComp - The Best Method for your Data
Machine learning as a service, very interesting. I found a similar site some months ago. I looked over my bookmarks but I could not find it. The idea was similar, you upload a data-set and they execute different learning algorithms over it. I do not recall if you also provide an evaluation or they automatically split the given data-set.
the_real_r2d2··on DARPA Network Challenge
Not necessary. If you assume that people is going to spread the news in twitter (or blogs, facebook, etc.) when they find a balloon, the locations is not a restriction. You just need a smart enough engine to search and find those tweets. Now, the "smart engine technology" is the difficult task (and for sure what DARPA is looking for).
the_real_r2d2··on Yahoos Learn To Wear Ties To Big Meetings
I think ties are for big consolidated enterprises that are slow and difficult to move (or at least that is my prejudge). Yahoo! does not need ties, they need to move fast and get in top of Google, MS, Facebook and Twitter. They have to re-invent themselves if they want to survive.
the_real_r2d2··on Yahoos Learn To Wear Ties To Big Meetings
Look at his eyes and the expression in his face. He is not comfortable and he does not believe what he is saying. He WANTS to believe it though. Or perhaps I've just watched "Lie to Me" too much.
the_real_r2d2··on Being Successful as a Distributed Team
We have been working remotely for a while. It is difficult but it can be done. I would like to add a couple of applications that we have used to make our life easier:

- Etherpad.com for real-time document colaboration - Google documents, if privacy is not a concern

Also, because it is very difficult for us to get together, every time that we can do it we try to maximize the time (no dumb and useless meetings, going straight to the important points, etc.). As result, our face-to-face meetings are very productive.

the_real_r2d2··on Announcement: YC alumni will help us read applications
Adding some randomness could help to avoid over-fitted populations. Then you could prevent to converge to a sub-optimal state and force the system to look beyond of what it seems the best.
the_real_r2d2··on AT&T cellular IP reveals iPhone users' location?
In the old times of WAP, mobile operators had gateways, so even though you could get the IP address of the phone (from a server-side for example) the information was meaningless to locate the user. With AT&T 3G I honestly do not know. May be someone could do some basic hacking and post some results.
Page 1 of 3Next →