The curious case of DuckDuckGo
hacksandthoughts.posterous.com
hacksandthoughts.posterous.com
But if you typed "cup of java" or "java island" there would be no mistake. Those people wanted coffee and Indonesia. So that's what links you get.
I have used DuckDuckGo as my primary search engine. But it is not competition for Google. Google is much, much more advanced.
If I typed in a proper name and that proper name was tied to an address in my area such as by being in the local white pages or having an address on a website, I would see the local result for that name because Google looked up the geolocation of my IP. That sounds a little creepy, but I got what I wanted. Google gave that link extra weight for being near my location therefore it wasn't buried on page 50. That's incredibly smart. How would DDG solve the same problem? It doesn't even try.
Re: local search, we're bringing in datasets from services like Yelp. For an example see: https://duckduckgo.com/?q=Wood+tavern. We're always looking to improve, so if you've got interesting local data, please reach out.
Yes. And that is where I think it goes wrong. The fact that a lot of people misspell should not be used to correct a person's right search to a wrong one. That's not the right thing to do. It should suggest a different search, but not change my search altogether.
As an example, if I place an order for a Chicken Burrito but am served a Beef Burrito because that's the most popular dish, it would not be okay. Same applies to search.
Google is much, much more advanced.
Yes! I said they over did it.
Obviously in that situation they would just ask you to clarify your order before making a burrito, but if they had the ability to serve burritos as fast as Google serves results, then for the majority of cases (assuming the beef burrito is most popular) the outcome is satisfactory and it isn't worth the time or effort to ask and wait for an answer.
the menu contains almost every word in almost every language that's online (plus many misspellings and made up words and lists of meaningless character permutations and...), so if you are going to automatically correct a query, some set of words that are on the menu are going to have to be excluded.
On the other hand, if we accept that this case was suboptimal, the solution seems to be one of:
1) never autocorrect, only offer a "did you mean." I would bet this would result in more people having to click than the current situation (in spite of the annoyances reported in this thread).
2) be more conservative with corrections and offer a "did you mean" more often. 500,000 results for "uncollege" and the fact that correcting it to "college" repeats a word in the query string is a good argument for this particular case, at least. On the other hand, testing for "[some random word] and uncollege" never seems to correct for uncollege unless the other word is education related, which is interesting. While the autocorrect isn't smart enough to notice that it's correcting to a repeated word, it is doing some kind of clustering and deciding you probably meant college in this case.
Put 500k people in bucket 1, and 500k people in bucket 2, and see what happens.
It's pretty obvious to me that the vast majority of times I see that correction message, that I've actually misspelt a word, and that it's pretty rare that I did actually want to search for "dictonary".
Or just show the Wikipedia article on Philosophy :)
I would rather have a search that corrected typos and aimed for the best result which I could rapidly correct than a search which slavishly returned "No results for 'hgihway', did you mean 'highway'?" (as a simple example).
If you actually want to search for "hgihway", search for "+hgihway": https://duckduckgo.com/?q=%2Bhgihway
Of course, Google has results for "hgihway": https://encrypted.google.com/search?hl=en&sa=X&ei=mV...
Likewise, it doesn't even make any sense to search for "college or college" without quotes. It makes even less sense when the internet includes an exact match on "college or uncollege". Oddly, a search for "college and uncollege" (without quotes) finds the article in the #1 position. Again, is it too much to ask that Google include a few exact match results even when it strongly suspects a miss-spelling?
Downvote? Really?
Scala also has multiple meanings. As of 3 months ago, it was almost impossible to find relevant pages about "Scala" or Lift through Google without knowing including more relevant information ("Scala Language" or "Lift Scala").
1) visually skip the sizable disambiguation list
2) parse the main results, find they don't match (DDG is all about java language just like google on 'java')
3) go back and parse the disambiguation list
4) click the category to expand
5) parse the newly expanded list
6) click the relevant entry
7) wait for a new search
8) parse the main results again
I mean, seriously, a second word in your search is hardly cognitively onerous. Are we really so spoiled as to demand perfect results on short, ambigiuous topics?
Here is what you have to do to get results for Java coffee if you are using Google:
Type “Java”,
parse results and see that you didn’t get the desired results,
type space, “c”, “o”, “f”
And DuckDuckGo:
Type “Java”,
press enter,
parse results and see that you didn’t get the desired results,
expand right category in the disambiguation list,
click on “Java coffee” in the expanded list
It’s a wash, it really is.
No one is ever going to 'dukgo' someone. Searching is a verb, the naming conventions used with DDG in its current form just don't fly. I'd love to talk shop with Gabriel about the identity decisions, and whether he is open to pivoting the brand identity now that the service is getting more well known..
Also, please stop abusing the word "pivot" :(
- Microsoft spent pots of cash trying to verbify their search engine with their "bing and decide" commercials. As far as I know, this hasn't worked for them.
- IIRC Google themselves tend to use the form "do a Google search" - or they risk losing their trademark.
- Duck Duck Go is a catchy name - three punchy syllables. (I've recently become a fan of The Name Inspector's blog).
- And people should definitely stop using "pivot" when they just mean "change". Or "disruptive" when they mean "new". It's the startup equivalent of the crystal healers who use words like "quantum" to sound more intelligent.
Edit: Right, ddg.gg. I guess I had it. But don't tell me it's memorable (I only recalled increasing character repetition). How do others remember it? "Duck Duck G-G-Go"? He definitely needs a short, pronounceable name.
Duck.com redirect to google!
Duck.co points to a DDG community site!
Goduck.com is for sales
Duck.net is blocked from work so I guess its a porn thing
What do you think will work as a good brand?"""To be fair, it came as an asset in an unrelated acquisition (On2). But it just sat their (pointing to this Duck Corporation history page) for a long time.
I first inquired about it on 11/4/09. After several attempts, I got back a response "from management" on 3/25/10 that they didn't want to sell it. Understandable.
Now http://www.on2.com/ points to a Google explanation page about the On2 acquisition, yet http://duck.com/ points directly to Google search."""
Also discussed a little bit on the DDG community forum: http://duck.co/topic/duck-com-redirects-to-google
Huh. Well, that's fairly bizarre.
From the ddg faq page: http://duckduckgo.com/faq.html
Plus it helpfully further confuses the word "Go", it's a programming language, a regular old verb, and a search engine!
For this unusual case. In most situations I've encountered, Google's auto correction is quite helpful.
> What if I was searching for place Java of Java Coffee fame. I would need to scan through the search results, spanning multi-pages (second page in this), until I came across the one that related to Java, the place.
Or, you revise your query to "Java coffee". Hell, with Google Instant it's not even another pageview. As a programmer, I'm glad Google does a little guesswork and gives me results that are relevant to the types of queries I'm likely to be making.
Right, but DDG makes it easier. Sure, technological advancement isn't required, you could still just do it the old way and edit your query, but this makes it easier and better. And that's a good thing.
I'm a fairly good speller and a good typist, and I almost always mean to search for what I typed. Most days, Google's auto-correct feature is of negative value to me. YMMV of course.
If I place an order for a Chicken Burrito but am served a Beef Burrito (auto correction) because that's the most popular dish, it would not be okay. Same applies to search. (Sorry, I repeated this example I used in another response in this same thread.)
If I were immediately - i.e. within a second or two - served a chicken burrito when I say "sorry, I ordered the chicken", I don't think I'd mind that much.
This "feature" has been getting steadily more annoying, particularly with more obscure words, or words where there is a similar word that's in more widespread use.
Thinking about it now, I was wishing there was a way to turn off this feature; but alas, a dive into http://www.google.com/preferences doesn't seem to have "turn off that dang autocorrect" as an option.
For example:
http://www.google.com/search?q=college+or+uncollege&nfpr...
I am sure it's not that hard to write a greasemonkey script to do that for you automatically, but I tend to like the feature, especially when I fat finger queries with my cell phone.
Two different ways to do it: http://johnbokma.com/firefox/keymarks-explained.html http://support.mozilla.com/en-US/kb/Smart%20keywords
http://www.google.com/webhp?complete=0&hl=en
You can add as many parameters as you want [1]. I use complete=0 to disable suggestions (I don't need/want them) and hl=en to force the interface language to be in english
[1] http://yoast.com/wp-content/uploads/2007/07/google-url-param...
Just a theory, but I suspect this form of autocorrect is helping more than hurting, it's just that it's easy to not notice when things work well and very visible when they don't.
Please stop spamming your analogy to every subthread and please consider that it may in fact have some flaws.
It's more about "geeks doing a web search" vs everybody else. Especially hackers want and are used to have a machine do exactly what is typed, without "smart correction".
But that is not true for most people, they want fault tolerance and a "you know what I mean" attitude from the machine. That's what G does.
I prefer DDG, of course.
Want to do a search on stackoverflow right from your url bar?
!so Hello world
Or maybe wikipedia? !w Hello world
Or do a google search !g Hello world[1] Which matters a lot to me, since i use 3 or 4 different browsers at a time across a few different computers and often don't have the ability to sync my browser prefs.
A good feature, but for my usage patterns it doesn't hold a candle to DDG !bang commands.
Hacker News !The vast majority of people looking for "java" are looking for the programming language. If they weren't, all those links wouldn't be at the top of Google. For most people, this IS the correct response.
For anyone else, seems like they could just say "huh, programming languages?" And then type "java indonesia," "java coffee," or even "java country." REALLY DIFFICULT
In the first example, all you have to do is click on the non-autocorrected text or even just put that search in quotes. I don't even know why the hell you would look for "college vs. uncollege" anyway, any search for "uncollege" is going to turn up a bunch of pages that talk all about that movement and why it exists.
DDG is a good product, but this article is stupid.
The rest of the non-programming world is probably full of people wanting to know where to buy Java coffee, or wanting to know something about Indonesian islands.
http://www.google.com/insights/search/#q=java&cmpt=q
The top searches involving "java" are download java, free java, string java, java script, sun, java sun, java code, etc etc. Even in Indonesia, the top searches are about the programming language.
I don't see islands or Indonesia or coffee anywhere.
I'd love to see your statistics on that - you must use a lot of very unusual words. Google has published a paper about the algorithm they use.
There are two cases:
If Google thinks you might be wrong it will display "Did you mean..." with the possible correction.
If Google is pretty sure you are wrong, it will search for what it thinks is correct and show what you typed originally as an option.
If you are hitting the second case 90% of the time then you are a very, very special snowflake indeed!
I have to go back and explicitly tell it that I meant to tell it what I told it
You have to click on the link to say you really meant what you typed.
No. I just type more accurately than the average Google user, so when I do type an unusual word it is more likely that I intended to type it.
Google could fix this (with logged in users) by using some type of Bayesian classification algorithm. They could track how often a user subsequently clicks "Showing results for _____" compared to "Search instead for ______". That would give them a self-rated user typing accuracy score they could use to adjust which results to display when they detect a potential misspelling.
For all I know they already do this. However, based on anecdotal evidence from my own experience (admittedly non-scientific), it does not appear that they do.
Try "http://duckduckgo.com/?q=pyqt+glp and it will actually search for "pyqt gpl"
I feel that the main difference now is because of the immense size of googles data from some 7-8 years ago when i first started uni. However to be able to structure the size of the data they have and still provide relevancy is still an awesome job i think.
I just wonder though, if duckduckgo ever did become a contender (from a data size perspective) and started to approach the size of googles dataset whether they would have the same kinds of problem.
One of google's biggest advantages -- for me at least -- is its localized URLs. google.co.uk, google.fr, google.de, ... they all boost results in the local language(s) and in the relevant country. There's a way to make DDG act the same way, of course, but it's much easier to just type google.de.
My solution for this is !g in duckduckgo: This brings me to the international Google.com, no matter what locales in the browser, what computer and what google-account is active. For local searches I just type in google.com and somehow 90% of the time end up with the .nl version. Works for me.
If we want Google's software to do our thinking for us, it has to know all the relevant information that we do, necessitating a rather complete invasion of our privacy. If we want to withhold privacy, which means withholding data, we have to do some of our own thinking.
http://giffo.imgur.com/search_results
The link above are screenshots from a test page of a search engine project I gave up on last year due to burn out and that I just couldn't afford to get it to the online stage. Today I feel (as biased as I am) - it still does the job better than anything out there for me.
Because its simple.
Google failed miserably. Even the forum posts it uncovered did not really help me find a bargain. There was too much "advertiser" influence in the search results.
Duck came to the rescue -- pointed at a great forum post and ultimately a cheaper rate than I found using Google and the phone. Cheaper by over 20%!
What was the "cheaper by 20%" solution?
With the hundreads of millions of searches that go on everyday you would think they could pull a little bit more.
I guess it truly is hard for people to change who they search with after all is said and done.
I tried it myself based on all the glowing comments here, but I didn't find it to be particularly impressive (not bad, but not great either). I also found myself using '!g' most of the time because the default results were inferior to those returned by google; in the end I just cut out the middleman.
So I guess I just don't get all the hype about DDG on Hacker News (same goes for bitcoin and the never-ending stream of Python non-stories). Maybe there's a cult-ish aspect to it?
i guess its hard for me to switch since EVERYTHING i do is with g ( email, search, google+, etc.)
its more a convienience thing for me. but yeah i think it def is a bigger following on tech sites in relation to the average person.