supersan

Hi, I find the Blog more interesting right now since I hope to find write-ups about how you were able to manage such a herculean task on your own?

Crawling 2bn pages could take forever and could generate a huge bandwidth bills, so any lessons you learnt, pitfalls you faced, etc would be a great read.

The article won't load,even after clicking the web link under the HN heading. Any ideas?

No, but i think you should leave it there. Pricing should be upfront otherwise it creates suspicion and distrust.

That is really great news. One way I can think off to distinguish a library from other code is how many times the file shows up in your search results, i.e. the more the duplicates of a file you find (in various repos), the higher the chance it is a library.

First of all great work! Of all the search engines I tried (and I've tried at least 10), I found yours to be the next best thing after GitHub search.

Anyway, here are some links you can try for yourself:

No php results:

1. https://searchcode.com/?q=CORSConfiguration+CORSRules 1. https://github.com/search?l=php&q=CORSConfiguration+CORSRule...

Only SDK libraries, what I think would be useful if the search engine somehow prioritized code built on SDK/API over libraries (though I don't have the first clue how you would distinguish the two but that would be a killer feature because that is super useful)

2. https://searchcode.com/?q=createEnvironment+ElasticBeanstalk... 2. https://github.com/search?l=php&q=createEnvironment+ElasticB...

I can provide you with more examples, if that helps. Thanks!

Tried it, didn't return anything. Also for the life of me, I can't figure out a way for it to search php code.

Yes, that is very interesting to me as well. I think Amazon's ElasticSearch can be used for searching. GitHub would be the obvious choice for crawling the source code.

Of course, there are a lot of roadblocks, like how much GitHub allows you to crawl the source code (sometimes you can find huge dumps on legit torrent sites or I don't remember the name of the site but it provides you with S3 buckets with crawled data where the requester has to pay for bandwidth but the data is free).

Then of course you will have to index the source code by language, project, author, date, etc. It's definitely not easy, which could be the reason why there is this huge gap.

Thanks, I've already tried both of them and they're not returning a lot of results, esp. not many relevant results.

But so far I think searchcode is okay because at least it does show something.

Banning his account was totally unjustified since he approached them first with the issue. A less ethical person could have tried to make money or sold this off on the back market. People like him should be rewarded not have their accounts banned. For all we know he just saved DO a lot of headache in sorting this issue had it gone wrong. I really wish the response from DO on this was different.

I'm curious to know more about the experience you had when you couldn't move your body and the thoughts leading up to the epiphany.

Was it the usual denial, anger, bargaining stuff or something different?

I wish there was a Dropbox for developers where you never had to worry once about commits or history or tags. Maybe just a big green "Release" button and that's all there is to it. Surely it won't be ideal for writing the Linux operating system but for most of the cases that would be more than enough to get the job done, keep eveyone in sync and yes a lot less confusing allowing you to focus on things that really matter.

This is a little off topic and maybe controversial because it is against the spirit of open source but in all earnestness if you make a software that you want to make available to all open source projects but then you want to charge a recurring monthly fees if the software is being used to make money - is there a standard license for that?

I've seen sites do this like readme.io but can you do that for a software library?

Thanks for the encouragement and suggestion. I'm on a mobile right now but pretty sure you can just click the link on the number to see the full feedback. Will check to make sure when I get back. thanks

This is a small chrome extension I wrote in less than 2 hours yesterday. The purpose of this extension is to show the eBay seller's feedback directly inside the search results[1].

I needed it because when buying used items it really helps if you look at the feedback and make sure it is at least above 98% (in my experience). Before you had to open each and every listing and see the ratings.

This extension takes the pain away and it also highlights sellers with 100% feedback with green. Again, it's just a quick hack I made for myself but sharing it here in case someone else using eBay finds it useful.

Comments and suggestions are most welcome!

[1] https://www.youtube.com/watch?v=NtcsBQ1cScQ

For me it would have to be the Michael gerber's Emyth books. It will forever change how you think about business and maybe the world around you.

Followed by sam carpenter's work the system. I think if you're a programmer trying to make it as a business person those two books are the most invaluable.

Edit: about the how part.. Before reading and understanding these books I was always in a kind of firefighting mode. It was like a constant pain in the neck that something was somewhere needed me. Sure i was making money but I was not enjoying it and felt stressed all the time. Plus I wasn't scaling my business because of the constant need of attention from everything. Then I learned the systems thinking and it all started to change.. It was like I felt I had wasted 10 years of my life being stupid before. I'm telling you these two books can forever change your life both professionally and personally if you aren't already doing it.

My activity is full of Visited "then some link on reddit". Guess reddit accounts for majority of my visits, so maybe that's why.

One of the people who I don't know personally but admire a lot in this regard is Derek Sivers (creator of cdbaby.com). If you've got 5 mins, you'll just love reading this article by him "Why I gave away my company to charity" [1]

I was listening to his audio-book and in the end he tells his story where he gave all of his money away (I think it was like 95% of the money away to create an institution for up and coming artists). It's just truly inspiring.

[1] https://sivers.org/trust

I was not expecting to see my Reddit activity on that list.

There is one more point that can really get you motivated. I call it the cliff-hanger approach. I use it mostly for programming but you can use it for other aspects too.

Anyway, it goes like this. Whenever you're leaving work, make sure to leave at least one thing nearly done.

Like one failing test which you know how to fix, a function that you've just started writing but haven't completed.

This way you have a starting point the next day and it really helps to get the ball rolling.

On a related note, another approach is to make things easier for yourself. I think it's all about getting over the static friction (time before you get the ball rolling). This approach is to prepare for the next day in advance. Like have your running shoes and socks ready by your bed, have a glass of water and a lemon (+knife) on your kitchen cabinet before going off to sleep.

If it has an HDMI port, you can install Kodi[1] on it and plug it to your TV to create a really cool media center.

[1] https://kodi.tv/

0×03 – Enumerating UUIDs with phone numbers. The bug that was marked as duplicate but I think really is at the heart of it all. Without this you won't get the UUIDs which are needed for all the other exploits. Just imagining that you can get anyone's email using just a phone number is crazy.

This alone should be worth thousands of dollars in the wrong hands because just imagine someone running a telephone book against this exploit - it's like having a peek into their users table and seeing all the registered users.

Thank you everyone for your replies. After carefully reading all opinions I think that TDD is the way to go because for larger projects sooner or later it will help me catch bugs when the project becomes complex. I also think that the 2x effort will be worth it with easier deployments.

I was kind of giving up on TDD but seeing that almost everyone thinks it is important (for larger projects), I will try to watch some more videos and try to write tests for my current project (for the work already done) and tests first for the code that hasn't started (maybe I'll add comments in the tests). This way I can compare the two, with which approach suits me better and fails more (i.e. catches more bugs) in future.

That would definitely be another interesting read! I'm not a networking guy, but I definitely want to know if it is possible to stop the packets from going to their final IP? Can they be intercepted and replaced with other data?

This feels as exciting as what they do with video feeds in Hollywood movies, i.e. where the hacker puts in her own camera loops replacing live feed.

This reminds me of a very old Perl module called HTTP::Recorder [1]. It used to set a Http Proxy for WWW::Mechanize and then output a WWW::Mechanize script to automate the requests.

I used for testing long time back. Of course it didn't allow Javasript because it ran on Mechanize but it also meant it was extremely fast.

[1] http://www.perl.com/pub/2004/06/04/recorder.html

Apart from efficiency the most important difference between these two is that Adblock has a default Whitelist which allows certain type of ads to pass (i.e. by charging advertisers like Google and Taboola millions of dollars to unblock their ads).

[1] http://www.businessinsider.com/google-microsoft-amazon-taboo...

Google drive: in a big folder named ideas with sub-folders like B2B, B2C, Fun, etc (doc files inside each sub-folder).

It's also easy to sync and access on all devices.

eBay.in offered cash on delivery waaay before flipkart (as a matter of fact, the original site Baazee.com which got merged into eBay did it very successfully too)

Yes, you would gain a massive chunk of traffic if you can get your site spam and malware free. There are still some projects like mp3gain, etc that are useful.

Right now uBlock won't even let me visit Sourceforge without adding it to my exceptions list (probably for a good reason).

Hi, is there a link to your email privacy policy?

Wow that was super easy. I tried this on one of my sites and it really took me like 2 minutes total to add SSL to it.

The only confusing part was that port 443 was blocked in ELB by default (which made it look like it didn't work but got fixed easily as soon as I figured it out). I've never seen an easier way to do this till date.