HNHacker News
TopNewBestAskShowJobs

shirkey

245 karma · joined March 22, 2012

submissionscomments
shirkey··on You probably shouldn't use OpenAI's embeddings
Please do and thanks in advance for any insights you can provide -- it would be great to understand any benchmarking improvement with ada-002 from your previous findings, and whether you tested the specific OpenAI text-search-*-{query,doc} models as a comparison for large document search.
shirkey··on ViperGPT: Visual Inference via Python Execution for Reasoning
ChatGPT for Robotics: https://www.microsoft.com/en-us/research/group/autonomous-sy...
shirkey··on Did Times Underplay Drone Program Leak?
We?
shirkey··on Did Times Underplay Drone Program Leak?
Let's put this another way: if the data suggest a false positive rate of 90%, does that constitute an effective test?
shirkey··on Did Times Underplay Drone Program Leak?
"Ten thousand might be fine if it meant saving Afghanistan from Taliban rule, as long as that as low as coalition forces could keep civilian deaths."

The same thinking could then be applied to our "war or drugs" -- the killing of several thousand innocent Colombians could be easily justified in order to eradicate the cartels, albeit temporarily.

Do you find that a satisfactory trade-off as well?

shirkey··on The Economy Got Off to a Historically Bad Start in 2014
The data provided in my link shows 4-6% average, I was referring to the most recent spike in real inflation that is not showing up in the BLS data. At the lower end, you'd have 48% price growth compounded annually over that 10 year period, at the higher end is 79%, so not sure why you extrapolated that at 7% over ten years.
shirkey··on The Economy Got Off to a Historically Bad Start in 2014
Government stated inflation based on chained CPI and other new measures to reduce inflation may be at around 2%, but previous formulas used in the past to calculate inflation would show a much higher rate (6-10%)[1]. For those actually buying or consuming anything, that official number is a farce.

[1] http://www.shadowstats.com/alternate_data/inflation-charts

shirkey··on Open Football Data
Agreed -- looking at the player data[1], IMO the format type is unrecognizable:

  ## GK / Goalkeepers

  Kawashima|Eiji Kawashima,   20 Mar 1983
  Nishikawa|Shusaku Nishikawa,   18 Jun 1986
  Gonda|Shūichi Gonda,   3 Mar 1989

  ## DF / Defenders

  Inoha|Masahiko Inoha,   28 Aug 1985
  G. Sakai|Gōtoku Sakai,   14 Mar 1991
  Nagatomo|Yuto Nagatomo,   12 Sep 1986
  Uchida|Atsuto Uchida,   27 Mar 1988
  Konno|Yasuyuki Konno,   25 Jan 1983
  Kurihara|Yuzo Kurihara,   18 Sep 1983
  H. Sakai|Hiroki Sakai,   12 Apr 1990
  Yoshida|Maya Yoshida,   24 Aug 1988
  Masato Morishige,      21 May 1987   ## Japan F.C. Tokyo
Comments as a double-hash, key fields are either player last name or occasionally first initial-space-last name, then three different delimiters of pipe, then comma, then tab. Choosing either a consistently delimited format or a more verbose JSON/YAML structure with clear metadata would seem to be a better approach.

[1] https://github.com/openfootball/players/blob/master/asia/jp-...

shirkey··on Learn regular expressions in about 55 minutes
Another excellent resource, which I believe was highlighted a few years ago here on HN: http://regexone.com/
shirkey··on DigitalOcean Raises $37.2M From Andreessen Horowitz to Take on AWS
Probably "remote data centers" in this context
shirkey··on DigitalOcean Raises $37.2M From Andreessen Horowitz to Take on AWS
Had you tried this tutorial?

https://www.digitalocean.com/community/articles/how-to-set-u...

I had used it to setup a test server and had no issues -- FYI, the date on the article is today, but the original article has been available for a few months so perhaps the article has been updated.

shirkey··on DigitalOcean Raises $37.2M From Andreessen Horowitz to Take on AWS
Or:

  sudo ufw limit ssh
  sudo ufw enable
To automatically rate limit connections -- see https://wiki.archlinux.org/index.php/Uncomplicated_Firewall#...
shirkey··on I worked on the US drone program. The public should know what really goes on
If you think that the concern about DEA and SWAT can be easily dismissed, consider that SWAT teams regularly get involved in serving warrants for non-violent crimes -- in 1995, 3 out of 4 SWAT raids were based on drug warrants alone... and mistakes on those warrants can be made repeatedly:

"Perhaps no one was more victimized by the battlefield mentality that had set in at the NYPD than Walter and Rose Martin. The Brooklyn couple, both in their eighties, were wrongly raided more than fifty times between 2002 and 2010. The couple filed numerous complaints with the police department. They wrote letters to Mayor Michael Bloomberg and NYPD commissioner Ray Kelly. They were ignored. In 2007 they at least got someone at the NYPD to try to wipe their address out of the department’s computer system. But the raids continued. It wasn’t until the couple went to the media in 2010 that the city finally looked into the problem. Back in 2002, someone had used the Martins’ address as a dummy address to test the department’s new computer system. When the new system was implemented, no one removed their address. So anytime NYPD cops in certain precincts used the system for a warrant and forgot to remove the dummy address to put in the correct one, the police would end up at the Martins’ door."[1]

[1] http://www.amazon.com/Rise-Warrior-Cop-Militarization-Americ...

shirkey··on After traffic stop, man forced to have x-ray, enema, anal probes and colonoscopy
Yes, everyone should allow themselves to be subjected to a physical cavity search unless they have something to hide /sarc
shirkey··on Poll: Where are you currently living?
Hey Chris, I'm also from US and in the Jakarta area -- sounds like there's a larger community here than I had imagined. I'll drop you an email.
shirkey··on BBM Available for Android and iPhone
> Message can intelligently switch between Apple's own backend and SMS depending on data connection and presence information

I'm not familiar with the Apple implementation, but something similar was implemented by the Yahoo Messenger client app running on my Windows Mobile several years back, seamlessly switching from Internet data connection to SMS -- resulting in an SMS for every single outbound message and a bill of around $300 from AT&T for all those "OK" and "Sure" messages.

shirkey··on Show HN: A tiny QR code generator – my second webapp
Another important lesson: be careful in trusting your main functionality to a third party, as Google has already announced the infographics portion (including the QR code generator) has been deprecated, see: https://developers.google.com/chart/infographics/
shirkey··on Z3: A high-performance theorem prover from Microsoft Research
What are the advantages/differences between this and Google's or-tools (https://code.google.com/p/or-tools/), which is available under Apache license?
shirkey··on Eve: A Python REST API Framework
also Flask-Restless (http://flask-restless.readthedocs.org)
shirkey··on Vietnam Internet restrictions come into effect
By what measure is Vietnam beating Indonesia?
shirkey··on Facebook will shut down its physical gifts service this week
Ditto -- this was a great idea, and I was hoping to see an international roll-out as well. I am an American living abroad (SE Asia) and often find it difficult to reconnect with my friends, so I've used it a few times in the past month, thankfully without any of issues/horror stories as described here.

Sure, maybe the gifts are cheesy (coffee mugs, etc) and limited, but I have always found that a real physical product in someone's hands has more impact than an impersonal gift card. I'm sad to see this service go, but I hope someone steps into this niche.

shirkey··on Show HN: TextBlob, Natural language processing made simple in Python
For the Google Translate functionality, does this pass the request through an intermediary service or direct to the API?
shirkey··on The NSA Admits It Analyzes More People's Data Than Previously Revealed
Debugging of your source code is not equal to a pervasive surveillance state intruding on individual privacy, unless you are to assume (incorrectly) that we are all owned by the state and have no independent rights apart from the state.
shirkey··on Ask HN: serious alternative to Skype on Linux/OSX/Windows and smartphones?
Jitsi is another option:

https://jitsi.org

shirkey··on Yahoo Japan Data Breach: 22M Accounts Exposed (10% of all Yahoo accounts)
I agree -- in the headline, I took the number directly from the article as they stated "[t]he potential data breach affects 10% of Yahoo's user base."

Another article clarifies that the total number of Yahoo Japan accounts as 200 million, so it was actually 10% of all Yahoo Japan accounts. My apologies for contributing to that impression.

shirkey··on Apple Pays No Tax on Much of Its Overseas Income, Senate Panel Finds
Not sure what is 'emphatically not true' with the OP.

Americans are required to state global income over some threshold (I believe it was around $91K this tax year). Few other countries apply a tax to wages earned overseas by citizens. After passing a minimum threshold, tax treaties are applied to determine precise tax liability for the year.

shirkey··on FOIA release: Completely Redacted Document About Text Snooping
"There was sensitive information in the document that happened to be 100% of the contents, this was redacted."

Is it a defensible position to assume that 100% of a document was excised as sensitive data? Since the subject of the memo itself is announced clearly, are we to believe that the presentation of the term "message" which almost certainly occurred one or more times in the body text was sensitive? What about harmless pronouns, conjunctions, articles, etc?

If a citizen were to reply to a government request of information from the government in the same manner, few would be surprised at legal consequences (penalties, incarceration) as a result. Actions such as this, in response to a legitimate request from the public allowed under law, can only serve the purpose of undermining confidence in the rule of law.

shirkey··on FOIA release: Completely Redacted Document About Text Snooping
"Is that really a broken system or just a few bad apples?"

The state was built to serve the interest of the general public and yet today does not produce the necessary signals to indicate it is functioning correctly to that purpose. We are experiencing asymmetric information:

* the state holds whatever privileged data it wishes for the length of time and purpose that it finds appropriate within the law and determines whether to reveal or withhold this data at present or some future date

* the state also determines the correct interpretation of the laws in court orders, position papers and executive orders -- and these orders can also be considered privileged data, so the same principle applies about whether to reveal or withhold this data from the public

* any indiscretions in the use of that privileged data by the state may or may or may not be detected by the state itself and, if detected and as it pertains to privileged information that may or may not be known to be held by the general public, the news of this detection and optional remediation may or may not be later revealed to the general public

* any successes by the state cannot be audited outside of the state itself, so the general public is reduced to the hope that the results were satisfactory and correct

Yes, I would argue that the current system is broken.

shirkey··on George W. Bush is smarter than you
...just as every politician learns to create a persona.

"The caricature of President Bush is that of a good ol’ boy from Texas who is principled and tough, but just not that bright."

Whether genuine or not, that was the caricature he cultivated and embraced, further distancing himself from the "elite" in the minds of most Americans. Whether a voter found this to be charming or not went a long way to how those voters cast their ballot.

shirkey··on Discourse ditches CoffeeScript
>Python's issue is that a non-fundamental aspect of programming has been paired with a fundamental aspect of programming.

Python's "issue" is that it considers readability as a fundamental aspect of programming and that whitespace is critical to that end. Whether that suits a particular programmer is a matter of personal preference.

Page 1 of 2Next →