HNHacker News
TopNewBestAskShowJobs

lobstersammich

72 karma · joined September 1, 2022

submissionscomments
lobstersammich··on Don Knuth plays with ChatGPT
You can find GPT-2's training dataset list - at a high level - in the GPT-2 repository on Github: https://github.com/openai/gpt-2/blob/master/model_card.md#da... However, OpenAI goes dark after that regarding the 'data soup' that was fed into their LLMs. In general, start around 2019 and definitely by 2020 you'll notice that research labs became much less forthcoming about the data that went into their models. As far as I'm aware, BookCorpus is one of the more commonly-used 'large books dataset' that's been utilized in recent years to train large language models (LLMs) like generative pretrained transformers: https://12ft.io/proxy?q=https%3A%2F%2Ftowardsdatascience.com...

At my alma mater I remember the large-scale Google book scanning devices and what a herculean effort that was to digitize the largest university library system's books - University of Michigan - although only 7M texts from the entire collection of ~16 million texts: https://en.wikipedia.org/wiki/University_of_Michigan_Library) were digitized.I too was curious about the state of the Google Books project: https://www.edsurge.com/news/2017-08-10-what-happened-to-goo...

This is an interesting piece of ephemera from 2005, when Google started digitizing books at UMich: https://apps.lib.umich.edu/files/services/mdp/faq.pdf

As far as I recall, the Books project allowed the early n-grams functionality to be built out: https://ai.googleblog.com/2006/08/all-our-n-gram-are-belong-...

The Google Books Ngram Viewer tool is actually still in existence; you can play around with it here: https://books.google.com/ngrams/graph?corpus=0&content=Vorsp...

lobstersammich··on We will be shutting down neeva.com
I hadn't heard of this website, SiliconAngle.com, before this week but they interviewed someone from the company that I work at (not for this Neeva article; for a different article), so they're actually a real news reporting organization. I was reading that article with my colleague's interview this week when I saw the Snowflake + Neeva article title in the sidebar on SiliconAngle.com

https://siliconangle.com/2023/05/17/report-claims-snowflake-...

The Silicon Angle article cites another article from The Information as being the source of the Snowflake + Neeva news: https://www.theinformation.com/articles/snowflake-in-talks-t...

(I don't have a subscription to The Information, so unfortunately I cannot read that article's whole text. If someone with a subscription to The Information could summarize that article and share their summary with the community here I'd appreciate it!)

lobstersammich··on CNBC just deleted 5 pages showing CD5 data for banks including JPM and BAC
I have not read the paper below yet, but it seems germane to any discussion of the source(s) of credit default swap data:

"Are all Credit Default Swap Databases Equal?" https://www.cnmv.es/DocPortal/Publicaciones/MONOGRAFIAS/DT44...

I've been using this resource for some time to track the five-year CDS rates of many North American and European banks: https://www.derivateverband.de/ENG/Transparency/Credit-Defau...

At the bottom of the chart/table you can see (a) the source of the data points as well as (b) the last updated date. For the page today the text reads as follows, so the data was last updated on Friday, the 24th of March:

> Source: CMA, part of S&P Capital IQ, Copyright © 2013, Credit Market Analysis Limited. All rights reserved. Date: 24.03.2023

lobstersammich··on Instead of paying adults more, states let companies hire kids for labor shortage
In this post I've read A LOT of incorrect population decline estimates. Here is a paper from The Lancet - not retracted, that I know of - that charts the populations of the present day through 2100 for almost all countries in the world:

"Fertility, mortality, migration, and population scenarios for 195 countries and territories from 2017 to 2100: a forecasting analysis for the Global Burden of Disease Study"

https://www.sciencedirect.com/science/article/pii/S014067362...

Click on the large 'View PDF' button to read the paper; there is no paywall.

The wildly incorrect statement that China's population will halve by 2035 is very much off base:

> The reference projections for the five largest countries in 2100 were India (1·09 billion [0·72–1·71], Nigeria (791 million [594–1056]), China (732 million [456–1499]), the USA (336 million [248–456]), and Pakistan (248 million [151–427]).

China will become the largest economy starting around 2035 but the US is once again forecasted to become the largest economy starting around 2098, according to that study.

With the semiconductor on-goings (both by the United States as well as a the EU) over the last six or so months I think this changes the calculus on this, though.

---

I am wholly against child labor in all its forms and posters who are arguing that bagging groceries part-time after school as a middle-class kid is somehow equivalent to working in a meatpacking plant (a slaughterhouse) or on a construction site are either woefully naive or are arguing in bad faith.

lobstersammich··on Instead of paying adults more, states let companies hire kids for labor shortage
ProPublica has some consistently high-quality reporting on meatpacking as a an industry from all kinds of perspectives - the (mis)management of them during the pandemic, the hiring of children to work there, the horrid safety conditions, etc.

https://www.propublica.org/search?qss=meatpacking

I'm not sure if ProPublica has a free, public dataset on meatpacking plants but they generally have datasets that you can purchase that pertain to particular areas of reporting: Medicare and Medicaid overbilling / fraud; repeated pollution violators who keep paying fines instead of stopping polluting; etc. If anyone knows of a dataset on meatpacking plants, health and/or safety violations, etc. please do share the link to the dataset.

lobstersammich··on SVB Securities management exploring buying firm back
Yes, SVB Securities is a separate entity from SVB, the bank. See this press release from PRNewswire: https://www.prnewswire.com/news-releases/svb-securities-cont...

SVB Securities LLC recently - at the beginning of last month - changed its name from SVB Leerink LLC to SVB Securities LLC: https://www.svb.com/de/news/company-news/svb-leerink-llc-ann...

The Wikipedia page states that SVB Securities' leadership plans to buy back the company from its parent org, SVB (the bank): https://en.wikipedia.org/wiki/SVB_Securities

It's sloppy reporting in this article that the reporter mixes up SVB, the bank, with SVB Securities; Joe Gentile is the CAO (Chief Administrative Officer) of SVB Securities / Leerink: - https://www.svbsecurities.com/team/joseph-gentile/ - https://news.yahoo.com/silicon-valley-bank-exec-lehman-00055...

Note that 'Yahoo! News' - f/k/a the Verizon Media Group - was bought by Apollo Capital Management a few years ago, so perhaps Apollo is short SVB and that's why 'Yahoo! News' is amplifying this narrative about the CAO having worked at Lehman until 2007; recall that Lehman imploding in 2008 is largely seen as one of the catalysts for the 2008 Global Financial Crisis.

lobstersammich··on Planning for AGI and Beyond
I think they mean Transformers in the Vaswani et al 'Attention is all you need' paper, not Generative Pretrained Transformers, specifically? Paper link below:

https://proceedings.neurips.cc/paper/2017/file/3f5ee243547de...

For some papers on attention mechanisms from before the 2017 'Attention is all you need' paper, check out that paper's references. Chris Manning's 2015 paper covers attention mechanisms. And so do a few other researchers from that mid-2010s time period:

[21] Minh-Thang Luong, Hieu Pham, and Christopher D Manning. Effective approaches to attention based neural machine translation. arXiv preprint arXiv:1508.04025, 2015.

[22] Ankur Parikh, Oscar Täckström, Dipanjan Das, and Jakob Uszkoreit. A decomposable attention model. In Empirical Methods in Natural Language Processing, 2016.

lobstersammich··on Detect breaches with Canary credit cards
Does anyone have a good alternative to Privacy.com where your virtual credit card transaction data isn't sold to Wall Street? If you're unfamiliar with what a "virtual [credit] card" is here's the page from Privacy.com's website: https://privacy.com/virtual-card I use the Privacy app on my mobile phone to create virtual cards (primarily for work subscriptions). Pro-tip: since each Privacy card can have its own name put a tag such as `[WORK_RECURRING]` into the card name and then you can search your email inbox for `[WORK_RECURRING]`, quickly and easily finding all of the transactions / charges that you may want to submit to your workplace for reimbursement.

Privacy is owned / created by Lithic, but if you look at Lithic's investors you'll see that the plurality of the company's investors are in the private equity or VC space: Bessemer Ventures, Tusk Partner Ventures, Index Ventures, etc. You can see the Privacy.com / Privacy mobile app's funders here: https://www.crunchbase.com/organization/lithic-pay

Thus, I have no doubt that my transactions on cleverly-named Privacy app are being gifted or sold to Wall Street so that hedge funds can squeeze out a few addition drops of 'signal' from consumer purchase pattern data that would otherwise remain dark. (I'd imagine that many folks use the Privacy app to buy things that they'd rather not have show up on their regular credit card bills: 'adult websites', marijuana or tobacco products, etc.

So, two questions:

(1) Does anyone have a privacy-respecting alternative to Privacy.com's virtual credit cards?

(2) Does anyone know of a recent blog post where these virtual credit card services are compared / contrasted by

- the services that they offer, - the cost: free, paid, etc., - the terms of service: how your data is re-sold / who your data is transmitted to

lobstersammich··on The FTC plans to curtail the use of non-compete clauses
I was writing a long comment up top about this, but instead I'll reply here. Person with a background in public policy, especially around poverty alleviation efforts. I think that the removal of non-compete clauses has to due to with employees who you normally (at least I wouldn't think) of being subject to non-compete clauses... namely, service industry workers. Apparently 1 in 6 are subject to non-compete clauses: https://thecounter.org/biden-targeting-non-compete-agreement... This industry has been 'suffering from' high vacancy rates since the start of the pandemic because the industry has low wages, minimal-to-non-existent benefits, generally no paid sick days, advanced notice of your work schedule isn't provided (thus it becomes difficult or impossible to attend college or work a second or third job), etc.

For a group of workers who are generally less able to afford legal remedies to situations such as non-compete clauses I can see how non-compete clauses are especially damaging to this group of workers. (I'll show some hard data points on non-compete clauses by pay and by education level obtained in a few paragraphs.)

If I had to guess I would say that non-compete clauses are being removed now because there's a "worker shortage": 1M dead from covid and of that some percentage (50%?) of that in the workforce; restricted immigration - legal and otherwise - for the last 3+ years and before that a decline in immigration due to the polices of the former guy). Why the quotation marks around worker shortage? Basically, the service industry businesses want workers but hardly anyone wants to work in the service industry because the pay's bad, there are often no benefits, in many states you don't know your schedule until the day of (which makes planning for childcare, attending college, etc. damn near impossible), etc.

So if I had to guess this is the federal government's way of attempting to address the "labor shortage" in the service industry across the United States as well as allow people in white collar jobs to switch into new roles. I would bet that most folks who fall under the 'knowledge worker' class of employment know that their company's non-compete clause is pretty much non-enforceable, but ask your average restaurant worker who is under such a clause and I bet that they believe that the non-compete clause _is_ enforceable.

From this report from 2015, it looks like ~18% of all US workers are under a non-compete clause in their current role, with ~15% of workers without a college degree being under a non-compete clause and roughly the same percentage of workers with an annual wage of <$40,000 being subject to a non-compete clause (Rf. page 7 of 36): https://home.treasury.gov/system/files/226/Non_Compete_Contr... In that same document on page 16 you'll note that California, Oklahoma and North Dakota have the 'least enforcement' of such clauses. I suspect that the oil and gas industry in OK and ND enjoys not paying for training of employees, so if your employee can be trained at a competitor and then jump to your place of employment, full trained / ready to work, that seems to be what those states are looking for. (Yep, large swaths of ND and OK have over 20% of that county's employees employed in the petroleum extraction industries: https://www.ers.usda.gov/data-products/chart-gallery/gallery... )

TL;DR: Fifteen to twenty percent of all Americans are currently working under non-compete clauses (with 1 in 6 food service industry workers being subject to non-compete clauses). Thousands of jobs are going unfilled in the service industry as well as in white collar, 'knowledge worker' domains. By removing the ability of employers to create and enforce non-compete clauses this should, in theory, 'free up' around 20% of the workforce to change jobs. In theory, most of these workers would be changing jobs for factors such as more flexible work schedule (advanced notice in the case of service industry workers; WFH for white-collar workers), benefits and sick days, and increased wages. My (admittedly cynical?) take on this is that by freeing up 20% of the workforce to switch jobs the federal (and state) governments are hoping that they can get away with any increased spending toward social services and instead can just tell people 'Well, go look for and get a better [paying] job! What's stopping you? Certainly not a non-compete!" Also, by allowing a 'great migration' into new roles the federal government can get a rough tally as to how many immigrants they'll need to let in via the skilled (H1B, NAFTA, etc.) and unskilled (EB3) visa programs; it's my opinion from looking at state- and federal-level labor statistics over the past 3+ years that the data is rather 'noisy' and by removing non-compete agreements it should make it easier to get a "closer to reality" tally of how many workers the US will 'need' to import to create and maintain full employment in various skilled and unskilled industries.

lobstersammich··on Canada bans most foreigners from buying homes
One thing that I'm not seeing mentioned in any capacity in the comments on this HN page is role of institutional investors. Prior to 2008 'single family homes' did not exist as an asset class that the asset management companies - Blackstone, etc. - were able to invest their client's/investor's money into. Long story short, the Savings & Loan implosion of the 1980s in the United States soured investor's money on SFHs. But when 2008 rolled around asset prices were depressed; the banks were flush with cash thanks to a bailout bonanza, and thus began the bulk purchasing of residential real estate by asset management firms.

Read it from the horse's mouth, Redfin: in Q3 2021 investors bought 18% of single-family homes sold in the United States. 1 in 5. https://www.redfin.com/news/investor-home-purchases-q3-2021/

In 2016, 2017, 2018 we were averaging around 50,000 to 60,000 homes being bought each quarter by institutional investors. Then, when the pandemic fun bucks got released (and I'm not talking about the $1200 'relief' checks that went out) we were looking at 80,000 to 90,000 homes bought by institution investors each quarter in Q2 2021 and Q3 2021, respectively.

Add in Airbnb / the short-term rental markets decimating housing stock in many cities and countries, plus intentionally restrictive zoning ordinances in the US and in Canada, and it's no wonder that North America's housing market looks the way it does in 2022.

Also from that Redfin article: > Investors Have the Highest Market Share in Atlanta, Phoenix > >In Atlanta, nearly one-third (32%) of homes that sold in the third quarter were purchased by investors—the highest share of the 40 U.S. metropolitan areas Redfin analyzed. Next came Phoenix (31.7%), Charlotte, NC (31.5%), Jacksonville, FL (28.3%) and Miami (28.1%). > > Atlanta also saw the largest year-over-year gain, with investor market share rising to 32% in the third quarter from 12.9% a year earlier (+19.1 ppts). The second-biggest jump was in Charlotte (+18.2 ppts), followed by Phoenix (17.7 ppts), Jacksonville (+15.2 ppts) and Las Vegas (+14.6 ppts).

I'm curious (and hopeful) to see how the Canadian situation plays out. I hope that increased enforcement of antimoney laundering laws will also result in a return of many thousands of single-family housing units to the market. If the Canada law works well it would be encouraging to see it applied in the United States with additional funding at the federal level for the construction of dense apartment housing in cities near transportation hubs as well dense housing in suburbs/exurbs with the creation of mini walkable downtowns in those denser pockets.

lobstersammich··on Stripe is holding over $400k of mine with no explanation
Is there a way to use an app similar to Privacy to set up a "burner bank account"? Or do you physically go into a bank, credit union, etc. and sign up for a new account as a new member?
lobstersammich··on Stripe is holding over $400k of mine with no explanation
I forget where I read it - maybe it was a creative writing exercise somewhere - but the hivemind was tasked with coming up with "a replacement for the car wash in Breaking Bad". Along with the usual suggestion of laser tag (a la Saul Goodman) as a way to launder cash while looking like a legitimate business was the humble escape room. Why? They're high traffic (well, they can _be_ high traffic, on paper), low per-transaction amounts (nothing near the $10,000 reporting threshold).

If I had to guess I'd say that the escape room(s) for which you're selling tickets are in some kind of legal trouble and your company as a vendor of tickets to those escape rooms is also being investigated. (It's unclear to me if you're the owner of the corporate entity that owns/runs these escape rooms or if you're simple a ticket seller to various escape rooms, e.g., a "Groupon but for escape rooms".)

Many friends who sell spare computer parts on eBay have had their PayPal accounts frozen over the years, so they've developed a process whereby if they're relying on a payment processor (PayPal for eBay transactions; stripe for other transactions) they will set up a 'cash out to my bank account' process on as often a cadence as possible. Ideally nightly if that's an option. I haven't used Stripe, but does anyone know if there's a setting whereby you can say "punt my Stripe balance over to my bank account every X days"?

Also, there's a push to use payment processors and 'neobanks' (see below) to basically do parts of the IRS' job for the IRS (or I should say that the government is allowing these private corporations to take on the role of governmental agencies probably in return for campaign finance contributions):

- https://www.propublica.org/article/chime

- https://arstechnica.com/gadgets/2021/07/the-chime-banking-ap...

Immigrants, children of undocumented immigrants, the recently incarcerated, the poor, etc. are the Chime customer base. One of the draws with Chime is that you can get your paycheck a few days early, so it's literally a payday lender, but calls itself a "neobank". As digital surveillance increases in the ability to connect transactions across disparate systems I expect these sorts of actions by Stripe, Chime, and other fintech companies to increase in frequency.

Sorry I don't have any "here are 5 steps to take to get your account back to normal" guides, but I wish you luck and - like others are suggesting - I would probably retain legal counsel.

lobstersammich··on Cheerful chatbots don’t necessarily improve customer service
I thought that people understood that this was the point of chat bots? Much like useless phone trees with awful automated speech recognition chatbot are - IMO as someone who has worked in NLP for over a decade - simply there to tire out the customer from tasks like:

- getting a refund for an order - cancelling a service - anything else that would cost the company money

Hostile design but in cutesy-wootsie 'Digital Assitant' form. Yuck.

Thankfully some geographies require the option to be able to one-click cancel your service (California) and some other localities (the EU) prohibit deceptive or 'hostile' website design. Try using Amazon.fr or Amazon.de sometime and compare it to the user experience of Amazon.com. Amazon Prime will notify you in the EU several days before your month of 'Free Prime' is up, before your credit card is charged. Even then, you have up to 14 days after the charge to cancel your membership AND the cost of the Prime membership will be refunded in full.

lobstersammich··on Airtable lays off over 250
I wonder if a large portion of their valuation isn't based on the data rather than the product? (Would allow you to get signal on when [your] employees are interviewing elsewhere, etc. given the name, phone number and/or email address that you provide to Calendly)
lobstersammich··on Tell HN: Apple refuses to delete a personal domain Apple ID that I didn't create
My email address is fname.lname@gmail.com and I get dozens of these account signups per year. You'd be surprised at the mobile phone companies, banks, and other accounts which do not require you to verify that an email account is yours before you are able to use that email address for your mobile phone, banking, tax returns, health insurance accounts.

And it's not just limited to not-tech-savvy Americans either: I get Canadians, Australians, Brits, etc. all using my email address as if it were their own. One added 'benefit' from this is that by receiving all of these emails for other FName LName people who mistakenly use my email address it muddies the data that Google sells to Facebook. Having made a Facebook account many years ago that has been dormant for over a decade I was surprised to see upon logging into the Facebook account that "my purchases" at [American chain store] were being used to make recommendations on Facebook. I've never purchased anything that [American chain store] in my life, but I do receive DOZENS of e-receipts for a person in South Carolina who has electronic receipts sent to my email address for $1,000 home goods items. Additionally, the ads that Facebook shows me also conveys that their ad system thinks that I'm a healthcare worker in Australia because I received an Australian healthcare worker's test results / certification to practice as a healthcare worker at my FName.LName@gmail.com email address.

lobstersammich··on Gore-TEX, a lightweight, waterproof fabric made from the expanded form of PTFE
You may have to turn on your VPN to appear to be coming from an EU country (or maybe even from inside Germany, since this Youtube channel, Strg-F [literally "Ctrl F", so 'find'] is part of `Funk`, which is a German public broadcast station) but I found this half-hour-long documentary on PFAS and PFOAs, more generally, to be quite informative:

https://youtu.be/ovCvW22ol3Y

The video covers Chemours, DuPont, etc. and how there's a town in the US where the rain and soil is poisonous due to PFOA production in the past (and still on-going: not PFAS but other deemed-safe-by-corporate-lawyers PFOAs). The man who they interviewed had pet dogs that he would let outside and the husky loved being outside in the rain. However, the dog developed sores / lesions on its back and then died. Turns out the groundwater and basically the whole environment around the PFOA factory is highly toxic.

The video also interviewed a worker at a PFOA plant in Germany who has (had?) thyroid cancer, I believe it was, and suffers from many disrupted endocrine system effects. (He worked inside a PFOA factory where sometimes the chemical vapor would condense on the ceiling and drip down on to the workers. Again, the ground water and soil there is not safe for human or animal consumption.)

They also cover / touch upon the lawsuits that farmers with grazing cattle (that died off) tried to bring against PFOA manufacturers like DuPont, Chemours, etc. Unfortunately, most of those farmers are now dead due to cancers of various sorts (from consuming PFOA-laden groundwater, the same water which they were giving to their animals which died by the hundreds a few decades ago).

They also touch upon how difficult it is to recycle PFOA-containing fabrics: they must be incinerated at much higher temperatures to render the compounds inert and safe for disposal in the way that regular trash is disposed of after incineration.

lobstersammich··on Ghidra: Software reverse engineering suite developed by NSA
For folks who are curious, here's a translation. Scroll to the bottom of the dictionary page. In the left-hand column there is an entry under `gadara`: https://ejtaal.net/aa/#hw4=793,ll=2323,ls=5,la=3216,sg=766,h...
lobstersammich··on Columbia whistleblower on exposing college rankings
I like to use OpenSyllabus to investigate which textbooks, papers, etc. are used to teach courses: https://opensyllabus.org/
lobstersammich··on Ask HN: Anyone having issues with job applicant fraud?
I'd reach out to Crowdstrike with the domains names (https://dataservicegroup[.]com). This follows the MO of APTs out of North Korea: https://www.wired.com/story/north-korean-it-scammer-alert/ If you share the list of similar phrases and the domain names that pop up when you search for those phrases the Crowstrike researchers can (a) probably help confirm which group(s) you're dealing with or at least (b) write up an analysis piece on yet another APT trying to gain a foothold in sensitive systems via the ol' fake candidate mechanism.