HNHacker News
TopNewBestAskShowJobs

jlukecarlson

289 karma · joined January 8, 2013

Machine Learning Engineer @ Apple
submissionscomments
jlukecarlson··on Testing LLM Agents Like Software – Behaviour Driven Evals of AI Systems
I appreciate the details shared in this paper but it'd be great if they open sourced their implementation!
jlukecarlson··on How is einx notation universal?
Related - einops https://github.com/arogozhnikov/einops
jlukecarlson··on Ask HN: What open source projects need help?
ml-mdm from Apple Machine Learning Research

I maintain ml-mdm, a text-to-image diffusion codebase, that contains implementations of my research group’s recent papers https://github.com/apple/ml-mdm

Any help with DOCS or CODE would be greatly appreciated. I’m happy to have BEGINNER-FRIENDLY contributions as well, there’s a “good first issues” label that we use on GitHub.

We have an active and growing group of external contributors and welcome newcomers.

Could be a fun opportunity to contribute to a machine learning research project and to learn about cutting edge techniques in this subfield.

jlukecarlson··on Apple open sources a framework for training text-to-image models
I'm one of the contributors to this repo, so feel free to comment with any feedback!

The key research contribution from the related paper is that with a moderate amount of data (eg. 12M image pairs from CC12M) and a moderate amount of compute (single node of 8 A-100 GPUs for example) anyone can train a good text to image model using the unique multi scale nested u-net pipeline.

Hope this can help level the playing field for researchers everywhere.

jlukecarlson··on Embarrassingly Simple Text Watermarks
To the comments about this being easy to defeat: when it comes to detecting whether a person submitted a document containing LLM generated text (whether a law document, school essay, work document etc) the real value in a technique like this is high precision, not necessarily high recall.

Yes many people can circumvent this simple watermark technique but for those who don't, it is essentially guaranteed that they used a LLM if their text has clearly atypical unicode marks (Whether U+2004, ligatures, or variant selectors). Thus an organization can feel confident in taking action against the individual who submitted the document.

Whereas right now there are a bunch of dubious "LLM detector" models that output a confidence score that may or may not correspond to whether the person used an LLM. This low precision technique leads to people getting incorrectly accused of using LLM content.

So in my opinion, a world of high precision (but potentially low recall) LLM watermarks using simple techniques is way better than this current high-noise low precision black box world of low quality "LLM detector models"

jlukecarlson··on Ask HN: If your code no longer makes sense to you, do you leave it as is?
I’d start by either stepping through the program (gdb, pdb, or a debugger of your choice) or adding more test cases - that’s often a quick way to understand what a piece of code is doing.

Either way I wouldn’t leave it as is, that’s just a recipe for ensuring it becomes even more opaque over time

jlukecarlson··on A brief example of tailoring words for listeners: engineers and managers
It may just be a fake scenario but the actual solution there would be to implement the 1 hour fix without a single discussion or email.

Sometimes the best way to tailor words for both engineers and managers is to 1) solve the problem then 2) if the solution was actually difficult, explain how you solved it in simple terms.

jlukecarlson··on Air Marshals Will Refuse Orders to Go to the Border, Prefer First Class Cabins
Seems like a completely failed program to me. Any organization should be able to quantitatively prove their value on some level. As the article points out, for the DHS to say they do “not have information on [the air marshal program’s] effectiveness” while also averaging a cost of $200 million per arrest is an insane statistic that should immediately require changes in the program.
jlukecarlson··on This word does not exist
The generated "using it in a sentence" examples are often the funniest (and most absurd) part:

  chokebone
  choke·bone
  the muscle holding a prisoner down, used in controlling an animal or person such as a cat, dog, snake, snakebite, or spider
  "he managed to regain the chokebone and win the auction for his 12-year-old daughter"
jlukecarlson··on Elizabeth Holmes to Accuse Ex-Boyfriend of Abuse at Trial
John Carreyrou, the WSJ reporter who first broke much of the Theranos story, just came out with a podcast called Bad Blood the Final Chapter that’ll follow the court case and other recent developments
jlukecarlson··on Police say they found mafia fugitive on YouTube, posting cooking tutorials
The more interesting question, left unaddressed by the article, is exactly how they were able to make the connection in the first place.

Did they parse through millions of YouTube videos cataloging every tattoo and descriptive feature then run it against any outstanding fugitive’s features?

Or was it just a decently popular cooking channel

jlukecarlson··on Handcalcs: Automatically render Latex equations from Python math code
This seems like a pretty helpful educational tool — you could sprinkle it in a project's documentation to help clarify the exact formulas being used.

I could also imagine people using this if they aren't that comfortable with LaTeX and want an easier way to write it. They could just write out their formulas with Python, call @handcalc() to get the string output, then post it in their tex documents.

jlukecarlson··on Ask HN: How to find research on a certain topic
If you're specifically interested in recent work then it could be worth checking out arxiv for preprints of papers in the relevant field.

For instance, here's a section on Programming Languages: https://arxiv.org/list/cs.PL/recent

jlukecarlson··on Ask HN: If you have a short time to learn and do, what will be your strategy?
Personally, I might start by reading up on some background literature but ideally I'd move into a phase of building out an initial system as soon as possible.

It's only when you really try to build something that you uncover assumptions you made and aspects of the task that you don't truly understand. From there you can read further on a topic or try watching a lecture or two on the specific issue you encountered. Otherwise you may spend hours/days/months just passively learning without gaining fundamental understanding.

Eventually, you scrap everything from your first couple of attempts and actually put together a working solution.

jlukecarlson··on Ask HN: Do you think the internet changed how people seek self worth?
Yes definitely. Succinctly, its converted intangible social norms into concrete numbers that people can compare and fret over.

Before, popularity could be described as a general sense of "people enjoy being around you". You could conceivably say that one person was more popular than another but that would be pretty subjective. Now it can be quantified directly in terms of number of followers or likes on a message.

I doubt people used to worry so much about whether they had 97 acquaintances who valued what they say vs having 102. Now those are very real worries for some people who regularly engage with social media and web forums.

jlukecarlson··on Ask HN: What is going on with the US stock market?
The stock market is not a direct reflection of how healthy the US economy is at large. As others have mentioned, gains in the stock market are being driven by a select group of companies that investors believe are poised to seize an advantage during these times.

This advantage can be a product that is well positioned for this situation (Zoom, Slack, Amazon), having large cash reserves to weather the storm and potentially buy competitors (Uber with UberEats + Grubhub), or a myriad of other reasons. Not many of which apply to companies in the wider economy.

jlukecarlson··on Show HN: Beef, a new performance-oriented programming language
Hey if I can make a small recommendation, I’d suggest putting some code examples directly in the readme.

Currently the examples are buried multiple pages into the documentation, making it harder to evaluate the project at a glance

jlukecarlson··on A Worrying Analysis of Recent Neural Recommendation Approaches
In my opinion, the most provocative point that this paper makes isn't just about general reproducibility issues or problems with comparing to a weak baseline — it’s that a number of these papers used improper methods to obtain their results in the first place.

For instance the NCF and MCRec papers tuned model parameters on the test set and the SpectralCF paper used a non-randomly sampled test set for evaluation.

That to me is even more surprising than their revelations that a well-tuned statistical baseline outperforms these models.

jlukecarlson··on FlightCar shuts down
I used FlightCar for the first time literally last night. I signed up right before I boarded and getting to the FlightCar location ended up being decently convoluted but I did get a pretty nice Mazda for the weekend. This morning I received a 'Welcome to FlightCar' email and two hours later a follow up 'Update from FlightCar' thanking me for being a loyal customer and letting me know that they are shutting down
jlukecarlson··on Startup Failure Post-Mortems
It seems like the post-mortems from people outside the founders circle, like early employees, competitors or investors are more honest and realistic about the factors that led to the company's demise. Founders sometimes try to reframe their failure to make themselves look better. Poor market fit, not enough money, etc can be legitimate reasons but don't completely get to the heart of why a company didn't succeed.
jlukecarlson··on Great Works in Programming Languages (2004)
Benjamin Pierce was my CS advisor freshman year, it's great to see him on the front page of HN. I'm definitely going to try to get through the papers in the "greatest of the great" section
jlukecarlson··on Resume in C
I really liked this project and it inspired me to write something similar in OCaml. If you are interested the link is here: https://news.ycombinator.com/item?id=9226093
jlukecarlson··on Show HN: Resume in OCaml
I saw this post on hn: https://news.ycombinator.com/item?id=9216299 and thought it would be interesting to write something similar in OCaml
jlukecarlson··on Unix system programming in OCaml
This sounds really cool. I currently TA a CS course that deals primarily with OCaml so it is great to have real world applications/uses I can show to students in the class.
jlukecarlson··on Markov Chains Explained
Exactly and the actual page rank of the site comes from finding the equilibrium distribution from the transition matrix, which in this case is called a Google matrix.
jlukecarlson··on Markov Chains Explained
Interesting article, would have been helpful when I was writing a paper on Google PageRank since it is a markov chain. I do think it would be valuable to talk about equilibrium distributions and how you can determine the tendency of the system
jlukecarlson··on Show HN: Find the best area to stay. My weekend project.
The look and feel is cool and so is the map view but I think you should add more information about why those areas are so great besides just restaurants and hotels. Like a main attractions section since people don't just choose areas based on where they can eat and sleep
jlukecarlson··on Why OCaml, Why Now?
OCaml is actually taught in the second level computer science course at my university. I think its a great language for learning topics like recursion especially with its pattern matching. Its also a great intro to functional programming
jlukecarlson··on A Lost Boy Grows Up
Jacob told the Greens he was sure they had struggled as well. “What matters,” he said, “is your determination, your dedication, your ability to move your own challenges.”

Given his life experiences it is so cool that he refrains from judging people and it's sad that people who have endured much much less feel entitled to look down on others.

jlukecarlson··on Show HN: Using GitHub to tackle Ray Bradbury's 1,000 Nights Challenge
Would you ever consider putting the text of these pieces of literature into the repo? There is always the chance that links break and all that.
Page 1 of 2Next →