Hacker News Reader

Comment by leobg | Hacker News Reader

> In one experiment, they started with the prompt “Bill Bradley was a” and used the decoding functions for “plays sports” and “attended university” to see if the model knows that Sen. Bradley was a basketball player who attended Princeton.

Why not just change the prompt?

  Name, University attended, Sport played
  Bill Bradley,

View on HN

This is research, trying to understand the fundamentals of how these models work. They weren't actually trying to find out where Bill Bradley went to university.

Of course. But weren’t they trying to find out whether or not that fact was represented in the model’s parameters?

No, they were trying to figure out if they had isolated where facts like that were represented.

Reply on news.ycombinator.com