155 karma · joined May 6, 2023
Much of this data is extremely 'gameable', and a lot of the 'alpha' between successful and less successful institutions is being 'good at surveys.' e.g. for NSS, between comparable institutions it's really a question of how good they are at getting students to complete the survey (students mostly ignore it, and you lose marks for poor completion rates).
Of course — it should also go without saying that there is no 'correct' weighting for any of this data, and depending on how you weight the different indicators, the rankings change.
The people who get what they want in these situations are the ones who are prepared to behave sufficiently unreasonably. This is a second order consequence of 'unaccountability' that Davies misses. For the customer, or object of the system, it incentivises people to behave *as unpleasantly as possible* — because it's often the only way to trigger the exception / escalation / special case, and get what you want.
The people who get what they want in these situations are the ones who are prepared to behave sufficiently unreasonably. This is a second order consequence of 'unaccountability' that Davies misses. For the customer, or object of the system, it incentivises people to behave as unpleasantly as possible — because it's often the only way to trigger the exception / escalation / special case, and get what you want.
- you aren't allowed to do any programming yourself, you just write a specification
- the majority of the people doing the programming are incapable of reading the specification
- many of those who can will deliberately ignore it to save money
- nevertheless, it's your fault if it's realised incorrectly
The current legal requirement to get clearance for all samples only arose after a bunch of court cases in the late 80s/ early 90s, mostly involving quite obscure musicians.
There are a lot of people on here who assume that ‘logic will prevail’ in the courts on questions like use of copyrighted data in training data. History shows that this really isn’t a safe assumption. The courts have historically been extremely favorable to copyright holders. It would be foolish to underestimate the legal risk to openai et al here