New bill would let defendants inspect algorithms used against them in court

Getting expert witnesses (cheaply/pro-bono) is the missing catalyst here. What does Joe User know about hidden weights and logical evaluation orders?

Either the algorithm or the code can be wrong.

We see frequent updates (aka error corrections) to our phone operating system and apps on a near daily basis.

To be admissible evidence, a computed result must show the entire decision tree and the code at each decision point. This should be in the initial disclosure to the defendant.

Id ask how was the system tested? For the system complete test records to be produced for examination. Id ask to see the test data for the specific software version This includes test cases, test case data and test case results The test results should also include any needed setup information and configuration, such that test results can be reproduced, exactly.

If its not been tested and/or there is no record of it, how can it be known that the system operates correctly?

Interesting that a bill is even necessary. Doesn’t the defense already have a right to preview the evidence used against them?

A black box algorithm passes all tests that it has accuracy and precision both above 95%. Nobody understands how it works but all tests support the performance stats. Should this mysterious black box algorithm be allowed for use in courts to improve decisions?

Crazy that the victim now has to be debugging the accusers systems. Still, better to have the option than not.