For some reason this issue with model having insane amounts of weights but training data being small is not something that is an issue for modern NNs.