It would be interesting to see a plot of the error compared to the analytical solution as it trains.
The advantage of the RL approach is that it doesn't need to know how an arm moves but then involves some training.
It's certainly neat that inverse kinematics can be learned from zero knowledge, but I would have a hard time trusting it to operate a real arm in an industrial setting.