Looks like this is not fully compatible with Apple Silicon M1. I tried to install Pandas along with PyPy and ran into failure on building numpy. Looks like it's a known issue https://github.com/numpy/numpy/issues/17807