You can install from an apk and not get updates.

Besides, if all you're doing is some kind of chain of authority you could do it through fdroid which enforces a constant key. No need for a standalone phone which will anyway have the same components as any other phone.