The various Sun 'JavaStation' NC models retain the SPARC CPUs of their workstation line - they definitely do not use ARM.
JavaOS was in ROM, on a module that can be removed (SIMM-style form factor). At one point people started to use BOOTP to run Linux compiled for SPARC as a replacement, as JavaOS was unpleasantly slow on JavaStation hardware.