Closer is RJ38X, which is a series 8-position jack, not a normal 8-position jack. ("Series" means that the jack shorts pint 1 to pin 4 and pin 5 to pin 8 when there's not a cable plugged in to it; you would be able to fit an "Ethernet" connector into it, but even so it's probably not what you want.)
AFAICT (skimming 47 CFR part 68, and the historical AT&T documents that became 47 CFR part 68), there is no RJ-number for a normal 8-position jack.
Because of the size being different? Surely a keyed female plug will take a male connector with or without the key. Or did you mean you couldn't fit a RK45 connector into a Ethernet plug because then the key would interfere?
The regular ethernet 8P8C connector was defined by both an ANSI and ISO spec, neither of which gave the connector an actual name as it covers modular connector designs. :/
RJ11, RJ14 and RJ25 all used the same 6P housing though, making them 6P2C, 6P4C and 6P6C connectors, respectively.
Things sold as RJ11 is often 6P4C, making for another error. The rule of thumb is that anything referred to as RJ-something is likely wrong.