Where I live (a small seaside town), everyone makes their own jars of salt-cured anchovies. They are traditionally sealed with a loose lid consisting of a slate disc with a stone or other weight on top. They need to mature while still being able to breathe, and they must always remain covered by the proper amount of salt.
(The way you describe yours—as extremely smelly and falling apart—doesn't really suggest they're high quality. Normally, a properly cured anchovy should remain almost completely intact, so you can remove the tail and backbone and end up with two whole fillets. The peppercorns are a bit unusual as well.)