I once worked on a monitoring system (internal and for clients) that was build in house. Everything was configured in an Oracle database.

To adjust the parameter of a check? Edit rows in Oracle using SQL. Add a new check? Edit rows in Oracle using SQL. Edit the script for a check? Edit rows in Oracle using SQL.

My job was to make improvements to the scripts/checks/agents, but not the process.