I work in a similar area, have some questions:
- How do you deal with standardization across the different events you log? How do you handle standardized naming, representations (formatting) and types?
- What about validations? do you validate the payloads in any way? if so, at what layer? Client before logging? In Kafka?
- Any privacy capabilities? How do you make sure the data is not accessed by processes/people that's not supposed to access a datum?
Thanks!