The 7-Year Bug That Took 3 Minutes to Fix
agilitza.com
agilitza.com
In 2019 my father died. My mother was quickly diagnosed with Parkinsons disease and could not really cook for herself any more so I increased the frequency of my visits and cooked enough food in a week to last her a month, freezing everything in portions. This meant I got to spend more time with the extractor fan and I decided to pull it down to see if my hunch was correct. Well, it was, more or less. The installer had installed a ferrite bead but he clearly did not understand why and where that bead was to be installed so he put it on the incoming power line. That's fine if the interference is expected to come from the outside or if the locally produced interference is to be kept from travelling down the line to the network but it does nothing to protect the control circuit from the interference coming from that big transformer which is connected directly to it. Swapping the ferrite bead from the incoming power line to the transformer power line took maybe a few minutes. The thing never locked up again, unfortunately my father never got to see the thing working as intended.
I love when a simple solution fixes something.
Would need to investigate, will do the next time I have some beers with the colleagues from that company!
Every few months for 7yrs is a lot of opportunities to iterate on collecting field measurements. And it could be done in a holistic way that doesn’t break the safety certification.
This equipment was deployed in remote places without any kind of connectivity, sometimes not even cell coverage.
But the real problem is that the frequency of this failure in a single device was much lower than that. There were hundreds of these devices deployed and we never had one particular unit that was triggering all the time, sometimes here, sometimes there. Really a nightmare.
I can list several major problems I created that took many months to solve that make me look incompetent.
So I'm the pot calling the kettle black.
Also: hindsight is 20/20.
However, I have to disagree in one aspect, it is not basic electrical engineering practice to add filter capacitors on every node. Some nodes need it, some don't. This one, by the topology of the circuit didn't, but from the need for immunity did. This is not always obvious, but for sure I could have anticipated.
Hindsight is definitely 20/20 on this one.
If you think this way, you are already on a good path. Think that there's a lot of folks that don't even care at all, you do care and want to improve, that sets you apart.