Hacker News Reader

Comment by hga | Hacker News Reader

True horror story: The first board I was involved with when working at Lucent in 2001 was a monster modem card, provided something like 300 modems plus or minus. For a long time in the development process we had a weird reliability problem which just could not be tracked down. Until in desperation a hardware engineer started putting his scope probe everywhere ... and found a line (or set of them) where the signal was messed up in the middle but not at the end!!!

Analog is a black art.

View on HN

There's a lovely book on high-speed signaling subtitled "a handbook of black magic". I always found it very fitting. It explains the rules and heuristics and methods of working around and exploiting the analog nature of digital signals.

I highly recommend that book as well, I learned more about signal integrity from reading it twice than I did during all of EE undergrad.

Link: http://www.amazon.com/High-Speed-Digital-Design-Handbook/dp/...

My company designs & sells high-perf memories. My lead AE has a copy of this within reach of his desk.

I currently work in the embedded field and we had a similar issue where my software team spent days trying to track down weird problem that looked like hardware.

Long story short was that spansion changed from gold to copper feeder wires inside their memory chip and was in every so many chips causing bit flip problems.

Our end product is in the automotive space averaging 300,000 units per year. It's a non safety related component.

Black arts are just arts with more rules than we ourselves understand. I don't think we should let that scare us from trying to understand. It's all just physics.

It's all well modeled by transmission line theory and electromagnetic compatibility, as far as I know; although I'm sure modern processors have some additional problematic quantum behaviors too.

Of course. But the actual physical models that underpin these things are vastly different than the mental models we use to reason about them - even for people who understand them. Frequently the "lower level" model only needs to be pulled out at troubleshooting-time.

Hiding complexity behind abstractions is what allows us to build complex things.

It's also about manufacturing tolerance, making room for error, suffering environmental stuff and understanding that the universe is out to get you. Sure, in reductio ad absurdum it's all just physics, but most of shipping a product is making engineering tradeoffs, dealing with complex stuff you may not fully understand, and making plans for when vendor B's product isn't exactly the same as vendor A's chips, but vendor A was just bought by Apple and won't talk to you any more, at any price. :-)

Yup. As clocks increased, traces began to more/less resemble waveguide designs a-la microwave. And if you've ever done microwave RF eng, it's all black magic.

Or don't use auto-route feature of many electronic design programs have...

When was the last time you heard of a signal in a PC trace degrading and then getting much better?!?!!??!!!! So much better that when previously tested that trace wasn't deemed suspicious?

Not a PC, but a good story about a PDP-10 back-in-the-day:

http://www.catb.org/jargon/html/magic-story.html

Look at load line impedances. The effective output impedance of a transmission line depends on the fraction of wavelengths of waveguide transmit the wave. At any half wavelength, the output and input have equal impedances. If the output were matched to the input but no the line you get the exact effect described.

http://en.wikipedia.org/wiki/Transmission_line#Half_wave_len...

Serial LVD buses make clock skew and interference mostly irrelevant. It's a reason besides cost that parallel ports and PATA and parallel SCSI are dead and USB, SATA/SAS dominates.

Reply on news.ycombinator.com