Gibbs Phenomenon
en.wikipedia.org
en.wikipedia.org
"...is the peculiar manner in which the Fourier series of a piecewise continuously differentiable periodic function behaves at a jump discontinuity. The nth partial sum of the Fourier series has large oscillations near the jump, which might increase the maximum of the partial sum above that of the function itself"
I have a PhD in machine learning and also an interest in magnetic resonance imaging. Sometimes Gibbs phenomenon leads to an artefact (called Gibbs artefact) that we see in our images of the heart when we are doing a certain sequence called stress perfusion cardiac MRI. I am not an idiot, and yet I actually cannot understand the first paragraph of this page.
Mathematics articles on Wikipedia so frequently read in a way that is only interpretable by mathematicians or physicists. This is not the point of Wikipedia! You don't even have to pick an advanced topic - the Taylor Series is taught in high school maths in the UK, and look at the introduction to its Wikpedia article, it's ridiculous!
Articles about relatively esoteric topics in the biological sciences are almost always much better, and at least try to first introduce the topic in a way the average reader can understand, e.g. https://en.wikipedia.org/wiki/Supraventricular_tachycardia
Naturally, to understand it you need to some understanding of the terms used but that's why they each link to their own wikipedia pages.
As for the section you quote - I saw what it was trying to say in my head (graphically-ish) before I actually parsed the sentence properly, that might be why it's remained poor. It's not a bad explanation it just isn't long enough.
> In mathematics, the Taylor series of a function is an infinite sum of terms that are expressed in terms of the function's derivatives at a single point. For most common functions, the function and the sum of its Taylor series are equal near this point. Taylor's series are named after Brook Taylor, who introduced them in 1715.
> If zero is the point where the derivatives are considered, a Taylor series is also called a Maclaurin series, after Colin Maclaurin, who made extensive use of this special case of Taylor series in the 18th century.
> The partial sum formed by the first n + 1 terms of a Taylor series is a polynomial of degree n that is called the nth Taylor polynomial of the function. Taylor polynomials are approximations of a function, which become generally better as n increases. Taylor's theorem gives quantitative estimates on the error introduced by the use of such approximations. If the Taylor series of a function is convergent, its sum is the limit of the infinite sequence of the Taylor polynomials. A function may differ from the sum of its Taylor series, even if its Taylor series is convergent. A function is analytic at a point x if it is equal to the sum of its Taylor series in some open interval (or open disk in the complex plane) containing x. This implies that the function is analytic at every point of the interval (or disk).
The Wikipedia article reads like a summary for someone who already knows what it is. I'd reckon if I hadn't spent years going over the topic, the article would've read like a riddle.
This is an enormous challenge that is met only by people with a particular gift for communication and teaching... And they are not rewarded for their skill beyond some scattered applause.
I'd say the minimum qualifications of understanding this sentence adequately is:
- knowing the basic terminologies of calculus to understand what "piecewise continuously differentiable" means
- knowing that the Fourier series is some sort of infinite series, which you can get from context if you already know that infinite series is a thing, from Taylor series, which you'd know from calculus from the above requirement.
As a programmer, I have learned the importance of simple, explanatory variables, comments, and abstraction to communicate what is going on without losing the reader in the details.
Wikipedia definitely suffers from inconsistency in who they are writing for.
Regardless, even people with deep familiarity in a topic can benefit from succinct explanations.
I have no idea who wikipedia wants to serve with its articles since they vary wildly in intended audience.
Do not take that badly, but have you learned actual statistics and the mathematics behind them? Or like the few ML people I've met, do you just use and tweak models?
The part you quoted is extremely clear to me, even without actual pictures: it just means the approximation you use departs from the actual function, tell you where and why.
I can infer there will be an artifact, and how I could try to minimize it.
> Sometimes Gibbs phenomenon leads to an artefact (called Gibbs artefact) that we see in our images of the heart when we are doing a certain sequence called stress perfusion cardiac MRI.
You describe where and when it happens in practice, not why it exists in theory.
Different needs for different people!
Oops. I was just talking from experience, where I had some expectations of understanding given the level of expertise professed that weren't met in practice.
I say that and I don't even have a PhD (or any other degree!!) in statistics or ML...
> I noticed a lack of holistic knowledge when it came to (say) the hardware that actually execute that machine learning.
Exactly, there are a lot of people I talk to who seem to use "black boxes", without any understand of how it works.
If they can be more productive, why not? However, when one of their black boxes is broken, they often get stuck: as they can't even understand how it works in normal cases, understanding when it may stop working, or even more importantly, how to fix it then, is just not possible.
I have found that to often be the case with mathematics and statistics.
Sometimes it can be a problem, so I have derived some quick test questions to evaluate the person understanding. They are not Shibboleth: they are not hurtful by virtue of having different "levels" of answer that the person may give.
Typical example for stats/ML: "Can you explain why the LLN happens?" Bonus points if the person just tells me the Normal distribution is defined by a Gaussian that is the Fourier transform of itself.
But this is almost a necessity, since people will have so different backgrounds. Just imagine bringing a first-grader up to speed on the gibbs phenomenon. That's a lot of things they need to learn first.
Mathematics is, unlike almost any other subject a tower of learning where everything builds on the previous level. So it's uniquely hard.
[1] https://www.google.com/books?id=JrQ4AAAAMAAJ&pg=PA198#v=onep...
It's still unclear to me about how the mathematical explanation (approximating a continuous function with finite series) explain the physically observable "ringing artifacts" and square wave jitters.