Elementary Calculus: An Infinitesimal Approach (2000)
people.math.wisc.edu
people.math.wisc.edu
https://terrytao.wordpress.com/tag/nonstandard-analysis/
https://terrytao.wordpress.com/2010/11/27/nonstandard-analys...
That said, it's a shame the PDFs are in image format instead of text as it makes it more difficult to copy notes etc. from the text into one's workbooks. This would save the student time in taking notes.
Another minor criticism I have is that like many texts on mathematics it lacks both detail on the background to mathematical concepts and their applications. For example, the discussion of Eula's Formula on page 879 is somewhat incomplete. In some ways the Wiki page https://en.wikipedia.org/wiki/Euler%27s_formula does a better job in that it has a diagram of the 'Three-dimensional visualization of Euler's formula' (its application to circular polarization, etc.). Including this diagram and having some discussion about the significance of the relevance of the i, e and ᴨ in this famous relationship would have put the subject into better context.
(I recall the significance was lost on me when I first studied the subject for the same reasons. I think that many mathematicians don't realize that many of us ordinary mortals just don't think the same way they do, so including more visual descriptions and diagrams, typical applications and historical background do actually help one's understanding. However, I acknowledge that including this extra material makes textbooks larger and thus more expensive. Perhaps that's the penalty we have to pay.)
I was just thinking the other day about how enjoyable I found learning calculus, compared to what others tend to report. Perhaps this book was part of the story -- very cool that it is being provided free of charge now!
But the worst part of the experience was the method of starting with epsilon/delta and limits, to "explain" what was going on, and then throwing that away to get on with solving problems using differentials and integrals. The lectures almost universally took the form of the professor going through a proof of the technique in question and then assigning a set of problems from the text.
I guess that was pretty normal once upon a time? I remember that was how my calculus textbooks did it. First pictures to develop some visual intuition, then a gentle foray into how to make the intuitions more rigorous using limits, sequences, and series, and then techniques for solving certain differentiation and integration problems. It makes sense to me; it shows that the techniques are based in math and not in magic, and it lays the groundwork to introduce Taylor series later. It also foreshadows the kinds of proofs that students might do in real analysis if they decide to pursue an engineering or physical science major.
I guess every math class could be very different if you knew it was the last math class that students would take, but you don't know that, and it's problematic to separate students according to which ones will study the material further before they're even exposed to it. If a student takes a class and unexpectedly finds they want (or need) to take further classes in the area, they don't want to be find out later that, "Oh, sorry, we didn't think you would pursue this subject, so we gave you the version of the class that didn't prepare you for the next one."
I understand the ε,δ way of defining the limit is important because it extends to other context such as continuity in topological spaces etc; however, as a physicist, infinitesimal quantities reflect the way we really think about calculus intuitively, so it makes sense make them "first-class" numbers.
Simply put, because there aren't more textbooks for it and because professors aren't as familiar with it, leading to a vicious circle where it's not taught because it's not as easy as teaching the standard way, and then it's not routinely learned because it's not taught ….
(The advanced logic that goes into the underlying constructions, but that isn't necessary to use non-standard analysis, also causes many non-logician mathmaticians to give it an unjustified bit of side-eye.)
You really think that it makes sense to require the axiom of choice to prove that the derivative of x^2 is 2x as Robinson's ultrafilter construction does?
I personally like understanding infinitesmals, and knowing what the d in dy/dx means. And knowing that the notation for a second derivative, d^2y / dx^2, is not just arbitrary. This occasionally has uses. For example if you have implemented a numerical d function, for example as lambda x: f(x+h/2) - f(x-h/2), then d(d(y))/d(x)^2 is an excellent approximation to the second derivative.
But conceptually I think it is far better to understand approximation a lot more directly than using a complex construction for the infinitesmals.
This was just what I meant to say—the details of the construction shouldn't matter, only the axiomatics of the structure that's been constructed. You can use infinitesimals perfectly well without having to get into the weeds of how they're constructed. To be sure, your results only apply within that structure, but that's the way of mathematics, that things are proven only within some structure.
I think one wouldn't expect, for example, a constructivist mathematician to disparage classical mathematics because it relies on such inelegant logical machinery as the law of the excluded middle. Well, maybe some constructivists do that, but more often they offer the better response of showing how many of the same results you can recover without requiring that logical machinery.
The same response seems appropriate here: there's no reason to cast aspersions on people whose work rests on the axiom of choice; but, if it bothers you, then see how much of their work you can do without the axiom of choice. If you can prove the equivalent, then great; no need to complain! If part of their work genuinely requires choice, then that's an interesting fact, too.
Robinson's construction required the axiom of choice and proved that every result that you can prove with infinitesmals has a proof with limits without the axiom of choice. But he went on to show that infinitesmals allowed abandoned proofs to be made rigorous, and claimed that they were good for intuition.
In other words infinitesmals were trying to replace something that had become established. The axioms behind the established thing are much weaker than the axioms required for infinitesmals. And infinitesmals provably don't let you prove anything fundamentally new.
At that point any interest in infinitesmals has to come down to curiosity and the claim that it helps intuition. As for curiosity, I'm glad to have understood them. As for helping intuition, that is in the eye of the beholder, and has not been a compelling enough argument to get people to switch.
If we switched to teaching calculus based on nonstandard analysis we'd have to also teach the standard approach because of all the existing material that uses it and all the people who already know the standard approach but not the nonstandard approach.
Not many people are willing to commit to a few generations of teaching dual approaches and using both in their work until the people who only know standard are all dead or retired and all the old material has either been translated or is obsolete, when the advantage of the nonstandard approach is just that it might be conceptually easier or more intuitive.
Everybody switched during the 19th century, because epsilon-delta was in fact the only rigorous method.
Abraham Robinson gave a rigorous foundation for infinitesimals only in 1960.
cf. Detlef Laugwitz, Curt Schmieden's Approach to Infinitesimals. https://doi.org/10.1007/978-94-015-9757-9_12
However this turned out less useful going forward.
Perhaps there’s a perceived notion that to understand infinitesimals and such you need a logic background, but logic classes are generally an upper-half class that doesn’t have a full track for undergrads. This would be in addition to the fact that most professors are familiar with ε,δ-proofs and AP calculus classes cover the limit approach (though not rigorously).
The entrenched pipeline of mathematics students and professors would have to face a period of getting flushed out and refitted, and this is probably not attractive to administrators.
In my experience, epsilon delta understanding was pretty much unrelated to passing calculus, where tests consisted of formula/substitution crunching.
That's a shame. There are so many exciting things to learn in calculus that you can skip the epsilon delta stuff and still do so much more than formula/substitution crunching. Calculus is the gateway to differential geometry, topology, mathematical physics, differential equations, taylor series which are useful for numerical approximations and so many other things, analytic number theory, complex analysis, many forms of statistics. So many wonderful things you can do with it.
Imagine using your new found calculus knowledge to show that the orbit of the planets about the sun is an ellipse -- which is what Newton used calculus to do -- OR learning all about epsilons and deltas. Which would be more fun as a student learning calculus. Make the math exciting enough and people will put up with the drudgery of calculations.
Oooh, the comments you'll get from other mathematicians...
e.g., many engineering calculus courses, and explicitly some of the texts.
Analysis from Rudin, and later some manifold theory from Lee, have converted me to more mainstream views on the subject... However I think this is probably how calculus should be introduced at first, particularly to say highschoolers.
Define “f(x)” is an infinitesimal if lim f(x)=0 when x-> 0.
which is the same as saying “f(x)” is smaller in absolute value than any real number.
Nothing more.
The problem: you cannot divide by infinitesimals. Now you need to “create a field” from these numbers and the reals.: this requires the axiom of choice. There is also the sign problem.
But in the end, “that is all you neeed”. You think of infinitesimals as “numbers smaller than any true real number”.
I am also a bit worried, if you have a field it is also a division algebra. And I thought we know that the only divisions algebras are R, C, H? Like https://math.stackexchange.com/questions/2020399/division-al... (The link does not 100% fit). So how do hyperreals go around that 'no-go' theorem?
A simpler example of another real division algebra (and in fact, another field) is the field of rational functions with real coefficients. This field is also infinite dimensional over the reals (for example, 1, x, x², x³... are linearly independent).
The usual construction of the hyperreals replaces real numbers with sequences of real numbers, and also introduces a nontrivial equivalence relation on the sequences, making two sequences equivalent if they agree on a “large” set of terms. The real numbers get represented by the constant sequences, infinitesimals get represented by sequences that approach 0, and infinite numbers are represented by sequences that grow without bound.
The magic is in how “large set of terms” is defined. You need a “large set” relation with the property that finite sets are not large, and for any set either the set or its complement is large. Then we can resolve your question: say you had two not-always-zero sequences that multiply to give the all-zero sequence. Then the set of zero positions is large for one of those two sequences. And that means one of your sequences is equivalent to the zero sequence. The field axioms are saved!
This honors project has what looks like an accurate write up of the construction along with proofs of some of the main theorems: https://ideaexchange.uakron.edu/cgi/viewcontent.cgi?article=...
Otherwise you do not easily know if your axioms are actually consistent.
I still find myself in the "number systems are a cultural artifact" camp. We choose which details to keep and which to throw away in our abstractions. There are anumeric cultures and it's not clear to me at all that the existence of integers is obvious (beyond what humans can subitize) unless you're immersed in a culture that has impressed them upon you since early childhood.
Do you have "2 cats" or actually just "this cat and that cat"? This cat is a bit bigger but that one looks meaner.
Deep down I think that an insistence on the "reality" of integers versus reals (say) is purely aesthetic. (Ignoring for the moment that our conventional constructions build one from the other in a certain way).
I don't want to descend into solopsism and apologise if I veer too far in this direction. Also thanks for taking the time to rebut what is probably a sophomoric argument.
I suppose my fundamental objection is that if integers are "real" then it seems to me that quaternions must be similarly "real" (since I can describe useful things with them) and so on, I can't see a boundary which would let me say "ok integers are the real deal but infinitesimals are just a thing we made up".
I think we have a zone of possible agreement if we decide either that all these abstractions are "real" or none of them are.
I disagree! In fact, I think the difference between countability and uncountability is pretty huge!
(I prefer "pure complex", but that's got its issues too, of course.)
You might want to look at the Metamath Proof Explorer materials on constructing numbers, a good starting point is here: http://us.metamath.org/mpeuni/mmcomplex.html Metamath is a general tool that lets you specify axioms and proofs, and verifies that the proofs only depend on axioms and previously proved proofs. The Metamath Proof Explorer (MPE) is a particular application of it that uses classical logic and the ZFC set theory axioms. MPE shows how to construct numbers using these axioms, then proves a set of number axioms, and from then on uses only those axioms so that the details of any particular construction are not important. What's usually more important is showing that you can construct them.
A standard real z can be viewed as a hyperreal, by taking that sequence to be z, z, z, …. Another equivalent representation of that same hyperreal would be the sequence 0, z, z, z, … because that's equal to the first sequence in "very many places". There's an infinite hyperreal, implemented by the sequence 1, 2, 3, …. (In fact there are tons and tons of infinite hyperreals.)
You can prove that the space of hyperreals is a field, and moreover with some model theory you can show that actually a lot of structure (in fact, all first-order structure) transfers directly over to the hyperreals from the reals.
For the foundations of nonstandard analysis, and a wide-ranging overview, I strongly recommend Robert Goldblatt, "Lectures on the Hyperreals: an Introduction to Nonstandard Analysis", one of the Graduate Texts in Mathematics.
https://people.math.wisc.edu/~keisler/foundations.html
It's a bit more than an instructor's manual. It covers the construction of the hyperreals in two ways: One (in section 1E) is relatively short, and is like the compactness theorem approach Abraham Robinson originally used in his book ("Non-standard Analysis", Princeton U. Press).
The second construction uses ultraproducts (in Chapter 1*). Keisler gives a quick introduction to the logic needed to understand the ultraproduct construction, beginning with formal languages and sentential logic. So the prerequisites are there, and explained concisely but clearly. The ultraproduct construction comes up elsewhere; for applications to other areas of math, see Martin Davis's book "Applied Nonstandard Analysis" (Dover Publications). (There's a review of the books by Keisler, Davis, and Stroyan and Luxemburg: https://www.ams.org/journals/bull/1978-84-01/S0002-9904-1978...).
The rest of Keisler's monograph contains mostly nonstandard proofs of many of the results in the textbook. I like it a lot, and anyone who's interested in this stuff should grab the PDF.
Another book that is short and moderately elementary is "Infinitesimal Calculus" by James Henle and Eugene Kleinberg, also published by Dover [which also publishes a paper version of Keisler's text, and is generally a great publishing company].
When Keisler's book came out, someone decided that it would be reviewed for the Bulletin of the AMS by Errett Bishop, who (as I recall) was a noted constructivist. You can read the review here: https://www.ams.org/journals/bull/1977-83-02/S0002-9904-1977... Having a constructivist review a calc textbook that uses nonstandard analysis was probably not a great idea. The review ends with: "Now we have a calculus text that can be used to confirm their experience of mathematics as an esoteric and meaningless exercise in technique." I believe Keisler wrote a reply in a subsequent issue of BAMS, but I can't find it.
R* = {tau[epsilon] : tau(x) is an element of T(M)}
Note that the proof uses Zorn's lemma, so it's definitely not "constructive" in the strict sense (in case that's what you meant).The extended reals or extended complex plane do behave as you describe (and infinite cardinalities have the same property), but infinitesimal treatments of calculus do not. You're instead working in an ordered field that contains the reals and some element greater than all reals.
Supposing such a thing can exist (they can exist in ZFC), the fact that you're working in an ordered field gives you a lot of infinitesimals and infinities (and also a lot of numbers "between" the ordinary reals).