You could chooch along quite nicely in Kolibri OS all the way down to 8MB of RAM it seems and have a relatively okay experience in it [1]. Seems as though something like Puppy Linux will get you going on 64MB of RAM or lower [2].
If you really want to take Linux to the extreme, probably the place to start would be the efforts made to use it on embedded devices [3].