Flowcharts of programming language constructs
progsbase.com
progsbase.com
(1) Makes it pretty clear why exceptions are even more of a control-flow nightmare than goto. What a messy graph.
(2) The 'defer' diagram is a big WTF. Couldn't even figure out which box is supposed to represent which statement in the example.
(3) I'd love to see a graph of the control flow when you throw in a few spurious lambdas like "advanced" C++ programmers tend to do (and similar in a few other languages). Might even make exceptions look good.
And yet in practice, it’s really not that confusing. Expressivity counts for more than the number of branch opcodes generated by the compiler.
That makes exceptions fall more towards the "easy-to-write, hard-to-read" side of things; implied side-effects make your code slim in the present, treacherous as combinatorial elements increase. With error codes you pay a linear cost for every error, which implicitly discourages letting things get out of hand, but adds a hard restriction on flow. With goto, because so little is assumed, there are costs both ways: boilerplate to specify the destination, and unconstrained possibilities for flow.
Jumping backwards is the primary sin associated with goto, since it immediately makes the code's past and future behaviors interdependent. There are definitely cases where exceptions feel necessary, but I believe most uses could be replaced with a "only jump forward" restricted goto.
What do you mean?
(It's actually even simpler than that when accounting for the functor and monad properties of Result<T, Err>, but the graphical representation for a "functor" or "monad" is a bit more complex; these would be drawn as labeled regions, and functor and monad properties would describe how such regions can be "merged" or "combined".)
A good use case for understanding the control flow of 'defer' is when cleaning up resources.
mutex.lock();
defer { mutex.unlock(); }
val f = File.open(filename);
defer { f.close(); }
// write to file
It's a nice construct because it keeps construction and destruction close together instead of far apart mutex.lock();
val f = File.open(filename);
// write to file
f.close();
mutex.unlock();Flowcharts feel like a simple and universal way of talking about, well, control flow, but they imply a certain kind of bias toward a kind of reasoning which isn't necessarily all that better than code itself.
I found the defer diagram very accurate and understandable, but I already knew what "defer" does.
From the preceding examples, I understand that the little box is an instruction the developer didn't write, but was added automatically. From the graph, I understand that the instructions are executed in a different order from what it's written by the developer (and exactly in reverse order).
Normal brain: Find the representation that best expresses the structure to discover the hidden simplicity in everything.
Galaxy brain: Use flowcharts to draw out how exceptions work, forget your previous understanding, and then realize that they are too complicated for anyone to use.
In some code, for some people.
> their flow chart looks like a hot mess
In code where the "exceptions are rather easy to reason" about the flowchart would also be easy to read.
In code where the exceptions hide a flowchart that's a hot mess the exception syntactic sugar hides the mess.
I'm not suggesting every code with exceptions is good. Just saying that not every exception is bad, and many are indeed great.
I can't imagine writing Python without try blocks...
In other words, Python requires that model, but making something necessary isn't the same as it being good. If you go around breaking people's arms then splints and casts become necessary. Does that make arm-breaking OK?
> It allows you think about the problem with a much smaller cognitive load.
There's a very fine line between "smaller cognitive load" and "sweeping stuff under the rug". Since you mentioned Python, I'll point out that a lot of Python code only looks simple because it's incomplete and will fail catastrophically for what should be innocuous errors. Add the proper error handling and it's just as complex as code using an error-return or optional-type model. Often that means even more cognitive load because the happy path and the handlers are in multiple methods/classes/files (especially likely as multiple people hack on code over time).
- - - -
Sometimes the problem you're solving really does require a gnarly flow-chart. If that's the case, you're almost certainly better off writing (and documenting!) a state machine instead.
If your control-flow graph is only a little gnarly then representing it with exception syntax is fine IMO (I write Python code too, with exceptions.)
The problem comes when you accidentally create a hidden gnarly graph (as the result of bad design up front, or "drift" over time as a piece of code gets reworked, maybe by multiple people who may not all be privy to the whole history of the design and code, or both) and then forget to do something crucial along some flow of control and you have a hard-to-debug bug.
They may only be a hot mess when expressed as a flowchart. But so what? I'm not programming in flowcharts. If exceptions can do what I want cleanly, why do I care if it's a mess considered as a flowchart? That's not my problem.
This argument is like saying that the library function I call is a mess of a flowchart. Why should I care? Can I express what I need to express cleanly by calling that function, or not?
Of all the arguments against exceptions, "it's got a mess of a flowchart" is the absolutely least relevant one.
There are places to worry about compiler efficiency. I don't think that this is one of them.
Programming languages have different "things" built in. Like, if you have re-entrant function calls, then your language has a built-in data structure called "the stack". If you have some algorithm that needs a stack, you have the choice of using the built-in stack, or using an explicit stack.
If you have a programming language with some sort of type system, then you have tagged data built-in. You can model your domain in the type system, or you can model your domain using a tuple like (tag, datablob).
If you have object-oriented programming with dynamic (single) dispatch on the first argument, then your language somewhere has a built-in data structure called a table/dictionary/associative-array. If you want to implement some sort of switching behavior you can do a switch on the `tag`, or encode the tag in the type system, and use dynamic dispatch.
Some programming languages have support for asynchronous calls. That programming language has a built-in scheduler of sorts. You can use it, or build your own, (or use the OS!).
A state machine, I think, is a great example of the same idea. Your CPU has a bunch of state (e.g. the program counter), and your programming languages has a bunch more state (like the current stack frame, the line number). You can encode your state machine in that, or you can model it explicitly. How well you can do it "implicitly" depends on other language features, like whether you have coroutines.
I think it's challenging, without expertise that might come only from having solved an identical problem already, to know ahead of time when to use these built-in things or roll your own. When you mention testing, I think that's a great example of expertise you've acquired. If you would like to test certain invariants in your state machine, e.g. "a transition from A to B never happens", then you're going to have a hard time doing so if your state machine's state is encoded in the line number of your language interpreter or the program counter, or whatever.
Rick Flow:
https://pbs.twimg.com/media/DHnyCwiXsAAFyzq.jpg
Circumstances In Which Whipping It May Be Appropriate:
https://gypsywitchcampfire.files.wordpress.com/2015/08/whip-...
Total Eclipse of the Heart:
https://i.pinimg.com/originals/86/17/e8/8617e878f9c33ab3a3ba...
We Will Rock You:
https://www.edrawsoft.com/template/lyric-flowchart.png
Let It Be:
https://i.pinimg.com/originals/a7/74/b5/a774b576f45a6eb71a42...
All You Need Is Love:
https://www.researchgate.net/profile/Alex_Ruthmann/publicati...
Modern Love:
https://i.pinimg.com/originals/8f/fc/9a/8ffc9a199caa1da49ec1...
I just gave Modern Love a listen, thanks, this was great.
https://en.wikipedia.org/wiki/The_Echo_Nest
http://infinitejukebox.playlistmachinery.com/
Infinite Jukebox
For when your favorite song just isn't long enough
This web app lets you upload a favorite MP3 and will then generate a never-ending and ever changing version of the song. Infinite Jukebox uses the Echo Nest analyzer to break the song into beats. It plays the song beat by beat, but at every beat there's a chance that it will jump to a different part of song that happens to sound very similar to the current beat. For beat similarity the uses pitch, timbre, loudness, duration and the position of the beat within a bar. There's a nifty visualization that shows all the possible transitions that can occur at any beat. Built at Music Hack Day Boston 2012.
Billie Jean Forever:
http://infinitejukebox.playlistmachinery.com/?trid=TRSFLTX13...
Scatman (Ski-Ba-Bop-Ba-Dop-Bop) by Scatman John:
http://infinitejukebox.playlistmachinery.com/?trid=TRXKEZN13...
Lots more cool Echo Nest demos:
[0] This is a slightly related vaporware loop which, I don't know, I find it mesmerizing.
I was alright right up until it got to exceptions. Simple statements are fairly nicely represented in flowchart form and almost condense the information a bit. Then it hits exceptions and everything after that just got so convoluted it became pretty ridiculous. Imagine trying to write out even 100 lines of modern code like that. You'd need a page the size of the side of a barn just for that.
Also, TIL about “long jump”. Seems like a feature I’d never use in a million years, but maybe it has its applications.
You call SetJmp, where you would want to put your try/catch blocks, then no matter how deep down some call stack you go, if an errir occurs, you can immediately jump back to where you called setjmp and handle it / report the error or whatever, rather than having to handle and bubble up the error by at every intermediate level, "returning" your way up the call stack.
Just me? Ok, I'll show myself out.
Great way to visualize. I think Exceptions, Finally (and Promises) got a little messy, but would make a good poster.
However, from what I observe, "aspects" look a lot like Common LISP Object System (CLOS) before/after/around methods.
The following could be added to C-style languages without overlapping with the existing syntax:
select(a) {
when 1,2,3 {...}
when 4 {...}
when 5,6 {...}
...
otherwise {...}
}
C# recently added a pattern-matching alternative, but it's still a bit verbose for most needs.It’s a far cry from general pattern matching (a la Rust, Scheme) but it’s helpful in some circumstances. Otherwise, you can also stick multiple case labels together, i.e.
switch(x) {
case 1 ... 4:
case 7:
case 9 ... 16:
...
default:
...
}
I don’t see why you need to call the C-style construct obsolete and awkward, though. It works plenty well for enumerations, which is basically what it was designed for. If you need to do something more fancy, if/else if chains always work.The Break statement is error prone because it's easy to forgot. Some languages "solved" that by making Break required; but if it's required, then it's superfluous: code-bloating eye clutter. If you never used a language that didn't need "Break" you may not understand how annoying it is to go back.
My suggestion above allows C-ish languages to add a modernized version and yet keep the existing construct for backward compatibility. In other words, the old one would be "deprecated".
This is not entirely true. Ranges and sets allow you to run the same code for different inputs. Fallthrough allows you to run partially the same code for different inputs.
It's a rare case, so I don't think its utility warrants making fallthrough behavior the default. But it's nice to have it explicitly, like "goto case" in C#.
Anyway, the reason why it is the way it is in C, is because case labels are literally labels, and the switch statement itself is just a branched goto - which is why e.g. Duff's Device is a thing. And that, in turn, is probably because it's a descendant of "switch" in Algol-60, which was basically an array of labels.
True, but it's a screwy way to manage such overlaps. The volume of errors and confusion exceeds the benefits in my opinion. There are other ways to do such. For non-trivial conditionals (such as overlaps), if-else is often the better tool anyhow. Case/Switch should only be used for simple mutually-exclusive value look-ups.
The closest I've seen to anything that actually does that is UML. But it does so only by having multiple different diagrams. That's like having a drawing with a front view and a side view - it's not a 3D diagram, it's two 2D diagrams that you can use to kind of see what's going on in 3D.
I don't know of any good system of notation that does what you're asking, nor any software for drawing or viewing such diagrams. But I agree that 2D flowcharts don't represent parallelism well, and that 3D looks like a better answer.
I mean, I'm not opposed to documentation. It's important. But if your management thinks that flowcharts are the way to do it, I wonder what millennium they think it is.
Flowcharts are just where I've felt that I've significantly underperformed; where management has asked for more of them.
Putting my resume on the street is something I do often. Want to look at it?
If you think flowcharts aren't the way to describe code flow, then I'm curious what method you think is better.
Depending on what exactly you are doing, parts of UML might be better. It lets you describe different aspects with different diagrams, so that, if one kind of diagram is sub-optimal for showing some aspect of what's going on, another kind might be better.
Actually, I didn't. I said I wanted to "up my game" which is a phrase commonly meaning "to get better". Said another way: I needed to get better at describing code to management.
> I will encourage you to keep thinking about the complexity of the choices you make in which constructs to use
Indeed, management generally wants simpler code even at the cost of performance. Simpler code generally translates to cheaper developers and cheaper maintenance.
> don’t buy into the thought that says performance implications are not a really concern
I actually write DNA analysis software. Performance implications definitely are a concern. :)
But performance is useless if I'm the only developer who understands how it all comes together (eg, high bus factor). So I've been writing a lot of documentation to that end, from file-level down to the systems-level and bit-level descriptions. I really would like better support for diagrams in markdown.
* a choice of a precondition and postcondition, Pre(B) and Post(B), for every basic block B
* for every basic block B, a proof that {Pre(B)} B {Post(B)}
* for every arrow a : B1 -> B2, a proof that Post(B1) /\ Cond => Pre(B2) where Cond is the condition for the arrow to be taken
o
|
v
+--□
|
| □<-+
| | |
| v |
+->□--+ compute thing -> predicate true ------> compute some other thing
| -> predicate false ->|
\---------------loop-----------/
... etc ...https://en.wikipedia.org/wiki/Nassi%E2%80%93Shneiderman_diag...
>A Nassi–Shneiderman diagram (NSD) in computer programming is a graphical design representation for structured programming. This type of diagram was developed in 1972 by Isaac Nassi and Ben Shneiderman who were both graduate students at Stony Brook University. These diagrams are also called structograms, as they show a program's structures.
>Overview: Following a top-down design, the problem at hand is reduced into smaller and smaller subproblems, until only simple statements and control flow constructs remain. Nassi–Shneiderman diagrams reflect this top-down decomposition in a straightforward way, using nested boxes to represent subproblems. Consistent with the philosophy of structured programming, Nassi–Shneiderman diagrams have no representation for a GOTO statement.
>Nassi–Shneiderman diagrams are only rarely used for formal programming. Their abstraction level is close to structured program code and modifications require the whole diagram to be redrawn, but graphic editors removed that limitation. They clarify algorithms and high-level designs, which make them useful in teaching. They were included in Microsoft Visio and dozens of other software tools, such as the German EasyCode.
>In Germany, Nassi–Shneiderman diagrams were standardised in 1985 as DIN 66261. They are still used in German introductions to programming, for example Böttcher and Kneißl's introduction to C, Baeumle-Courth and Schmidt's introduction to C and Kirch's introduction to C#.
>Nassi–Shneiderman diagrams can also be used in technical writing.
When Ben Shneiderman and Ike Nassi (who were grad students at the time) submitted their paper about them to Communications of the ACM, it was quickly rejected on October 4, 1972, with the most brutal rejection letter Ben Shneiderman has ever received.
But then they submitted it to the unrefereed ACM SIGPLAN, where it was published in August 1973, and since then it has been cited many times, widely implemented by many tools, and used for educational and documentation purposes. It's a great example of the importance of persistence for people whose new ideas are brutally rejected by respected authorities:
Flowchart techniques for structured programming:
https://dl.acm.org/doi/10.1145/953349.953350
Scan of the brutal referee's report:
https://www.cs.umd.edu/hcil/members/bshneiderman/nsd/rejecti...
>My first thought was to write a referees report which would by its sarcastic nature be funny. For example, I thought of writing that it was a sound, useful theory, but it wasn't practical because it would be difficult to design flowcharting templates to be manufactured and sold.
>I guess, however, that it is best to come right out and say that I feel the best thing the authors could do is collect all copies of this technical report and burn them, before anybody reads them. My opinion is that it shows the inexperience and ignorance of the authors with respect to programming in general, and their misunderstanding of so-called structured programming.
>To say that [BEGIN body END] should be written as [NS diagram] is ridiculous. Even more ridiculous is having to write [DO i=1 TO N; DO J=1 TO N; S = 0; DO K=1 TO N; S=S+A(I,K)*B(K,J) END C(I,J)=S END END] as [NS diagram].
>The authors mention that "the ease with which a structured flow-chart can be translated into a structured program is pleasantly surprising". My retort is "yes, just erase those silly boxes!"
>Flowcharts are a crutch we have invented to try to understand programs written in a confusing style. This was due to our ignorance of the programming process and what was needed -- after all, programming is only 20-30 years old. So-called "structured programming" helps to limit us to, as Dijkstra calls them, "intellectually manageable" programs, in which case flowcharts are completely useless and in fact a hindrance to programming. They shouldn't be used.
>I shudder at the thought of further explorations revolving around the context-free nature of this [flowchart] language.
Ben's rejection letter story:
https://www.cs.umd.edu/hcil/members/bshneiderman/nsd/rejecti...
>Rejection letter from the Communications of the ACM
>Ben Shneiderman, June 12, 2003
>Our submission of the structured flowcharts to the Communications of the ACM was quickly rejected, on October 4, 1972, by the Programming Languages Editor David Gries of Cornell University. He included a single anonymous reference letter which is on paper that has a Cornell University watermark. I assume Gries gave our paper to one of his colleagues (you can play the guessing game too), who wrote the most brutal rejection letter I have ever gotten.
>The reviewer wrote: "I feel that the best thing the authors could do is collect all copies of this technical report and burn them, before anybody reads them." As graduate students, this stinging rejection shocked us, but we kept getting enthusiastic responses from people around us. We sent the paper to the unrefereed ACM SIGPLAN Notices, where it was published in August 1973. It didn't take long for others to produce extensions, software tools, and applications of structured flowcharts.
>The next problem was theft of the idea. I had sent a draft to respected colleagues, and soon others published slight variations. One of these respected colleagues was Ned Chapin, who greatly troubled us by publishing what he called 'Chapin Charts.' A friend of mine sent me his published paper with a note encouraging me to sue. For several years I feared that Chapin's reputation and his frequent professional seminars would wind up leaving the idea tied to his name, but as the decades passed, the ending has proved to be a happy one. We called the idea 'structured flowcharts, but they are widely known as Nassi-Shneiderman Diagrams.
>Another problem was the appearances of patents for variations on our idea, but these have not limited the widespread recognition we have gotten over the years.
>I wish every graduate student or young inventor would have the pleasure of seeing his/her ideas spread so far and influence the work of so many people. I also hope that the story of the bold rejection of our novel idea and its eventual international success, is an inspiration for anyone whose new ideas are rejected by some respected authorities.
More on Ben Shneiderman and NS diagrams:
https://news.ycombinator.com/item?id=11368430
[1a. If] Note This is the first time we see synchronous calls, decisioning, and the representation makes no specific callout to the structure. The structure IS the case.
[4. Break] InconsistencyConfusion This is the first time we see a specific part of the flow called out as the structure (it isn't a structure). This is flow control, not a construct. This confusion plagues the rest of the document.
[7. Switch (No Fall-Through)] InconsistencyConfusion This is the same as If/elseif.../else/, but the post goes with the oddly specific "switch". Would be more appropriate as [1c. if/elseif.../else] and a [1d. Switch] - The different terminology if/switch does not change the fact they are the same structure. Grouping Switch-type by name is a bad choice.
[9. Local Goto] Omission The Goto example has no exit node.
[11. Exceptions] Mistake The exception travels the stack, meaning (from the perspective of the original parent function), from grandchild to the child, to the parent catch.
[12. Finally] OmissionConfusion Finally should be it's own block, since it is treated as such and has an implicit catch mechanism, even if it's not always required in the syntax.
[13. Blocking, Synchronous Calls] Confusion This is rather pointless. All the flows, prior, were blocking. Now introducing another metaphor that changes past examples is inconsistent. Blocks which are synchronous (blocking) are represented by 2 different forms. It's unnecessary.
[14a. Non-Blocking, Asynchronous Call, Callback] InconsistencyConfusion There is a whole function called, which should be represented by a starting and ending node.
[14b. Device Input] InconsistencyConfusion This isn't even a different construct. Event handling is what this is and is poorly represented, in the same way as 14a.
[15. Framework] MistakeConfusion This isn't a construct, nor is it an accurate representation. Frameworks are a collection of idioms, which usually has little to do with constructs (as defined in the beginning). It feels like the author has gone off the rails here.
[18 Come-from & 19 Aspects & 21 Destructor] Confusion? The size of the block is supposed to indicate a specific syntax, which is inappropriate for describing logical constructs. They should be full sized and optionally labeled blocks, as they are evaluated.
[20 Dependency Injection] Confusion This is another "timing adds a new way to represent things" issue. There's no difference between an Aspect and DI, logically.
[22. Defer] *Confusion Adding data (even a function) to a separate stack, which is called later, does not make the diagram presented.
All in all, this needs work. Even the grouping description at the bottom does nothing to help make this more useful.