The Fastest VM Bytecode Interpreter
byteworm.com
byteworm.com
gcc simvm.c
time ./a.out
857419840
real 0m0.374s
user 0m0.359s
sys 0m0.003s
gcc -O3 simvm.c -o fast.out
time ./fast.out
857419840
real 0m0.006s
user 0m0.001s
sys 0m0.003s
/me goes to comment on the blog.
edit: bah! Foiled!
>Hmmm, your comment seems a bit spammy. We're not real big on spam around here.
Please go back and try again.
edit2: holy cow, that spam filter hates me. I can't get anything to post...
I do still side with the optimization though, in that the .NET-VM could do this as well. The loop is pretty simple, and can be optimized away. Why shouldn't it?
The author of the article updated his post for -O3 by using a volatile variable for the for-loop test, which makes the compiler not optimize away the loop.
For .NET you can look at the generated assembly, and if it does optimize away the loop you can use the same trick.
No reasons for guessing. We are software engineers after all.
(I wonder, did the people who upvoted you actually read the article?)
real 0m2.209s
user 0m2.191s
sys 0m0.006s
real 0m0.020s
user 0m0.001s
sys 0m0.003s
Where's the printf(answer)? For comparison, here's the `gcc -S simvm.c` output: https://gist.github.com/710269
For an actual benchmark of various bytecode interpretation schemes see:
http://www.complang.tuwien.ac.at/forth/threading/
These micro benchmarks also take some care to attempt realistic branch prediction rates.
Running these on current hardware, switch based interpreters still perform quite well. Direct threading gets you slightly more performance. I'd say that sticking to ANSI c and just using switch is a good plan. If you need more performance then you likely should go ahead and implement a native JIT of some sort or use JVM/.NET.
This phrase, what does this mean anymore? Do these things exist in the form of real, non-toy software anymore? What's the difference between compiling to an AST, byte code, or LLVM intermediate? I think these words have more to do with cultural expectations than with VM/compiler technology.
(Although it's true that CPython is one of the few extant members of a dying breed.)
The connotations of "compiled" and "interpreted" might have plenty to do with vague expectations, but the words still mean something in the context of language implementation: even though it is reasonable to call the situations you list "compilation", it would not be accurate to call a language that was compiled to LLVM IR, then interpreted with lli, "compiled".
Yeah, it pre-allocates lots of common data-structures, and reuses old ones rather than using new ones if possible, and I think it might do some stuff with iterators ... but it's nothing like PyPy or a modern JVM.
Why not? I wouldn't see that as being too different from compiling a Java application and running it on "a modern JVM." With most examples of that I've seen, I think I could fairly characterize them as being "compiled."
For some reason, people think of things like MRI 1.8 as being "interpreted" and expect those things to be slow. One could just as well take the same language and run it on a tracing JIT VM. (after some considerable engineering) Semantically, the thing would still be "interpreting bytecodes," just doing it in a highly optimized way. Note that the step where the MRI reads the source and creates an AST is is fundamentally the same as parsing source code and outputting bytecode. There is nothing somehow special or sacred about an intermediate language in the form of bytecode.
Given the compiler/VM technology we have today, even the degree to which things are (or aren't) late-bound is more flexible than in the past.
While I agree that there is nothing special about bytecode, interpreting it is regarded to be faster than AST interpreters. AFAIR, I read a paper about that, too, but cannot for the love of god remember its name/authors; also my impression is that Ruby 1.9 uses a bytecode interpreter (with some optimizations, such as direct threaded code interpreter).
Actually, my understanding is that V8 automatically compiles all JS code on load, it has no interpreter. So in a sense it's "method at a time" (i.e. its methods are compiled as units, it's not a trace system) but it's not traditional, and you could make an argument that it's not even a JIT.
Other approaches, like JVM, are more accurately described as "dynamic compilation" sub-systems of the virtual machine.
At least that's my understanding of things, and I used to lump everything in that area into the "JIT" category, until (quite recently, actually) someone brought this small but important distinction to my attention. I don't see how one could make an argument not classifying V8 as a JIT compilation virtual machine, though...
Off topic, but in case you weren't aware, that "considerable engineering" exists, and is called JRuby. It works (almost) exactly as you describe. And yes, it is rather fast :-)
Since nobody mentioned it before, the primary advantages of interpreters in the field of pldi are:
- ease of implementation
- portability
This has very important implications to the field of interpreter optimizations, too, since most of them are relatively easy to implement and portable. The ease of implementation advantage when compared to an optimizing native code compiler is usually very big, the same holds true for JIT compilers as well. Portability again is a nice thing to have for optimizations--particularly when compared to the portability of JITs, which need a dedicated native code generating backend for every supported architecture.
Java interprets bytecodes, Python interprets bytecodes. Java has JIT, Python has a JIT (`import psyco`). Where is the substantial difference between these two?
If all you mean by "qualitative difference" is that they use different bytecodes, then you're not saying very much.
Even conceptually, interpreters and compilers differ in certain aspects. For me, the most striking one is that compilers do not fully emulate the results of the given program (one could argue that they do to some extent, when performing optimizations - like when gcc -O3 transforms the whole process to a single printf() call).
There are many others, but I hope you get the point.
I asked you a question regarding your previous claim. You responded with a downvote and a rhetorical counter but, again, no answer.
I'm mildly familiar with the JVM. I'm very familiar with Python's virtual machine implementation. I ask again: what is the substantial difference between the two? Rhetorical wizardry does not impress me: I actually want to know what your answer is. You said that there is a "qualitative difference" between the two and now have replied implying that it's a substantial difference. I don't understand your reticence to give a real answer here.
> Even conceptually, interpreters and compilers differ in certain aspects.
That has absolutely nothing to do with my question, and I don't see how it would substantially differentiate between the two implementations we're discussing.
The endpoints are easy. My point is that there are so many things nowadays which are really somewhat in the middle, and there's no clear line of demarcation.
Oh, I didn't see that VB was run on mono, run that code on a windows machine and I bet it will beat the -O3 optimized C
cache:url