DahliaOS operating system, combining the best of GNU/Linux and Fuchsia OS
github.com
github.com
Is there any OSDEV work that goes towards a more integrated, component-based architecture? As sad as it seems, Unix tools & pipes seems to be the most successful and enduring attempt in that direction. Systems doing that on a language basis seem mostly dead (Lisps, Smalltalks, Oberons), component architecture isn't doing much (OpenDoc as the prime example, CORBA/COM to a minor degree).
I don't think we'll be breaking much new ground when it just comes down to more efficient runtimes, packaging and ways to launch the same old ultra-tightly focused applications.
COM has been the underlying driving technology of Windows since Vista, where the Windows team took the Longhorn .NET ideas and redid them with COM, since then we got COM improved as WinRT/UWP. Which despite the common mix with the store (blame marketing teams), is what to this day most Windows 10 APIs make use of, and now even React Native for Windows is built on top of.
On Apple side, we have XPC being increasingly used, while Android uses a mix Binder and Activities, also the same IPC mechanism powering Treble based drivers.
XFCE, GNOME and KDE make heavy use of DBUS.
Then I laugh of joy with hype around gRPC, as everyone is just rediscovering CORBA.
Lisps, Smalltalks, Oberons ideas can be replicated on top of those component stacks, which is what Powershell actually does to certain extent on Windows.
The tools are there, learn to use them Luke.
COM and OLE, which is based on COM, have been a core part of the Windows shell since at least Windows 95/NT 4.0/IE 4.
You can see this in the registry where shell extensions are simply registered OLE Components, using OLE Activation to to register themselves as toolbars, folder views, context menus and additional commands in context menus.
If you are referring to drivers or core OS concepts at a lower level, you may be right, but DirectX and class drivers were already using COM in places before Vista.
COM is a standard vtable implementing a single core interface, called IUnknown which provides a method of reference counting as well as a way to look up implementaions of specific other interfaces from a given pointer. These interfaces dervive from that base, so they can always be cast as IUnknown.
The rest builds on this base.
source: Inside OLE and Inside Windows 95
https://books.google.com/books/about/Inside_OLE.html?id=adpw...
https://www.bookdepository.com/Inside-Windows-95-Deluxe-Edit...
Edit: saw the reply below, the specific Longhorn components only expanded the scope of what is extensible to include searchable/virtual/indexed filesystem extensions and few other places, based on the innovative concepts in Longhorn. My reading of your comment originally was that Vista was a departure from what came before, though it appears that it may have been intended to say it was more of a return to the simpler COM.
For you to get where I am coming from, for me Longhorn only failed due to the usual set of politics between DevDiv and WinDev that those of us on Windows know so well throughout the years.
Had they actually worked together and Longhorn, with .NET based stack would have happened, just like it did with Android and ChromeOS. When technical limitations exist, they can be sorted out when everyone rows into the same direction.
So after its failure, and reboot as Vista, the Windows team took many of the Longhorn ideas and redid them as COM libraries.
This decision started a trend (hence my started with Vista), where all major new APIs that were added to Windows since then, were COM based instead of classical Win32.
You can see this by following the C++ Hilo tutorial later released for Windows 7.
When Windows 8 came to be, they decided to double down on this direction and came up with WinRT, which if you read the Ext-VOS paper, looks quite similar. Ext-VOS being what was being designed as successor to VB/C++/J++ as COM evolution, before all the events that made .NET happen.
So you got the Windows team creating WinRT, they also had their own shot at what .NET should be, hence why it uses AOT based compilation with a compiler that only supports the MSIL sets that they cared about.
As we all know by now, due to several reasons this did not turn out as expected, still UWP (as COM evolution is now know) is still the way to go to all major APIs, even in the context of Project Reunion.
So we changed from Win32 + some relevant projects using COM, to Win32 mostly frozen in Windows XP API level + everything else is COM/UWP based.
This was my point about Vista being the turning point where this took place.
I might be wrong, but this is how I see the evolution of those events.
That's the, excuse my Huttese, friggin' point. We had versions of those tools for ages. And once we even had high hopes of using them outside of a dev's context -- the aforementioned OpenDoc for example, but even early Linux DE's seemed to have some intentions of going that route. I remember using the GNOME CORBA implementation because I needed something that would compile with a proprietary workstation C compiler (no C++).
And it's not even hard to see why we're not doing it -- money and bikeshedding. We're selling apps. Heck, we've gone a step beyond that and don't even do that anymore, we're selling services now. There are two environments where you could go beyond that -- made for hire enterprise software and open source (I've given up on academia, especially after the bachelor-splosion). But that's where the second part comes in play -- most enterprises have given up on trying to come up with some overarching architecture, things are moving too fast and there are too many managers.
Whereas there are too few in open source. Never mind that a lot of open source these days is just commercial turds, github profiling and heavily influenced by what you're doing in your day job.
Conway's Law is really screwing us over.
Yes, we have all the tools to e.g. create a desktop where you could have your favorite editor widget in all contexts, where interoperation isn't just dropping stuff into UTF-8 files, to be massaged by scripts and other applications.
I doubt that it will get better. There's a whole generation starting to fill the FAANG bullpens that never saw anything beyond the cordoned appscapes of their indistinguishable mobile devices. Maybe someone will notice that "hey, I'm using this insanely clever federated way of connecting my microservices with <rpc-du-jour>, what if...". Probably will end up on something like the suckless/unixpr*n pages and go a few steps too far, banging ASCII rocks together to summon the holy gopher.
"Windows team took the Longhorn .NET ideas and redid them with COM"
Nowhere did I wrote that Vista introduced COM.
Only for IPC. There is no IPC within a typical glib app.
GObject keeps working flawlessly, but it is too arcane to newcomers (which are already few because of C itself becoming an arcane art these days)
So anyone serious about OS development should know it, regardless of their opinion towards the language.
As for GObject, there are bindings for almost any relevant language.
Can share horror stories of expensive hires with MSc/PhD degrees, and years of experience having a fright of their lifetime when they see real world C.
Azure Sphere, Microsoft's paragon of IoT security, only allows for C.
Those expensive MSc/PhD should just complain to their universities for not providing a proper systems programming classes.
For many places, there are clearly no alternative to C.
The humongous open codebase of high quality C code, exceeding every other language, is also not going anywhere.
The situation is, shortly speaking, "no alternative to doing it in C, but we cannot do it in C because of some purely non-technical constraint." And the situation is very common I feel.
Chipmakers with billions of cash free to throw on RnD can't make any passable Linux kernel work. Google Chrome team must be employing best C++ hackers on the market, and yet.... and the story goes on like this.
The relative overabundance of webdev/java people hides the the fact that we are not only not gaining developers in conventional programming, but losing them fast to age, career change, or them returning back to home countries in case of labour migrants.
Likewise those Webdevs might just brush up their skills for WebAssembly.
At the end of the day it doesn't matter if one is using D, Rust, Swift, Java, C#, Rust, C++, Zig, FreePascal, CUDA, Open... instead of C.
The system programming concepts are the same, and it all boils down to education.
As for lousy candidates, I get them in any language.
When it come to CS fundamentals, algorithmics, most were better than me, who never studied CS academically. This was the reason we ever took interest in them.
It's just you cannot compensate for training, and experience with overall feel of skill. You can hire an ACM olympian, and the guy will still loose it unless he did C professionally for 3-4 years.
Someone lousy in low level coding won't go through such a curriculum,
https://www.di.fct.unl.pt/en/education/integrated-master-com...
Again, a matter of teaching quality.
Basic C can be picked up in very short time. there is nothing to be frightened about. When I first laid my hands on C I wrote working software (keyboard driver for DOS) in a first day as a learning exercise. Not sure what other than incompetence as a programmers is causing your expensive PhDs "fright of their lifetime".
Memory management, handwritten loops, pointers everywhere, absence of ready made data structures, error handling (or its absence,) epopeia with C strings, sanitizing inputs, and nausea from the slightest smell of SIMD, or basic binary hackery to begin with.
C was amazing when it was introduced, but is as archaic as COBOL today. We are stuck with it because of legacy.
Amazing was what Burroughs was doing in 1961, 10 years before C came to be, IBM RISC research in PL/S and PL.8, VAX/VMS stuff in BLISS, Solo OS in Concurrent Pascal, Xerox XDE in Mesa, ....
Those were amazing in the 60's and mid-70's.
It was not amazing. It was decent particular tool for particular job. That was all about it. Same thing about Rust. There are no silver bullets laying around.
It might be C++ instead of C for some of the above, but that doesn't make C "a legacy tool".
I’m saying it’s a legacy tool from the early 70’s that is absolutely terrible compared to what we could have.
Cool kids use it because there is no alternative.
Except for anything to do with the UI, although admittedly, the details of this is usually hidden within the relevant libraries.
I keep looking for a good excuse to learn Vala. Maybe this is it.
It's possible to implement GObject subclasses in Rust which little additional overhead as compared to doing it in C, but you get the syntactical niceties of for each loops, traits, and other features of Rust.
librsvg makes good use of these bindings, and is undergoing a rewrite in Rust. Gstreamer bindings are also becoming more complete, and example implementations of many of the standard plugins have been rewritten. The official implementation is still in C though.
Vala is a neat concept though and a pretty clean language.
https://people.gnome.org/~federico/blog/librsvg-gobject-in-r...
And is losing support for older CPU architectures as a result.
I really hope we don't see this more before the rust compiler is improved to support older architectures, as otherwise it may become prohibitively difficult to revive older systems...
The Vala compiler complains about my code. The Rust one tears it to shreds.
I understand Rust's constructive criticism is coming from a good place, but it's still very harsh ;-)
Example: if one tool outputs JSON, another tool, like grep, would recognize that is a subtype TEXT, and be able to process it.
Example: a more sophisticated hypothetical grep tool, would recognize that it might grep JSON differently than it greps TEXT.
Example: Tool 1 exporting JPEG might be incompatible with Tool 2 that only accepts JSON. A nice shell error message could result.
If "unix" is considered a success, I'm giving up on coding. What's the point? People will just gravitate towards brand loyalty regardless of the technical underpinnings.
When will it implement plan9's bind?
https://github.com/dahlia-os/system-recovery/commit/49336659...
Have FUN!
Also even then, you'll probably find people doing mistakes, committing hacks, etc all the time. It's like complaining that the initial Linux release doesn't support x86... Linus didn't write it for x86 originally.
> a modern, secure, lightweight and responsive operating system, combining the best of GNU/Linux and Fuchsia OS
The initial announcement and first couple years of development of linux had no logo or website or anything. Let's compare:
> a (free) operating system (just a hobby, won't be big and professional like gnu) for 386(486) AT clones
I usually just move on without comment ... but I'm kinda annoyed by the trend of the "npm generation" to have all this slick marketing bluster for experimental "just for learning" projects. Go ahead and compare to https://gcc.gnu.org/ - much less slick, much less marketing bluster, much more important project.
This dahliaOS has apparently recently joined the Open Invention Network "joining the likes of Google, IBM, SpaceX, Huawei, Microsoft, Yamaha, Honda, System76, GNOME, Daimler" and is accepting donations. Meanwhile, the founder says:
> A lot of my stuff is learning about kernel development and is mostly what I do. I do a lot with porting devices to fuchsia, and tinkering with the zircon kernel. Thats mostly it.
If there was just a repo and the readme just said that, I don't think there would be any skepticism and criticism here, just some interest and encouragement. But with all this slick marketing, skepticism and criticism is a healthy balance.
I don't know your project in particular so I don't know if this is what you are doing, but I agree with ploxiln in that it is a general trend nowadays.
I'm not sure it's not. And that's kinda sad...
I think it's a really interesting project but it's not an honest presentation (not in an exceptional way, it seems to be an existing trend in startup culture so it's understandable that people replicate it).
What the hell is this nonsense?
Linus was working on a terminal program for his 386 with native x86 task switching and that's the origin story of Linux. It's clearly recorded on the wikipedia page for the kernel, and he speaks to this in Just For Fun IIRC.
My general point still stands though. His initial Linux announcement E-Mail has this line:
> It is NOT portable (uses 386 task switching etc), and it probably never will support anything other than AT-harddisks, as that's all I have :-(.
So it wasn't very portable at the start. If you complained about it not being portable to different arches (idk which one was available at that time? SPARC? MIPS?), it would have been unfair. Everyone has to start somewhere.
Like it or not, people like this kid run the world.
Generally the advice I hear from more experienced people is to under promise and over deliver.
Besides, the comment you're replying on isn't really bashing them.
He was 21.
Instead of aiming the moon today, I may suggest to focus on only one thing and do it very well now.
My suggestion is to target mobile / desktop (convergent) linux. The story today is not good, and you seems to have achieved some interesting things with your UI shell that may take years to achieve with the usual linux technologies: Gnome or KDE.
You may even be able to quickly make a business by selling pre-flashed linux devices like raspberry pis, pinephones, pinebooks... with your beautiful and easy to use UI.
Why does a new open source OS project have to always shoehorn the entire GNU/Linux ecosystem with X11/Wayland, GTK, DBus and GNOME onto a totally different system?
The only positive takeaway from this is perhaps the learning experience in OS development. Other than that is there a point to this?
However the power of free beer....
For Dahlia specifically, it looks to ship a Linux kernel out of the box to extend its hardware compatibility. Relevant section below:
> Our dual kernel approach allows users with new(er) hardware to take advantage of the Zircon Kernel, while maintaining support for older devices using the Linux Kernel.
[0] https://9to5google.com/2018/06/15/fuchsia-friday-machina-bri...
This has the power to accelerate flutter desktop development in general. Really excited for both these projects.
I can't speak to the qualities of the os, but hopefully this won't be the entire a11y experience both on the website and on the os itself if both use flutter.
I see two instances of "Uncaught Error: undefined" in the JS console. Strangely, in a different session I instead see "NoSuchMethodError: J.aH(...) is null" and the empty page has a gray background instead of white. I get similar results in both Firefox 81 and Safari 14 on macOS 10.15. Let me know if you want more info.
On Firefox, its struggling to keep this page alive such that the browser controls are locking everything up. I don't think its quite ready yet if browsers can't keep up with correctly rendering websites using Flutter.
Thanks!
So in a browser/web context, all you need (roughly) is a canvas, and to compile the relevant Dart to JS and you're off to the races.
I can see canvas rendering as a good target for games and for individual components such as a drawing surface or a chart but using it for a whole app is just throwing out the baby with the bathwater.
It seems like it renders text via a SVG on top of a canvas layer that is the background, so that's a plus for a11y. As for the downsides, and I'm not sure how much this is due to flutter or the app itself:
* I can't use the browser search for elements outside the viewport
* I can't select text at all
* I can't tab through elements/links at all (which is often seen as a strong indicator of bad a11y)
* Browser back/forward do not work as expected (back exits the app completely, and then forward does not bring me back)
The second demo there: https://gallery.flutter.dev/#/shrine
* All the same as the first one, but also clickable elements do not give me any feedback that they are clickable (hand-pointer cursour or any underline/similar effect)
---
Maybe these are just demos that have not thought of these specific things but since it is a web showcase of a framework meant to work on the web (although not exclusively) and these were the first links up there it's a bit disappointing.
My point is that you get most of these things for free (or easy) on the normal web, but flutter seems to try to patch them back onto it instead of using what is there.
https://github.com/flutter/flutter/issues?q=is%3Aopen+is%3Ai...
The framework seems designed to hold the hand of android developers, not to provide a decent experience to the end user. I have no clue why people keep referencing it as some kind of working cross-platform solution when it clearly caters exclusively to android.
https://fuchsia.googlesource.com/fuchsia/+/refs/heads/master...
The core benefits of fuchsia are the kernel architecture and the security model it allows. If you're using linux for the kernel you have inherently done away with the primary advantage of fuchsia.
I looked briefly at the homepage but the actual architecture was not obvious even though their webpage was "pretty".
Can someone explain what it is they've done in a nice easy TLDR form?
"dahliaOS provides a fast and stable experience on nearly every computer, from a 2004 desktop tower to the latest generation of mobile notebooks. Our dual kernel approach allows users with new(er) hardware to take advantage of the Zircon Kernel, while maintaining support for older devices using the Linux Kernel."
Is the compatibility just broken because it’s not running a standard X (server/Wayland) or is it deeper ?
Anyone else?
But I don't see how that is relevant here because this thing is based on Linux and X11.