Data viz experiments with Svelte and Three.js
69 karma · joined October 9, 2019
This includes a correlation matrix with rolling correlation charts, a minimap, hierarchical clustering, time series detrending, and more. I've improved its design and performance and I'm developing new features to better contextualize the visible subsection relative to the entire dataset.
I've also rewritten the entire project in Svelte 5 (there's still a lot of cleanup to do).
It has hierarchical clustering, rolling correlation charts, a minimap, time series data detrending, and 2D matrix virtualization (to render only visible cells to the DOM).
It has up to 130K matrix cells and correlates up to 23.5M time series data points.
If you find a viable alternative to Svelte and React, please let me know.
One thing that also came to mind regarding Svelte 5 is that I always use untrack() for $effect() and declare dependencies explicitly, otherwise Svelte 5 becomes too magical for me.
I just loved the simplicity of using $: for deriveds and effects in Svelte 3 and 4. But after building a correlation matrix [1] and a work project with Svelte 5, I have to say that I really like it.
Will check out Nue and Datastar.
It includes rolling correlation charts, hierarchical clustering, and a terminal-style interface with high data density. It uses a 2D windowing/virtualization approach to render only visible matrix cells to the DOM. It's early WIP. The landing page is particularly bad.
I think what Nietzsche is doing beyond popularizing the concept is establishing its strange relationship to nihilism ("Das ist die extremste Form des Nihilismus: das Nichts (das „Sinnlose“) ewig!"[0]) and its life-enhancing qualities: It is life-enhancing because it is impossible to live with it. This may sound strange, but this is the essence of Nietzsche's "pessimism of strength" concept.
[0] NF-1886,5[71]
Thank you, that means a lot coming from someone with your experience.
Based on the feedback, the demo has a high priority for us, so we should have something in the next few days.
We had named the custom authentication header 'X-Time-Door-Token' at first and then switched it to 'X-Time-Door-Key' :)
The name Time Door also has a cool pop-cultural reference, which can be found on our 404 page.
Thanks for your feedback, very helpful. Interactive demo is on the road map. I have just added a tutorial on how to use our API with fast data streams (very early work in progress): https://timedoor.xyz/tutorials/fast-data-streams
All endpoints in the documentation provide request and response examples. So currently you could create an API key, copy an example request and use a REST client like Insomnia or Postman to play around with our API (which obviously is not ideal).
I will factor your feedback into our prioritization for the next features.
We (a close friend and me) built this over the past 9 weeks in our free time. I want to say thanks to my friend for all the productive nights we spent together.
I have often experienced that I have time series data generating processes as part of a project and then have to set up project-specific time series analysis infrastructure. While I was working on another project where this was the case, I had the idea for Time Door.
We are currently working on responding to all the mails. Thanks to everyone who reached out and/or created a Time Door account.
Quote 1:
We can thus guess where the great note of interrogation concerning the value of existence had been set. Is pessimism necessarily the sign of decline, of decay, of failure, of exhausted and weakened instincts?—as was the case with the Indians, as is, to all appearance, the case with us "modern" men and Europeans? Is there a pessimism of strength? An intellectual predilection for what is hard, awful, evil, problematical in existence, owing to well-being, to exuberant health, to fullness of existence? Is there perhaps suffering in overfullness itself? A seductive fortitude with the keenest of glances, which yearns for the terrible, as for the enemy, the worthy enemy, with whom it may try its strength? from whom it is willing to learn what "fear" is?[0]
Gibt es einen Pessimismus der Stärke? Eine intellektuelle Vorneigung für das Harte, Schauerliche, Böse, Problematische des Daseins aus Wohlsein, aus überströmender Gesundheit, aus Fülle des Daseins? Gibt es vielleicht ein Leiden an der Überfülle selbst? Eine versucherische Tapferkeit des schärfsten Blicks, die nach dem Furchtbaren verlangt, als nach dem Feinde, dem würdigen Feinde, an dem sie ihre Kraft erproben kann? an dem sie lernen will, was »das Fürchten« ist?[1]
Quote 2:
A fundamental question is the relation of the Greek to pain, his degree of sensibility,—did this relation remain constant? or did it veer about?—the question, whether his ever-increasing longing for beauty, for festivals, gaieties, new cults, did really grow out of want, privation, melancholy, pain? For suppose even this to be true—and Pericles (or Thucydides) intimates as much in the great Funeral Speech:—whence then the opposite longing, which appeared first in the order of time, the longing for the ugly, the good, resolute desire of the Old Hellene for pessimism, for tragic myth, for the picture of all that is terrible, evil, enigmatical, destructive, fatal at the basis of existence,—whence then must tragedy have sprung? Perhaps from joy, from strength, from exuberant health, from over-fullness.[0]
Eine Grundfrage ist das Verhältnis des Griechen zum Schmerz, sein Grad von Sensibilität, – blieb dies Verhältnis sich gleich? oder drehte es sich um? – jene Frage, ob wirklich sein immer stärkeres Verlangen nach Schönheit, nach Festen, Lustbarkeiten, neuen Kulten aus Mangel, aus Entbehrung, aus Melancholie, aus Schmerz erwachsen ist? Gesetzt nämlich, gerade dies wäre wahr – und Perikles (oder Thukydides) gibt es uns in der großen Leichenrede zu verstehen –: woher müßte dann das entgegengesetzte Verlangen, das der Zeit nach früher hervortrat, stammen, das Verlangen nach dem Häßlichen, der gute strenge Wille des älteren Hellenen zum Pessimismus, zum tragischen Mythus, zum Bilde alles Furchtbaren, Bösen, Rätselhaften, Vernichtenden, Verhängnisvollen auf dem Grunde des Daseins, – woher müßte dann die Tragödie stammen? Vielleicht aus der Lust, aus der Kraft, aus überströmender Gesundheit, aus übergroßer Fülle?[1]
[0] https://www.gutenberg.org/files/51356/51356-h/51356-h.htm [1] http://www.zeno.org/Philosophie/M/Nietzsche,+Friedrich/Die+G...