Show HN: Vineyard v0.2.0: big-data applications optimization on Kubernetes
github.com
github.com
Presentation: https://www.youtube.com/watch?v=p-falphSJq8&list=PLj6h78yzYM...
Live demo: https://www.youtube.com/watch?v=vPbF1l5nwwQ&list=PLj6h78yzYM...
Features and improvements included in v0.2.0 are highlighted as follows:
+ Vineyard has been integration with Helm for easier deployment on kubernetes clusters by simply typing `helm install vineyard vineyard/vineyard`
+ Vineyard objects are now represented using CRDs on kubernetes and are observable to tools built upon kubernetes.
+ A vineyard operator has been included in release v0.2.0, where a scheduler plugin could works in a way where pods are aligned with vineyard server where its required data is placed when possible, which reduce the data migration overhead for big-data analytical pipelines a lot.
+ A malloc-like allocator enables applications to allocate memory chunks directly on vineyard's shared memory arenas, implemented using jemalloc, avoiding the cost of copy and the cost of refactoring the source code to ease the integration with vineyard.