If you could checkpoint a GPU quickly enough it would be possible to run multiple isolated workloads on the same GPUs without any issues.
172 karma · joined April 28, 2020
If you could checkpoint a GPU quickly enough it would be possible to run multiple isolated workloads on the same GPUs without any issues.
Founder of Loophole Labs here!
The team and I are happy to answer any questions you might have about fRPC, Frisbee, or Loophole in general!
We wrote fRPC because we really liked the DevX and tooling around the proto3 syntax, but we needed the generated code to be significantly more performant than what gRPC provides.
We also needed the ability to extend the RPC framework with other messaging patterns (like pub/sub) and we needed to be able to reuse the underlying TCP connections as required.
Today, fRPC can outperform gRPC by more than 4x, doing more than 2 million RPCs/second on a single node.
You can check out our docs site at https://frpc.io, or check out the repo at https://github.com/loopholelabs/frpc-go
Author of this library here, I'm happy to answer any questions about this.
I'll make those changes as soon as possible.
Please email us at lynk@loopholelabs.io
I've written an analysis of Lynk's performance vs. Ngrok here: https://medium.com/@shivanshvij/building-a-better-ngrok-dbc1... and our documentation stating "SHA-256 Encryption" has been since removed as a mistake.
The client side will absolutely be open sourced probably by the end of next week once I've cleaned up some spaghetti code.
1. We'll be open sourcing our client in the coming weeks so you can check out our code yourselves.
2. We will be offering a self-hosted version which will decouple you entirely from our infrastructure and you can provide you own SSL certificates.
3. Lynk can forward traffic to your encrypted services - which of course would mean losing out on compression benefits, but Lynk is designed primarily for quick development work like testing out a Stripe or Github webhook on your local machine, or demoing your webapp to a remote client. For production use we recommend a reverse proxy or self-hosting Lynk.
The client compresses responses from your local services before they're encrypted and sent to the Lynk infrastructure. This application is designed primarily for development work and takes the hassle out of setting up a reverse proxy or dealing with port-forwarding.
If your local application provides its own encryption (ie, it's running over HTTPS), then your traffic won't be exposed to Lynk. In this scenario, you're right - there would be very little compression gain.
However, to be clear, this is intended primarily for local development use, for traffic that isn't necessarily sensitive.
We're excited to announce that the Lynk Beta is now live!
We've been hard at work building out Lynk's tunnelling protocols to make them faster, more stable, and all around better. We're happy to announce that vs. Ngrok our tunnels perform up to 6 times faster (source: https://medium.com/@shivanshvij/building-a-better-ngrok-dbc1...) and support technologies such as HTTP/2 (with HTTP1 fallback) and Websockets.
Check out our open beta and documentation here: https://lynk.sh
Our docs are being overhauled this week and will include examples on hosting common apps, troubleshooting common issues, and using the various features in lynk like HTTP authentication.
You can check them out here at https://lynk.sh