502 karma · joined January 16, 2017
What is more interesting is this: They have very GPU-specific auto-tuning routine that drastically reduces the optimzation space, compared to TVM/Ansor. They go from ~10^6 possible implementations for an operator to a "few hundred", which enabled much faster time-to-solution. This is achieved with a GPU-centric problem formulation and search space. In essence, they trade how widely applicable their approach is (from "any" kind of hardware to only GPU-style architectures) for retrieval speed.
On the ride home I already had made the downpayment with the intent to pick up the bike the next day. One the best decisions I ever made!
> A family father gets premonitions about a massive storm that will come, which triggers him building a bunker in his back yard. It is a family drama on how his obsession with protecting his family slowly tears it apart. In the end they convince the father to go on vacation for a few days, just to get away from the obsession. As they arrive in their vacation home, a huge, black storm cloud rolls in on the horizon
Great Movie, recommend watching it.
> The Bailey Ball was an Alpine Center attraction developed and tested, but never opened to the public, as a result of those tests. It consisted of a large foam sphere in which a rider could be secured, and then rolled downward. The plan was to do it on a track with PVC pipe as its outer rails, and one was built alongside a ski trail.[11]: 16:25
> The designers neglected to take into account the tendency of PVC pipe to expand in heat. During the first test, with a state inspector present on a hot summer day, the ball, with a man inside testing it, went off the track as a result of the pipe expanding and bounded down the adjacent ski slope. It continued through the parking lot, across Route 94, and came to rest in a swamp. After it came to a natural stop at the bottom, the inspector left without saying anything and park management abandoned the project.[11]: 16:25 [43]
- Spend more time with my family.
- Find a way to better engage with my town and community. I grew up where I live now, but still feel a little disconnected.
- Continue reading. Started reading again, this year. Want to keep up with that.
- Join the 1000lbs club. This is the follow up to this year’s goal of a 135 overhead / 225 Bench / 315 Squat / 405 DL
- finally finish my PhD. Still waiting for my Advisor to finish his report…
- relax more, stress less about income
If anyone is interested: An accessible python module for this is python-constraint. Gecode is a powerful, modern C++ CP Framework.
Notable works:
AutoTVM - https://arxiv.org/abs/1805.08166
CHAMELEON - https://deepai.org/publication/chameleon-adaptive-code-optim...
GPU-Warp Scheduling - https://deepai.org/publication/rlws-a-reinforcement-learning...
Tensions like these might very well be the reason corporate research has declined.
Also, consider this: Imagine you look back at your life, having spent countless hours on running, and never enjoying yourself.
The percentage should be flexible, depending on the current task and phase of the project.
Currently I learn a lot about relational algebra and algebraic semirings, because they are part of the theory behind constraint programming, which I use in a current project.