The spec is a release candidate so we'd like to get as much feedback as possible from the community. Here is a good place to discuss it but please also send feedback to the Label Schema mailing list.
29 karma · joined April 21, 2012
The spec is a release candidate so we'd like to get as much feedback as possible from the community. Here is a good place to discuss it but please also send feedback to the Label Schema mailing list.
We've also added sign up with GitHub to make it easier to create an account. If you've got any questions or feedback on the demo we'd love to hear from you.
https://github.com/force12io/force12
The follow up releases will be for the integrations we've done with the Marathon and ECS schedulers.
We think the faster launch times of containers makes auto scaling easier compared to using VMs. So our tool will prioritise the mix of running containers based on current demand.
To do this we'll need to support multiple metrics. Some of those will be within the cluster like CPU and RAM. But some may be external like the length of a message queue or requests per second on a load balancer.
The demo tool we've released today is single node and uses the Docker Remote API. We've also built demos that integrate with the ECS and Marathon schedulers. Force12 will be platform agnostic. So we plan to integrate with more schedulers and Swarm is definitely on that list.
http://blog.force12.io/2015/10/16/microscaling-in-a-box.html
Happy to answer any questions. Also all feedback is greatly appreciated!
At the moment language choice is a blocker for me. I don't want to have to learn OCaml to play with unikernels. LING looks interesting since its based on Erlang. If I could develop on Elixir that would make a big difference.
I relocated from London to Barcelona 3 years ago to do remote freelance work. The cost of living is lower here with a good quality of life. There is lots of interesting work in London and its a good place to gain experience but I've got no plans to go back.
EB works the same way for VMs, it will integrate with EC2 for you or you can use EC2 directly instead of EB.
You've probably seen it but for Elastic Beanstalk there is now a multi container version which uses ECS under the hood. Previously there was a limitation of 1 container per VM.
http://docs.aws.amazon.com/elasticbeanstalk/latest/dg/create...
We launched http://force12.io on Friday which is a demo of container autoscaling running on ECS. I'll be doing a blog post this week on how we're using ECS.
I definitely agree that there is a place for auto scaling both VMs and containers. Auto scaling with VMs means if it takes several minutes to add a VM to the cluster you have to scale up early and scale down slowly. We think auto scaling with containers can help a lot here by smoothing out the demand. Lower priority containers can be stopped while extra VM capacity is added.
On the data side I think http://commoncrawl.org/ can help with creating vertical search engines. Their crawl is much smaller than Google or Bing but it is web scale (2 billion pages of 2013 data). Data recency is still a problem but it can help with finding which sites belong to a niche. Some smaller scale crawling of these sites would then be a much more achievable task.
I think this makes it easier to manage your own load balancers using instance storage without EBS.