Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable EC2 Slaves to choose an optimal placement #13

Open
dinatale2 opened this issue Aug 9, 2016 · 1 comment
Open

Enable EC2 Slaves to choose an optimal placement #13

dinatale2 opened this issue Aug 9, 2016 · 1 comment

Comments

@dinatale2
Copy link
Member

Lately, EC2 spot prices have been fluctuating quite a bit which has caused the lustre and ZFS build farms to become unstable. Currently the solution is to manually choose a new zone and restart the buildbot master. The alternate solution is to stop using spot instances.

We can potentially make EC2 slaves a bit smarter and have them get running averages of the price per zone, then try each zone that is below our max bid price. We can even have the EC2 slaves fall back to using on demand instances if our max bid price can't be met or when no suitable zone exists.

@dinatale2
Copy link
Member Author

@behlendorf had another extension to this. In an offline talk, he mentioned that the issue could also be the region we are attempting to start instances in. In our case, US-West appears to be oversubscribed compared to other regions. We could potentially allow EC2 slaves to pick which region to start in and if we want to restrict the region, we can provide a region list in the constructor.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant