Hacker News Reader

Comment by diggan | Hacker News Reader

A short while ago (eh, just noticed this was over a year ago...) I did a comparison between different testing solutions for all projects within the IPFS organization. Remember this was a year ago, so many things have changed but we ended up going with Jenkins and I'm now migrating projects from free usage of Travis/CircleCI to Jenkins.

- Brief explanation: https://github.com/ipfs/infrastructure/issues/100#issuecomme...

- Spreadsheet comparing features: https://docs.google.com/spreadsheets/d/11kTloM6d1CGu_ycmP3Xz...

Check out those links and you should get a good overview

View on HN

"Haven't really found any good way of integrating the Gitlab-CI with Github"

Sounds like that is solved.

Very Nice!

I did something similar but only for hosted solutions

http://blog.codepipes.com/hosted-ci-comparison/hosted-ci-com...

I am preparing another blog post for on-premise (GoCD, Jenkins, Concourse etc.)

Nice summary. Did you test support for handling multiple changes to a single project in parallel? The only CI Platform I've found that tries to handle this in any meaningful way is OpenStack Zuul (https://zuul-ci.org/) and https://docs.openstack.org/infra/zuul/user/gating.html#testi... for details of the parallel support.

Do others have this need? Or are people generally focusing on keeping CI runs short and landing changes in a serial fashion?

No, this was not a consideration, as we often have so many PRs open at one time, that this is probably not feasible. If I understand the process correctly, it would merge each PR in order from the first made until the most recent one. So the most recent one includes all the proposed changes. For ipfs/go-ipfs, that would involve doing 104 tests + builds for each PR.

Rather, we test each branch as it was merged into master (in isolation), and when master changes, trigger builds for PRs that now are changed.

The "Cross Project Testing" and "Cross-Project Dependencies" is something we're deeply in need of though, and already do somewhat. The dependencies are implicit now though (via npm or our golang package manager, gx) rather than explicit.

If anyone have ideas for "cross project testing with dependencies" on Jenkins, I would be very happy to hear them.

Reply on news.ycombinator.com