I came across this great blog post: https://www.objectif-libre.com/en/blog/2021/02/23/a-new-era-...

Documentation: https://docs.gitlab.com/ee/ci/parent_child_pipelines.html

GitLab 13.10 also added support for parallel matrix job execution in child pipelines, speeding up the execution once more.

https://about.gitlab.com/releases/2021/03/22/gitlab-13-10-re...

There's more to dynamic pipeline creation, collecting blog post ideas in https://gitlab.com/gitlab-com/www-gitlab-com/-/issues/11122#... :)

Our shared pipeline used to create child pipelines and we wouldn't recommend them.

If all the shared pipeline jobs show up in your consumer project pipeline, you can easily extend them or overwrite them entirely.

Ya, as I understand, that's all this python ci lib is doing. I find it a little annoying that your first have to start a worker to create the pipeline file, and then again to run the pipelines steps

I feel like there was some weird edge cases I was having with child pipelines. Maybe it was something with artifacts, don’t remember.