One major issue that I faced was authentication while pushing to AWS ECR. Since, I'm using OIDC token in gitlab, not sure if it's supported by buildkit rootless.
I am facing the same issue. i have setup minio for this but not sure how to use the bucket cache without modifying my docker file. I have cargo install with --target-dir. i want to cache deps
I get weird errors when I have a FSx volume mounted on /var/lib/buildkit:
error: failed to solve: process "/bin/sh -c apt update && apt-get upgrade -y && apt install -y build-essential" did not complete successfully: invalid argument
And I wish you could specify a location for local caches to be stored on the agent.. I'm going to try mounting only over /var/lib/buildkit/runc_overlays or runc_overlays/snapshots and runc_overlays/cachemounts
One major issue that I faced was authentication while pushing to AWS ECR. Since, I'm using OIDC token in gitlab, not sure if it's supported by buildkit rootless.
It's supported. Buildkit uses the same Moby login backend that regular docker does. If you can do a docker login, it's fine.
You need to register gitlab oidc as a provider in AWS, but it will work.
https://aws.amazon.com/blogs/apn/setting-up-openid-connect-with-gitlab-ci-cd-to-provide-secure-access-to-environments-in-aws-accounts/
Yes, but the OIDC authentication method worked with kaniko but isn't working with buildkit rootles. It's not natively supported.
Here's an open issue: https://github.com/moby/buildkit/issues/3947
I am facing the same issue. i have setup minio for this but not sure how to use the bucket cache without modifying my docker file. I have cargo install with --target-dir. i want to cache deps
Hi Usha!
Rust builds are very hard to cache in Docker builds.
The creators of Depot have actually written about this better than I can!
https://depot.dev/blog/rust-dockerfile-best-practices
Did you end up getting an EFS mount to work?
I'd like to do the same but am running into issues
I did not ever end up trying it. What kind of errors?
I get weird errors when I have a FSx volume mounted on /var/lib/buildkit:
error: failed to solve: process "/bin/sh -c apt update && apt-get upgrade -y && apt install -y build-essential" did not complete successfully: invalid argument
And I wish you could specify a location for local caches to be stored on the agent.. I'm going to try mounting only over /var/lib/buildkit/runc_overlays or runc_overlays/snapshots and runc_overlays/cachemounts