Docker image build failing since PR 727

[rawnsley]

The master branch is failing to build for me with the following error:

[+] Building 10.2s (23/28)                                                                                                                                                                                                        docker:desktop-linux
 => [internal] load build definition from TurkeyDockerfile                                                                                                                                                                                        0.0s
 => => transferring dockerfile: 1.39kB                                                                                                                                                                                                            0.0s
 => resolve image config for docker-image://docker.io/docker/dockerfile:1                                                                                                                                                                         0.7s
 => [auth] docker/dockerfile:pull token for registry-1.docker.io                                                                                                                                                                                  0.0s
 => CACHED docker-image://docker.io/docker/dockerfile:1@sha256:9857836c9ee4268391bb5b09f9f157f3c91bb15821bb77969642813b0d00518d                                                                                                                   0.0s
 => => resolve docker.io/docker/dockerfile:1@sha256:9857836c9ee4268391bb5b09f9f157f3c91bb15821bb77969642813b0d00518d                                                                                                                              0.0s
 => [internal] load metadata for docker.io/library/alpine:3.21.3                                                                                                                                                                                  0.6s
 => [internal] load metadata for docker.io/hexpm/elixir:1.16.3-erlang-25.3.2.20-alpine-3.21.3                                                                                                                                                     0.7s
 => [internal] load metadata for docker.io/alpine/openssl:latest                                                                                                                                                                                  0.5s
 => [auth] alpine/openssl:pull token for registry-1.docker.io                                                                                                                                                                                     0.0s
 => [auth] library/alpine:pull token for registry-1.docker.io                                                                                                                                                                                     0.0s
 => [auth] hexpm/elixir:pull token for registry-1.docker.io                                                                                                                                                                                       0.0s
 => [internal] load .dockerignore                                                                                                                                                                                                                 0.0s
 => => transferring context: 2B                                                                                                                                                                                                                   0.0s
 => CACHED [base 1/2] FROM docker.io/hexpm/elixir:1.16.3-erlang-25.3.2.20-alpine-3.21.3@sha256:154504fb52b8a3830a27e3e9da44661d97b44e2147b39707e19b116c8610c941                                                                                   0.0s
 => => resolve docker.io/hexpm/elixir:1.16.3-erlang-25.3.2.20-alpine-3.21.3@sha256:154504fb52b8a3830a27e3e9da44661d97b44e2147b39707e19b116c8610c941                                                                                               0.0s
 => [internal] load build context                                                                                                                                                                                                                 0.4s
 => => transferring context: 1.39MB                                                                                                                                                                                                               0.4s
 => CACHED [stage-4 1/7] FROM docker.io/library/alpine:3.21.3@sha256:a8560b36e8b8210634f77d9f7f9efd7ffa463e380b75e2e74aff4511df3ef88c                                                                                                             0.0s
 => => resolve docker.io/library/alpine:3.21.3@sha256:a8560b36e8b8210634f77d9f7f9efd7ffa463e380b75e2e74aff4511df3ef88c                                                                                                                            0.0s
 => [certr 1/3] FROM docker.io/alpine/openssl:latest@sha256:d48f4277dc3b753325ee22c7614987c4d8426ce93aa3df4dbc6127fda87fabe4                                                                                                                      0.0s
 => => resolve docker.io/alpine/openssl:latest@sha256:d48f4277dc3b753325ee22c7614987c4d8426ce93aa3df4dbc6127fda87fabe4                                                                                                                            0.0s
 => [base 2/2] RUN mix do local.hex --force, local.rebar --force                                                                                                                                                                                  2.2s
 => [stage-4 2/7] RUN mkdir -p /storage && chmod 777 /storage                                                                                                                                                                                     0.2s
 => [stage-4 3/7] WORKDIR ret                                                                                                                                                                                                                     0.0s
 => CACHED [certr 2/3] WORKDIR certs                                                                                                                                                                                                              0.0s
 => CACHED [certr 3/3] RUN openssl req -x509 -newkey rsa:2048 -sha256 -days 36500 -nodes -keyout key.pem -out cert.pem -subj '/CN=ret' && cp cert.pem cacert.pem                                                                                  0.0s
 => [builder 1/4] RUN apk add --no-cache nodejs yarn git build-base                                                                                                                                                                               4.6s
 => [builder 2/4] COPY . .                                                                                                                                                                                                                        0.8s 
 => ERROR [builder 3/4] RUN mix deps.get                                                                                                                                                                                                          1.1s 
------                                                                                                                                                                                                                                                 
 > [builder 3/4] RUN mix deps.get:                                                                                                                                                                                                                     
1.083                                                                                                                                                                                                                                                  
1.083 08:10:53.990 [notice] Application ssl exited: exited in: :ssl_app.start(:normal, [])                                                                                                                                                             
1.083     ** (EXIT) an exception was raised:                                                                                                                                                                                                           
1.083         ** (MatchError) no match of right hand side value: <<206, 247, 200, 109, 35, 110, 247, 126, 67, 238, 189, 43, 63, 185, 206, 86>>                                                                                                         
1.083             (elixir 1.16.3) src/elixir_def.erl:134: :elixir_def.store_definition/3
1.083             (ssl 10.9.1.7) ssl_app.erl:53: :ssl_app.stop_logger/0
1.083             (ssl 10.9.1.7) ssl_app.erl:32: :ssl_app.start/2
1.083             (kernel 8.5.4.5) application_master.erl:293: :application_master.start_it_old/4
1.083 
1.083 08:10:54.010 [notice] Application public_key exited: :stopped
1.084 
1.084 08:10:54.010 [notice] Application asn1 exited: :stopped
1.084 
1.084 08:10:54.010 [notice] Application crypto exited: :stopped
1.085 Could not start Hex. Try fetching a new version with "mix local.hex" or uninstalling it with "mix archive.uninstall hex.ez"
1.089 ** (MatchError) no match of right hand side value: {:error, {:ssl, {:bad_return, {{:ssl_app, :start, [:normal, []]}, {:EXIT, {{:badmatch, <<206, 247, 200, 109, 35, 110, 247, 126, 67, 238, 189, 43, 63, 185, 206, 86>>}, [{:elixir_def, :store_definition, 3, [file: ~c"src/elixir_def.erl", line: 134]}, {:ssl_app, :stop_logger, 0, [file: ~c"ssl_app.erl", line: 53]}, {:ssl_app, :start, 2, [file: ~c"ssl_app.erl", line: 32]}, {:application_master, :start_it_old, 4, [file: ~c"application_master.erl", line: 293]}]}}}}}}
1.089     (hex 2.2.1) lib/hex.ex:5: Hex.start/0
1.089     (mix 1.16.3) lib/mix/hex.ex:60: Mix.Hex.start/0
1.089     (mix 1.16.3) lib/mix/dep/loader.ex:189: Mix.Dep.Loader.with_scm_and_app/5
1.089     (mix 1.16.3) lib/mix/dep/loader.ex:141: Mix.Dep.Loader.to_dep/4
1.089     (elixir 1.16.3) lib/enum.ex:1700: Enum."-map/2-lists^map/1-1-"/2
1.089     (mix 1.16.3) lib/mix/dep/loader.ex:364: Mix.Dep.Loader.mix_children/3
1.089     (mix 1.16.3) lib/mix/dep/loader.ex:18: Mix.Dep.Loader.children/1
1.089     (mix 1.16.3) lib/mix/dep/converger.ex:97: Mix.Dep.Converger.all/4
------

If I wind back the commit history, it appears to be this commit that is causing the problem. Reversing the version changes to TurkeyDockerfile makes the problem go away.

This is the command I'm running to build the image:

docker build --platform=linux/amd64 -t mozillareality/reticulum -f TurkeyDockerfile .

Note that the --platform argument is important because if you build for arm64 then it build fine:

docker build --platform=linux/arm64 -t mozillareality/reticulum -f TurkeyDockerfile .

This might explain why the GitHub workflow test pass if it is being built in an ARM64 environment.

[DougReeder]

When you run mix deps.update in the root directory of reticulum and re-build, does that change anything?

[Exairnous]

I'm unable to reproduce this using the specified command on the latest master (I double checked that I was ahead of the specified problem commit):
docker build --platform=linux/amd64 -t mozillareality/reticulum -f TurkeyDockerfile .

Everything also seems to work fine when running bin/up in Hubs Compose. And running mix deps.get also completes without errors on my host system.

My host system is an MSI laptop with the following:
Linux 6.7.4
Docker 25.0.4-rd
Elixir 1.16.1 (compiled with Erlang/OTP 26)

[rawnsley]

It looks like this problem is specific to building cross-platform on MacOS. I can confirm that the proposed ERL_FLAGS fix worked for me:

...
FROM base AS builder
ENV ERL_FLAGS="+JPperf true"
RUN apk add --no-cache nodejs yarn git build-base
COPY . .
RUN mix deps.get
RUN MIX_ENV=turkey mix release
...

I'm not clear on the implications of the flag and as I'm building exclusively for ARM now I don't really need a fix so I won't be submitting it as a PR.

[DougReeder]

I'm glad you figured it out!

Please submit a PR to the README documenting this situation and the workaround.