Local debugging

[InsideTheo]

Hello,

I would like to debug the code (especially the parts that deploy a job to Flink and the parts that interprete the Model Json) locally. However it is hard for me to get all the dependencies to run. Also the config that is specified in NussknackerApp.run.xml seems outdated, since its very different to what the quickstart project deploys (for example the Flink Urls dont match). Is there an easy way to get all dependencies to run locally and connect them to local designer?

Kind regards

[arkadius]

Also the config that is specified in NussknackerApp.run.xml seems outdated, since its very different to what the quickstart project deploys (for example the Flink Urls dont match)

What exactly do you mean by that? I see:

<env name="FLINK_REST_URL" value="http://localhost:3031" />

in NussknackerApp.run.xml

and:

  jobmanager:
    container_name: nussknacker_jobmanager
    image: apache/flink:${FLINK_VERSION-1.15.2}-scala_${SCALA_VERSION-2.12}-${JAVA_VERSION-java11}
    ports:
      - "3031:8081"
      - "9249:9249"

in quickstart.

Looks like ports matches.

Is there an easy way to get all dependencies to run locally and connect them to local designer?

Yes it is described in CONTRIBUTING.md

However we don't use this method too often during development. For debugging Flink execution it is more easier to write test that will be run on embedded Flink. It is described in developers guide

[InsideTheo]

Hmm yes, I think I was wrong about Flink. So, I was trying to get the example described in flink-streaming to run with a locally started instance of the Designer. It proves to be difficult for me though.

You mentioned the Contributions file. I suppose you were referring to the part where docker-compose -f docker-compose-env.yml -f docker-compose-custom.yml up -d is recommended, to start an integration environment. This did not work out of the box (issues with a nginx path) so I used the start script in the common folder and then stopped the designer instance to replace it with my own local one.
Also it is recommended to start RunFlinkStreamingModelLocally for the Flink things, which gave me an Illegal Argument Exception Found duplicate keys: (kafka,WithCategories...). So yeah it seems I am a bit lost :)

Im looking forward to your response,

kind regards

[InsideTheo]

Wow, I feel very stupid now :) I got it done, I just started the quickstart and then the local designer without stopping anything, since they run on different ports. It works fine now. Maybe the contribution readme could be a little more precise about a few things (for example it doesnt work to run the command that I mentioned in my comment earlier). But maybe it was just because I was a bit lost. Got it now, Thanks :)

Kind regards