[question] Ammonite spark scripts

[james64]

Hey,
thanks for amm-spark. It's a great tool with beautiful and readable code base! I noticed that it only can be used interactively because it relies on replApi instance. If I understand it correctly it is used to access classes which were defined or added after repl start but before spark session is started. In repl this is obviously needed. But I cannot stop wondering...

Would it be possible to create a sister of ammonite-spark which would be usable non-interactively in ammonite scripts? Having one project cover both these use cases would be better but looks unlikely.

Was this use case considered/investigated? It is known to be a dead end or it is worth looking at?

I am not as knowledgeable about ammonite internals yet and I want to save me a hassle of digging into it if there are known reasons why this would not work.

Thanks!

[alexarchambault]

As you said, ammonite-spark currently relies on replApi, which is only accessible from the repl, not from scripts. The things it accesses through replApi, mostly replApi.sess.frames could be made accessible from interpApi though. Minimal changes in Ammonite itself should be needed, it should be a matter of tweaking the way it handles its "bridges" / APIs.