Goals for Simulation.jl and the data pipeline

[claireh93]

There is currently a semi-working branch of Simulation pulling from the pipeline here: ScottishCovidResponse/EcoSISTEM.jl#80 specifically using examples/Epidemiology/Scotland_run.jl

Several improvements that spring to mind are:

• Reading all params from the pipeline, even if they are not associated with the literature/inference yet.
• write_array for writing back to the pipeline is currently broken.
• There are several datasets not currently housed in the scrc data repo due to data sharing limitations - age mixing and commuting data that could do to be incorporated somehow.
• Pulling large files like the demographic data times out currently ftp timeout on pipeline_download #741
• Investigate how easy it would be to have a direct Julia interface to the pipeline.

[github-actions]

Heads up @mrow84 @bobturneruk - the "data pipeline api" label was applied to this issue.

[github-actions]

Heads up @claireh93 @richardreeve @jwscook @sdl1 @wytbella - the "Simulation.jl" label was applied to this issue.

[claireh93]

@richardreeve do you have anything you want to add here? Martin will be helping out with Simulation & the pipeline, so I'm trying to compile a list of things we could do with some help on.