Designing a service to import files transferred by the DTS into a KBase Narrative

[jeff-cohere]

Overview

It looks like data is imported to a KBase narrative not by the staging service (which just accepts requests related to uploading/downloading files to/from the staging area and generating spreadsheets with bulk import specs) but by various mechanisms in the kb_uploadmethods app. The dispatch process for selecting these mechanisms is described in Data Importing in the KBase Narrative, which points at a staging_upload.json file that enumerates and annotates the mechanisms.

Specifically, there are upload methods that form thin wrappers around SDK-powered stuff like this GFF importer.

The kb_uploadmethods app uses the KBase SDK and handles the running of the jobs needed for the actual imports. I wonder where it would make sense to insert our own DTS manifest parser.

Resources

• Design discussion (within staging service repo)
• Data Importing in the KBase Narrative
• kb_uploadmethods repo