16409 do not use receive step to determine root report #16723

jack-h-wang · 2024-12-05T20:38:36Z

This PR adjusts the search for root reports to not rely on explicitly searching for the receive step report. Additionally, the root report from the submissions endpoint should now include the sender-supplied payloadname if present.

Test Steps:

The tests in ReportGraphTest and FhirTranslatorIntegrationTests are sufficient

Changes

Do not use receive step as indicator of a root report.
- Instead, a root report is determined by a report ID that does not appear in the report_lineage table as a child report.
Retrieve payloadname from submission endpoint message headers when creating root report.

Checklist

Testing

Tested locally?
Ran ./prime test or ./gradlew testSmoke against local Docker ReportStream container?
(For Changes to /frontend-react/...) Ran npm run lint:write?
Added tests?

Linked Issues

Fixes Identify and update DB queries to be independent of the Receive step #16409

github-actions · 2024-12-05T20:38:50Z

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

OpenSSF Scorecard

Package	Version	Score	Details

Scanned Manifest Files

github-actions · 2024-12-05T20:50:35Z

Test Results

1 257 tests +2 1 253 ✅ +2 7m 45s ⏱️ +10s
164 suites ±0 4 💤 ±0
164 files ±0 0 ❌ ±0

Results for commit b7c1982. ± Comparison against base commit e8025be.

This pull request removes 2 and adds 4 tests. Note that renamed tests count towards both.

gov.cdc.prime.router.fhirengine.azure.FHIRTranslatorIntegrationTests ‑ successfully translate HL7 for FHIR receiver when isSendOriginal is true()
gov.cdc.prime.router.fhirengine.azure.FHIRTranslatorIntegrationTests ‑ successfully translate for FHIR receiver when isSendOriginal is true()

gov.cdc.prime.router.fhirengine.azure.FHIRTranslatorIntegrationTests ‑ successfully translate HL7 for FHIR receiver when isSendOriginal is true from convert step()
gov.cdc.prime.router.fhirengine.azure.FHIRTranslatorIntegrationTests ‑ successfully translate HL7 for FHIR receiver when isSendOriginal is true from receive step()
gov.cdc.prime.router.fhirengine.azure.FHIRTranslatorIntegrationTests ‑ successfully translate for FHIR receiver when isSendOriginal is true from convert step()
gov.cdc.prime.router.fhirengine.azure.FHIRTranslatorIntegrationTests ‑ successfully translate for FHIR receiver when isSendOriginal is true from receive step()

♻️ This comment has been updated with latest results.

github-actions · 2024-12-05T21:15:54Z

Integration Test Results

59 files ±0 59 suites ±0 38m 34s ⏱️ +28s
423 tests ±0 413 ✅ ±0 10 💤 ±0 0 ❌ ±0
426 runs ±0 416 ✅ ±0 10 💤 ±0 0 ❌ ±0

Results for commit b7c1982. ± Comparison against base commit e8025be.

♻️ This comment has been updated with latest results.

jack-h-wang · 2024-12-11T17:13:35Z

prime-router/src/main/kotlin/fhirengine/engine/FHIRConverter.kt

@@ -178,7 +180,8 @@ class FHIRConverter(
                // is properly recorded in the report file table with the correct sender
                actionHistory.trackExternalInputReport(
                    report,
-                    BlobAccess.BlobInfo(format, blobUrl, blobDigest.toByteArray())
+                    BlobAccess.BlobInfo(format, blobUrl, blobDigest.toByteArray()),
+                    payloadName


This change to carry over payloadname from the submissions API is needed to continue supporting the sendOriginal function. This adds the information to the root report being created here.

jack-h-wang · 2024-12-11T17:20:53Z

prime-router/src/main/kotlin/history/db/ReportGraph.kt

+            .leftJoin(REPORT_LINEAGE)
+            .on(REPORT_FILE.REPORT_ID.eq(REPORT_LINEAGE.CHILD_REPORT_ID))
+            .where(REPORT_LINEAGE.PARENT_REPORT_ID.isNull())
+            .orderBy(REPORT_FILE.ACTION_ID.asc())


The previous query was to join the action table in order to check if the action_name is receive. The new query instead filters the list of reports to only include those that do not appear in report_lineage as a child. This list is then ordered by action_id to ensure the results are output in a consistent order. The join to the action table is removed since it is no longer necessary.

jack-h-wang · 2024-12-11T17:24:43Z

prime-router/src/test/kotlin/fhirengine/azure/FHIRTranslatorIntegrationTests.kt

@@ -798,4 +798,166 @@ class FHIRTranslatorIntegrationTests : Logging {
            assertThat(translatedValue).isEqualTo(reportContents.toByteArray())
        }
    }
+
+    @Test
+    fun `successfully translate HL7 for FHIR receiver when isSendOriginal is true from convert step`() {


These tests ensure sendOriginal items still function when convert is the root report, as the case would be when the submissions API is used.

…appear as child in report_lineage

sonarcloud · 2024-12-12T00:15:15Z

Quality Gate passed

Issues
5 New issues
0 Accepted issues

Measures
0 Security Hotspots
100.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

jack-h-wang temporarily deployed to staging December 5, 2024 20:38 — with GitHub Actions Inactive

jack-h-wang added the platform Platform Team label Dec 6, 2024

jack-h-wang temporarily deployed to staging December 6, 2024 20:40 — with GitHub Actions Inactive

jack-h-wang temporarily deployed to staging December 9, 2024 16:55 — with GitHub Actions Inactive

jack-h-wang force-pushed the platform/jwang/16409-query-root-report-without-receive branch from 5c35630 to 4f56b4b Compare December 9, 2024 17:21

jack-h-wang temporarily deployed to staging December 9, 2024 17:22 — with GitHub Actions Inactive

jack-h-wang temporarily deployed to staging December 9, 2024 20:03 — with GitHub Actions Inactive

jack-h-wang temporarily deployed to staging December 11, 2024 03:31 — with GitHub Actions Inactive

jack-h-wang marked this pull request as ready for review December 11, 2024 03:37

jack-h-wang requested a review from a team as a code owner December 11, 2024 03:37

arnejduranovic requested review from adegolier and JFisk42 December 11, 2024 17:11

jack-h-wang commented Dec 11, 2024

View reviewed changes

jack-h-wang temporarily deployed to staging December 11, 2024 17:27 — with GitHub Actions Inactive

jack-h-wang mentioned this pull request Dec 11, 2024

Submissions endpoint stores additional metadata #16727

Closed

3 tasks

jack-h-wang added 6 commits December 11, 2024 18:52

replace check for receive step with check for report_ids that do not …

155f318

…appear as child in report_lineage

remove unnecessary join to action table

b36a77a

track payloadname for submissions from the submissions api

b2a805d

add tests for sendoriginal from convert step

ad2e0fb

order by action_id for consistent result ordering

49ce495

rename variable for clarity

b7c1982

jack-h-wang force-pushed the platform/jwang/16409-query-root-report-without-receive branch from d665d9b to b7c1982 Compare December 11, 2024 23:52

jack-h-wang deployed to staging December 11, 2024 23:52 — with GitHub Actions Active

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

16409 do not use receive step to determine root report #16723

16409 do not use receive step to determine root report #16723

jack-h-wang commented Dec 5, 2024 •

edited

Loading

github-actions bot commented Dec 5, 2024 •

edited

Loading

github-actions bot commented Dec 5, 2024 •

edited

Loading

github-actions bot commented Dec 5, 2024 •

edited

Loading

jack-h-wang Dec 11, 2024

jack-h-wang Dec 11, 2024

jack-h-wang Dec 11, 2024

sonarcloud bot commented Dec 12, 2024

16409 do not use receive step to determine root report #16723

Are you sure you want to change the base?

16409 do not use receive step to determine root report #16723

Conversation

jack-h-wang commented Dec 5, 2024 • edited Loading

Changes

Checklist

Testing

Linked Issues

github-actions bot commented Dec 5, 2024 • edited Loading

Dependency Review

OpenSSF Scorecard

Scanned Manifest Files

github-actions bot commented Dec 5, 2024 • edited Loading

Test Results

github-actions bot commented Dec 5, 2024 • edited Loading

Integration Test Results

jack-h-wang Dec 11, 2024

Choose a reason for hiding this comment

jack-h-wang Dec 11, 2024

Choose a reason for hiding this comment

jack-h-wang Dec 11, 2024

Choose a reason for hiding this comment

sonarcloud bot commented Dec 12, 2024

Quality Gate passed

jack-h-wang commented Dec 5, 2024 •

edited

Loading

github-actions bot commented Dec 5, 2024 •

edited

Loading

github-actions bot commented Dec 5, 2024 •

edited

Loading

github-actions bot commented Dec 5, 2024 •

edited

Loading