Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/add corstone315 object detection app #60

Merged

Conversation

david-hazi-arm
Copy link
Contributor

@david-hazi-arm david-hazi-arm commented Mar 8, 2024

Description

Test Steps

Checklist:

  • I have tested my changes. No regression in existing tests.
  • I have modified and/or added unit-tests to cover the code changes in this Pull Request.

Related Issue

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@david-hazi-arm david-hazi-arm force-pushed the feature/add-corstone315-object-detection-app branch 2 times, most recently from f52f62c to 26085b8 Compare March 10, 2024 13:38
For the Corstone-300, 310 and 315 platforms,
TF-M allocates S DATA RAM on the first 128kB
of the ISRAM0 memory region. NS DATA RAM can
be placed after this region.

Signed-off-by: Ahmed Ismail <[email protected]>
@david-hazi-arm david-hazi-arm force-pushed the feature/add-corstone315-object-detection-app branch from 26085b8 to b57be05 Compare March 11, 2024 15:30
@david-hazi-arm david-hazi-arm marked this pull request as ready for review March 11, 2024 15:49
@david-hazi-arm david-hazi-arm requested a review from a team as a code owner March 11, 2024 15:49
@david-hazi-arm david-hazi-arm marked this pull request as draft March 11, 2024 16:07
@kstribrnAmzn
Copy link
Member

@david-hazi-arm are you looking for review still? I see you have moved this back to the draft state

david-hazi-arm and others added 13 commits March 12, 2024 11:05
The latest version of the Arm Corstone Platform BSP repository
provides support for the Corstone-315 platform.

Signed-off-by: Dávid Házi <[email protected]>
* 0001-corstone300-Modify-ISRAM0-to-be-non-secure-partition.patch
  have been removed, because DTCM was not large
  enough in some cases. S DATA RAM moved to the
  beginning of ISRAM0, size increased to 128kB.

* Updated to the latest commit which
  supports Corstone-315 platform

* patch: Corstone-315 has got a new provisioning method.
  To match the new method to the older platforms,
  we were changed the last provisioning step's log
  messages, in this case the CI pass conditions
  can be unified.

Signed-off-by: Dávid Házi <[email protected]>
Added Corstone-315 support. Because of the
different provisioning method, the 315 should
be handled separately.
The function is using the cmake variables
instead of the function parameter list.

Signed-off-by: Gabor Abonyi <[email protected]>
* Add Corstone-315 platform to FreeRTOS Plus TCP
  Corstone-315 has got a different memory map than the
  previous Corstone platforms.
* Turn on BL1 logging for Corstone-315
* Don't define PLATFORM_DEFAULT_CRYPTO_KEYS
  for Corstone-315, this platform using its
  own keys, because of the new security IPs

Signed-off-by: Gabor Abonyi <[email protected]>
Arm Mali-C55 image signal processor (ISP) driver

The Corstone-315 has an ISP IP, which can be
used to create downscaled image for ML vision
applications.
ISP also can handle camera lens, sensors. The
driver comes with a 3A algorithm (proprietary)

Signed-off-by: Gabor Abonyi <[email protected]>
Using the latest platform, the Corstone-315 as
default.

Signed-off-by: Dávid Házi <[email protected]>
Arm-2D is used by the object detection example to
draw frames around detected faces.

Signed-off-by: Gabor Abonyi <[email protected]>
Generates `You Only Look Once` (YOLO) fastest object
detection model for the object detection application

Signed-off-by: Dávid Házi <[email protected]>
The tools has been added to convert images
to .FRM format, which can be fed into the
Corstone-315 FVP's "camera" input.

Signed-off-by: Gabor Abonyi <[email protected]>
The HDLCD helper adds 3 predefined display
formats to the project, RGB565, RGB32 and
A2R10G10B10.

Signed-off-by: Gabor Abonyi <[email protected]>
Starting bootloader printed by BL2.
Corstone-300 and 310 starting the BL2 first,
than do the provisioning part.
Corstone-315 do the provisioning first, because of the
BL1 ROM bootloader, therefore the log messages
comes swapped from this platform.
We have deleted the Starting bootloader line to
unify the pass output file.

Signed-off-by: Dávid Házi <[email protected]>
Object detection example is an ML vision
example on the Cortex-M systems.
Currently running only on Corstone-315 to
demonstrate the usage of ISP, NPU, HDLCD
together.

Signed-off-by: Gabor Abonyi <[email protected]>
Corstone-315 added to the blinky and to the
ML/OTA tests too.

Signed-off-by: Dávid Házi <[email protected]>
@david-hazi-arm david-hazi-arm force-pushed the feature/add-corstone315-object-detection-app branch from b57be05 to 6f191cc Compare March 12, 2024 13:59
@david-hazi-arm david-hazi-arm marked this pull request as ready for review March 12, 2024 14:10
@david-hazi-arm
Copy link
Contributor Author

@david-hazi-arm are you looking for review still? I see you have moved this back to the draft state

Hi,
Now it is open again, I've missed something yesterday.
It is now ready for review.

@urutva urutva merged commit f104930 into FreeRTOS:main Mar 14, 2024
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants