Skip to content

HOMeR: Hardware Optical Music Recognition is a combination of a MATLAB app and an FPGA/SoC synthesizer capable of reading and replaying digitized sheet music images.

Notifications You must be signed in to change notification settings

takatz28/HOMeR-Hardware-OMR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HOMeR: Hardware Optical Music Recognition

For a complete description of the project, click here.

Abstract

From the thesis "Hardware/Software Co-design of an Optical Music Recognition System":

The objective of the project presented herein is to provide a co-design approach to the general optical music recognition (OMR) framework. The proposed system aims to be the first step towards a full-fledged hardware implementation of a music recognizer.

The OMR system is partitioned into two subsystems: software and hardware. Utilizing a combination of morphological and template matching techniques, the HOMeR software subsystem processes and converts simple monophonic, homophonic, and piano sheet music images to two numeric arrays corresponding to notes and beats through a graphical user interface. Subsequently, the hardware subsystem applies these array outputs into a custom synthesizer core written for the Zybo Z7 development board, which produces an organ-like audible equivalent of the initial input images through the onboard audio codec.

HOMeR was able to process sheet music images of different types and sizes with high accuracy and fast run times, both for pre- and post- correction.


Requirements

  • Software
    • MATLAB R2019a or later
    • Vivado Design Suite 2019.1 (primarily Xilinx SDK and Vivado)
  • Hardware
    • Zybo Z7: Zynq-7000 ARM/FPGA SoC Development Board (Z7-20 variant)
    • Speaker with an AUX connection

Setup Instructions

  1. Download the required software.
  2. Clone the repository.
  3. Open the HOMeR.mlapp within the HOMeR folder. Make sure that the current MATLAB workspace is the same folder.
  4. Select sheet music image(s) to be read, then click on the Read Score button.
  5. Once the processing is complete, open Xilinx SDK. When prompted for the workspace, select the OrganNotes.sdk folder.
  6. Connect the Zybo board to the computer using a micro-USB cable. Insert one end of an AUX cord to the HPH OUT port of the board, and the other to the speaker.
  7. Program the FPGA.
  8. Click on Run As > Launch On Hardware (GDB).
  9. Push the BTN1 button on the board to listen to the audio version of the images.

Notes

If the Synthesizer IP core is to be modified, follow these instructions:
  1. Delete the contents of the OrganNotes.sdk folder under HOMeR.
  2. Open Vivado 2019.1.
  3. Using the tcl console, type the following:
cd <change to extracted_folder>/Synthesizer/
source ./OrganNotes.tcl
  1. Once the project is created, modify the IP through the Block Design section.
  2. Create a new HDL wrapper for the block design, then generate the bitstream.
  3. Go to File > Export > Export Hardware. Make sure that the "Include Bitstream" box is marked, and the "Export to" location is the OrganNotes.sdk folder.
  4. Go to File > Launch SDK. Change both "Exported location" and "Workspace" to OrganNotes.sdk, then click OK.
  5. Once the SDK is launched, go to File > New > Application Project.
  6. Fill up the form with the following details:
Field Value
Project Name Synthesizer
OS Platform Standalone
Hardware Platform test_wrapper_hw_platform_0
Processor ps7_cortex a9_0
Language C
Board Support Package Create New
  1. Click on Next, select the Empty Application template, then click Finish.
  2. Copy the contents of HOMeR/src into OrganNotes.sdk/Synthesizer/src.
  3. Run the HOMeR app as described in the Setup section.
  • Launch On Hardware must be performed after every image read.
  • The board need not to be re-programmed every read, unless the audio produces undesirable results.

Demonstrations

Other Resources

System Setup

Block Diagram

HOMeR Sample Output

About

HOMeR: Hardware Optical Music Recognition is a combination of a MATLAB app and an FPGA/SoC synthesizer capable of reading and replaying digitized sheet music images.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published