How would you approach making an iPad app to upload a music sheet and then play along with it?

What packages/ APIs/ tools are needed to implement with Swift successfully?

My understanding is having an OMR parse music sheet images/ pdfs to music xml files, then render the notations using some notation library, then maybe play with MIDI?