Sight-Key (lettore Musicale)

With our project we wanted to create a piano that could play itself and execute any kind of music sheet thanks to a camera that reads it.

This project helped us to deepen our computer knowledge and practical skills applicable to this field, such as the use of arduino and programmes.

We decided to create this guitar because we were all acumened by the passion for music and the desire to create a project that merged technology and music.

This project is composed of a piano, a camera and a hand.

Supplies

STRUCTURE

Piano

2 Wood tables

plastic band for the trolley

CIRCUIT

Arduino

Breadboard

Jumpers

camera SP32cam

HAND

Hand made with 3d printer

Servos

rubberbands

We started by making a cardboard model to see how we wanted the project to look and to take the measurements we needed.

We decided to start by using 8 servos, one for each note in one octave, and make them play one music sheet that we used as a model. We used an arduino for the servos and python to read the music sheet.

To run the servos we use this program: Arduinoboia

We changed the angles for almost every servo because in the structure we put them on different heights.

Then we created another program on CV studio that has to make the camera work and read the music sheet to send the notes to the arduino program. The main issue was that using the camera we might have lots of variables, starting off with the sizes of the notes or the number of lines, so we had to work a lot on it to make sure it works well with most of the sheets.

This is the program, without the part to run the camera: Sheet_program

We used arduino’s serial to make the program on arduino and the one on python communicate.

Using wood, we built sticks, a structure that supported the servos and another structure that held the music sheet.

The sticks, attached to the servos, were the objects playing the piano before the hand was built.

After that we decided to focus on making the hand and making the program work for every music sheet. So we made the hand using onshape and printed it with the 3D printer.

We made a support for the camera with wood and then we built a trolley to move the hand on the keyboard using a wooden platform, a support, 2 servos attached to a wire that together move the platform.