Project Status Day 5 : Thursday 02/02/12

What has been done:

  • Getting signals from the sensors.
  • Working on Skemmi to process the signals and to send OSC messages.
  • Analyzing/creating the sounds in Kyma X.
  • Making the poster.
  • Adding the “offline mode” (AKA MP3 player) for the internet radio stream program.
  • Testing the control interface with Processing.

What will be done tomorrow:

  • Editing the sounds in Kyma X.
  • Test the sensors and choose which parameters to use.
  • Work on Skemmi to interact with Kyma X.
  • Make the control interface.

Problems & questions:

  • Problem with the fluidity of the gyroscope.

Converting HeartBeat-data into sound

Yesterday we wrote a code in C++ to interface the Polar HeartBeat Counter. As we mentioned, we had some problems in order to get the data in real-time. Now, everything is working perfect, so we could proceed to the next step: converting the dataformat so we will be able to send it to Kyma. This converting is done in OpenInterface. At this moment, we have already the parameters of the reactions of the person who uses the headset and the heartbeat of that  person. It’s the purpose to send all the data to Kyma, so we can modify the sound using all these parameters. That’s what we’re going to do the next days.

Using the Emotiv Epoc with the Emotiv API

After using OpenVibe to get the signals, we spent time on the Emotiv API.
It proposes directly different functions for three types of behavior:

  1. The emotions;
  2. The cognition;
  3. The expressions.

This last one, is the one wich allows to get the most results in a few time. So, we decided to use it (we don’t have time to explore all the possibility the Epoc offers).
It is also easy to use and, in a short time, we managed to implement it in OpenInterface.

Here is a list of the different expressions that we can recognize (this works for most tests) :

  • The blink of eyes
  • The eyebrow movement
  • The left wink
  • The right Wink
  • The look on the right
  • The look on the left
  • Clench teeth
  • The smile

Media content for the project

Today we grab some pictures, videos and sounds of Brussels city to use in our project.
We recorded various sounds from the city, these sounds are going to be morphed in a new sound that will be related to the respective picture.
These sounds were extracted from videos recorded in the city were then cut into short extracts.

Internet Radio Stream as Parameters

Our consultant, AERTS Gregory, has coded for us a little program in Pure Data.

The program catches an internet radio stream, analyses its frequency. For each of the 4 different ranges of frequency, it sends an OSC message, with a value between 0 and 1, to the Kyma that can be linked to a parameter.

UPDATE: We have added the possibility to play a local MP3 file in case of network problem.

Interfacing a Polar HeartBeat Counter

Today we provided an interface to the Polar HeartBeat Counter. We used the Polar Heart Rate Monitor Interface (SEN-08661) to convert the signals we receive. The HRMI provides a logic-level serial interface. So, we wrote a simple code in C++ to get the data of the heartbeat in real-time. For now it’s not working perfect, but we found the solution to solve the problem, so tomorrow, the interface will be completed and we will be able to get the heartbeat of a person in real-time.

   

Project Status Day 4 : Wednesday 01/02/12

What has been done:

  • Testing the sensors and getting signals from its.
  • Working on Skemmi to process the signals.
  • Recording sounds and taking pictures/videos of Brussels (part1).
  • Testing/analyzing/creating the sounds in Kyma X.
  • Catching an internet radio stream, analyzing it’s frequency and sending OSC messages based on it with Pure Data.

What will be done tomorrow:

  • Create the sounds in Kyma X.
  • Test the sensors and getting signals from its.
  • Work on Skemmi to process the signals and to send OSC messages.
  • Make the poster.

Problems & questions:

  • Problem with the serial port.
  • Problem with the stability of the gyroscope