Sensing Your Fruits

Sense Your Fruit is a one-day machine learning project which aims to encourage people to look and interact with something they know with familiarity in a new light. What would it be like to experience a new dimension to something as simple and refreshing as a piece of fruit? When it comes to fruits, we have associations of taste, emotion and texture, but rarely do we visualise the places they come from and the cultural sounds of that region.

The focal point of the project is a fruit bowl that is placed on a bare table. When a person picks up a specific fruit, they hear music from the country that the fruit as imported from to Denmark. In front of them, simultaneously, they see a map visualisation of the country that the fruit comes from. The experience encourages the participant to think about the journey of the fruit from its origin to the person’s hand, spark curiosity in guessing where the music might originate from, and keep picking up different fruits so they can enjoy different musical experiences.

The project was completed using Wekinator to train various classifications of the fruits so that the machine could recognise each fruit and provide a corresponding visual and audio output.