5toryline

5toryline is an exploration into human-machine relationships. With the rapid development of artificial intelligence and machine learning, we have never been closer to being able to co-create with the machines around us. 5toryline explores human-machine creativity by creating a platform in which you can collaboratively generate stories with your machine.

How it Works

5toryline is composed of an openFrameworks application and a python wrapper used to bridge two neural networks written in Torch. In the openFrameworks application a user selects 5 images to be used in the creation of a story.

These images are then sent via osc to the python script. This script first uses a library called NeuralTalk to caption the images. The image captions are then used as a primer sentence for another library called Char-RNN which generates full paragraphs.

Once the neural networks have completed their computations, the script sends the generated sentences back to the openFrameworks app via osc.

The code can be found here: https://github.com/mattvisco/5toryline

Credits

Special thanks goes out to Ross Goodwin — this code is an adapation of his NeuralSnap app.