FINAL STUDENT PROJECTS
Exploring the Role of AI in the Creative Process
Luxembourg Tech School’s AI Creativity & Arts Module 2020–2021
AI Creativity & Arts is a 11-weeks module of the LTS Level UP Program that aims to stimulate creative ability with the use of AI. Our students discover Generative Artificial Intelligence and what can be done with it (also knowing its limits) and then they unleash their imagination and develop creative and innovative projects.
The combination of creativity, arts and AI — in the module AI Creativity & Arts (AY 2020/2021) our students were introduced to a very creative artificial world, which made them expand their imagination as well as their computational skills. With the use of artificial intelligence they were able to generate new content of text, images and music. Several tools related to this domain were put into practice, such as RunwayML, Google Magenta and GPT2 among others; and at the end of the module the students organized themselves into groups to develop their projects. From books and comics with artificially created stories, to new original soundtracks for movies. Their combinations of AI and creativity covered a wide range.
Final student projects Winter / Spring 2021
Filipa, Francisca & Lili
An entertaining and special videoclip starring Donald Trump, Vladimir Putin and Kim Jong-un to the rhythm of the Britney Spears song Toxic. For the production of the video clip, the students made use of the First Order Motion model for the animation of images, alternating the generated sequences with other extracts of music videos.
Jean & Tony
A novel artificially generated guessing game where the player will have to guess which film it is while being shown a series of images extracted from the original film to which styles of Picasso and Monet, among others, were applied with the use of artificial intelligence models. The students added generated music with AI-powered technology, where the training sets were MIDI files of the original movie soundtracks and the results were new musical compositions that preserved the essence of the original soundtrack.
Mathieu, Ayush & Matthieu
An original artificial comic “Saviour of the Universe”, whose special touch is the result of the application of AI. With their project the students wanted to answer the following questions: Could the model make a funny script?, How would the text to image model interpret the script?, Does the comic style images make it better? The comic text was generated using RunwayML’s Film Script Generator model, while the comic strip images are the result of generating images from text descriptions of scenes and then styling them with a cartoonish look using Generative Adversarial Models.
Daniel, Federico & Danny
A book for the little ones with an artificial touch. The students designed an original book for children with images and sounds processed by AI. To achieve the result, they transformed the main images of the book into sketches and generated the text of the book artificially. Finally, they added a feature so that readers can press a button and play a sound, which was generated with the voices of our creators and turned into an instrument (violin, flute and trumpet among others) with the use of autoencoders.
Antonio, Willem & Sascha
From a real saxophone to a new AI-generated music composition. The students used their musical talent and recorded an extract of “Fly to the moon” played by a saxophone. The generated result (in MIDI format) was the input of machine learning models for the generation of new musical compositions. They used two models: the first continues a piano performance, starting with a chosen priming sequence and the second uses a melody to accompany the original input.
Chaitanya & Barnaby
An artificial story in the style of Dr. Seuss. The students were inspired by Dr.Seuss books (e.g. The cat in the hat, Fox in socks, Hop on pop, etc). Since many of those books are filled with fantastic characters and imaginative settings, they would be perfect as a starting point for an artificial intelligence project. The students trained their own model in RunwayML to generate text and images from excerpts from Dr. Seuss’s books.
Luxembourg Tech School (LTS) is an extracurricular education program to support the development of future Digital Leaders. It is aimed at 12–19 years old students, who are eager to learn and apply technology in a real business and creative context.
