Machine Learning for Creativity and Design

NeurIPS 2019 Workshop, Vancouver, Canada

Saturday December 14ᵗʰ 8:30 — 18:00

Image credit: Mario Klingemann's Neural Glitch from the NeurIPS 2018 creativity art gallery.

Introduction

Generative machine learning and machine creativity have continued to grow and attract a wider audience to machine learning. Generative models enable new types of media creation across images, music, and text - including recent advances such as StyleGAN, MuseNet and GPT-2. This one-day workshop broadly explores issues in the applications of machine learning to creativity and design. We will look at algorithms for generation and creation of new media, engaging researchers building the next generation of generative models (GANs, RL, etc). We investigate the social and cultural impact of these new models, engaging researchers from HCI/UX communities and those using machine learning to develop new creative tools. In addition to covering the technical advances, we also address the ethical concerns ranging from the use of biased datasets to the use of synthetic media such as “DeepFakes”. Finally, we’ll hear from some of the artists and musicians who are adopting machine learning including deep learning and reinforcement learning as part of their own artistic process. We aim to balance the technical issues and challenges of applying the latest generative models to creativity and design with philosophical and cultural issues that surround this area of research.

The goal of this workshop is to bring together researchers interested in advancing art and music generation to present new work, foster collaborations and build networks.

Invited Speakers

Important Dates

9 September 2019: Submission date for papers and art

1 October 2019: Acceptance notification for papers and art

1 December 2019: Deadline for final copy of accepted papers

8–14 December 2019: NeurIPS Conference

14 December 2019: Workshop

Contact

If you have any questions, please contact us at neurips2019creativity@gmail.com

Workshop website: https://neurips2019creativity.github.io

Schedule

Time Event
8:15 AM Welcome and Introduction
8:30 AM Invited Talk
Alec Radford (OpenAI)
Transfer Learning for Text Generation
9:00 AM Invited Talk
Giorgio Patrini (Deeptrace)
Deepfakes: commodification, consequences and countermeasures.
9:30 AM AI art gallery overview
Luba Elliott
9:45 AM Art / Coffee Break
10:30 AM Invited Talk
Yann LeCun (?)
10:30 AM Artist Lightning Talks
11:00 AM Neural Painters: A learned differentiable constraint for generating brushstroke paintings
Rei Nakano
11:10 AM Transform the Set: Memory Attentive Generation of Guided and Unguided Image Collages
Nikolay Jetchev, Roland Vollgraf
11:20 AM Paper Dreams: An Interactive Interface for Generative Visual Expression
Guillermo Bernal, Lily Zhou
11:30 AM Deep reinforcement learning for 2D soft body locomotion
Junior Rojas
11:40 AM Towards Sustainable Architecture: 3D Convolutional Neural Networks for Computational Fluid Dynamics Simulation and Reverse Design Workflow
Josef Musil
11:50 AM Human and GAN collaboration to create haute couture dress
Jun Seita, Tatsuki Koga
12:00 PM Lunch
1:30 PM Poster Session 1 (papers 1-15)
Han-Hung Lee, Asir Saeed, Terence Broad, Jon Gillick, Aaron Hertzmann, Gunjan Aggarwal, Eun Jee Sung, Alex Champandard, Junghyun Park, John Mellor, Vincent Herrmann, Da Gin Wu, Seri Lee, Park Jieun, TaeJae Han, Wonseok Jung, Seungil Kim
2:30 PM Invited Talk
Sougwen Chung
3:00 PM Invited Talk
Claire Evans (YACHT)
How to Chain Trip
3:30 PM Art / Coffee Break
4:15 PM MidiMe: Personalizing a MusicVAE model with user data
Monica Dinculescu
4:25 PM First Steps Towards Collaborative Poetry Generation
David Uthus, Maria Voitovich
4:35 PM Open discussion
5:00 PM Poster Session 2 (papers 16-30)
Mayur Saxena, Nicholas Frosst, Vivien Cabannes, Gene Kogan, Austin Dill, Anurag Sarkar, Joel Ruben Antony Moniz, Vibert Thio, Scott Sievert, Lia Coleman, Frederik De Bleser, Brian Quanz, Jonathon Kereliuk, Panos Achlioptas, Mohamed Elhoseiny, Songwei Ge, Aidan Gomez, Jamie Brew

Accepted papers

Papers 1-13 will be presented in the first poster session. Papers 13-28 will be presented in the second poster session. Papers 29-31 will not be presented, as the authors are unable to attend.

  1. Visual Indeterminacy in Generative Neural Art
    • Aaron Hertzmann
  2. Unsupervised Doodling and Painting with Improved SPIRAL
    • John Mellor, Eunbyung Park, Dan Rosenbaum, Andy Ballard, Yaroslav Ganin, Igor Babuschkin, Theophane Weber, Oriol Vinyals, Tejas Kulkarni, S. M. Ali Eslami
  3. Creative GANs for generating poems, lyrics, and metaphors
    • Asir Saeed, Suzana Ilić, Eva Zangerle
  4. UGly-Net: Playful Exploration of U-Net for Glitch Effects
    • Seri Lee, Eun Jee Sung, Jieun Park, Juhee Lee
  5. Paper Dreams: An Interactive Interface for Generative Visual Expression
    • Guillermo Bernal, Lily Zhou, Haripriya Mehta, Pattie Maes
  6. Stylizing Audio Reactive Visuals
    • Han-Hung Lee, Da-Gin Wu, and Hwann-Tzong Chen
  7. Breaking Speech Recognizers to Imagine Lyrics
    • Jon Gillick, David Bamman
  8. A generative approach to Korean abstract painting Dansaekhwa
    • TaeJae Han, EunJeong Kang, Jinho Bae, Junghyun Park
  9. Deep reinforcement learning for 2D soft body locomotion
    • Junior Rojas, Stelian Coros, Ladislav Kavan
  10. Transform the Set: Memory Attentive Generation of Guided and Unguided Image Collages
    • Nikolay Jetchev, Urs Bergmann, Gokhan Yildirim
  11. Neural Painters: A learned differentiable constraint for generating brushstroke paintings
    • Reiichiro Nakano
  12. Searching for an (un)stable equilibrium: experiments in training generative models without data
    • Terence Broad, Mick Grierson
  13. Immersions - How does music sound to artificial ears?
    • Vincent Herrmann
  14. Game Design using Creative AI
    • Anurag Sarkar
  15. Learned Interpolation for 3D Generation
    • Austin Dill, Songwei Ge, Eunsu Kang, Chun-Liang Li, Barnabás Póczos
  16. Machine learning based co-creative design framework
    • Brian Quanz, Wei Sun, Ajay Deshpande, Dhruv Shah, Jae-eun Park
  17. First Steps Towards Collaborative Poetry Generation
    • David Uthus, Maria Voitovich, R.J. Mical, Ray Kurzweil
  18. Artist in the Cloud: Towards an Autonomous Artist
    • Gene Kogan
  19. LucidDream: Controlled Temporally-Consistent DeepDream on Videos
    • Joel Ruben Antony Moniz, Eunsu Kang, Barnabás Póczos
  20. Towards Sustainable Architecture: 3D Convolutional Neural Networks for Computational Fluid Dynamics Simulation and Reverse Design Workflow
    • Josef Musil, Jakub Knir, Athanasios Vitsas, Irene Gallou
  21. Human and GAN collaboration to create haute couture dress
    • Tatsuki Koga, Ema Rie, Kazuko Hirose, Jun Seita
  22. Towards Principled Evaluation of Creativity of Machine-Generated Art
    • Lia Coleman, Panos Achlioptas, Mohamed Elhoseiny
  23. Location Conditional Image Generation using Generative Adversarial Networks
    • Mayur Saxena, Aidan Gomez, Yarin Gal
  24. MidiMe: Personalizing a MusicVAE model with user data
    • Monica Dinculescu, Jesse Engel, Adam Roberts
  25. Text Conditional Lyric Video Generation
    • Nicholas Frosst, Jonathon Kereliuk
  26. A robot and comedian walk into a bar, and… AHA!
    • Jamie Brew, Joseph Holt, Lalit Jain, Robert Mankoff, Liam Marshall, Robert Nowak, Rahul Parhi, Scott Sievert
  27. Neural Loops
    • Vibert Thio, Chris Donahue
  28. Dialog on a canvas with a machine
    • Vivien Cabannes, Tina Campana, Charly Ferrandes, Thomas Kerdreux, Louis Thiry
  29. GANDelve — a Visual Interface for Creative AI
    • Frederik De Bleser
  30. Generative System to Assist the Artist in the Choice of 3D Composition for a Still Life Painting
    • Guido Salimbeni, Frederic Fol Leymarie, William Latham
  31. cFineGAN: Unsupervised multi-conditional fine-grained image generation
    • Gunjan Aggarwal, Abhishek Sinha

Organisers

Luba Elliott, AI Curator

Sander Dieleman, DeepMind

Rebecca Fiebrink, Goldsmiths University of London

Adam Roberts, Magenta, Google Brain

Jesse Engel, Magenta, Google Brain

Tom White, Victoria University of Wellington

Christine Payne, OpenAI

Parag K. Mital, HyperSurfaces, Mogees, Ltd

Nao Tokui, Keio University

Sponsors

Google