Introduction
Generative machine learning and machine creativity have continued to grow and attract a wider audience to machine learning. Generative models enable new types of media creation across images, music, and text - including recent advances such as StyleGAN, MuseNet and GPT-2. This one-day workshop broadly explores issues in the applications of machine learning to creativity and design. We will look at algorithms for generation and creation of new media, engaging researchers building the next generation of generative models (GANs, RL, etc). We investigate the social and cultural impact of these new models, engaging researchers from HCI/UX communities and those using machine learning to develop new creative tools. In addition to covering the technical advances, we also address the ethical concerns ranging from the use of biased datasets to the use of synthetic media such as “DeepFakes”. Finally, we’ll hear from some of the artists and musicians who are adopting machine learning including deep learning and reinforcement learning as part of their own artistic process. We aim to balance the technical issues and challenges of applying the latest generative models to creativity and design with philosophical and cultural issues that surround this area of research.
The goal of this workshop is to bring together researchers interested in advancing art and music generation to present new work, foster collaborations and build networks.
Invited Speakers
- Sougwen Chung
- Claire Evans (YACHT)
- Giorgio Patrini (Deeptrace)
- Alec Radford (OpenAI)
Important Dates
9 September 2019: Submission date for papers and art
1 October 2019: Acceptance notification for papers and art
1 December 2019: Deadline for final copy of accepted papers
8–14 December 2019: NeurIPS Conference
14 December 2019: Workshop
Contact
If you have any questions, please contact us at neurips2019creativity@gmail.com
Workshop website: https://neurips2019creativity.github.io
Schedule
Time | Event |
---|---|
Session 1 | Livestream/Recording |
8:15 AM | Welcome and Introduction |
8:30 AM | Invited Talk Alec Radford (OpenAI) Transfer Learning for Text Generation |
9:00 AM | Invited Talk Giorgio Patrini (Deeptrace) Deepfakes: commodification, consequences and countermeasures. |
9:30 AM | AI art gallery overview Luba Elliott |
9:45 AM | Art / Coffee Break |
Session 2 | Livestream/Recording |
10:30 AM | Invited Talk Yann LeCun (?) |
10:30 AM | Artist Lightning Talks |
11:00 AM | Neural Painters: A learned differentiable constraint for generating brushstroke paintings Rei Nakano |
11:10 AM | Transform the Set: Memory Attentive Generation of Guided and Unguided Image Collages Nikolay Jetchev, Roland Vollgraf |
11:20 AM | Paper Dreams: An Interactive Interface for Generative Visual Expression Guillermo Bernal, Lily Zhou |
11:30 AM | Deep reinforcement learning for 2D soft body locomotion Junior Rojas |
11:40 AM | Towards Sustainable Architecture: 3D Convolutional Neural Networks for Computational Fluid Dynamics Simulation and Reverse Design Workflow Josef Musil |
11:50 AM | Human and GAN collaboration to create haute couture dress Jun Seita, Tatsuki Koga |
12:00 PM | Lunch |
1:30 PM | Poster Session 1 (papers 1-13, 23) Han-Hung Lee, Asir Saeed, Terence Broad, Jon Gillick, Aaron Hertzmann, Gunjan Aggarwal, Eun Jee Sung, Junghyun Park, John Mellor, Vincent Herrmann, Da Gin Wu, Seri Lee, Park Jieun, TaeJae Han, Wonseok Jung, Seungil Kim |
Session 3 | Livestream/Recording |
2:30 PM | Invited Talk Claire Evans (YACHT) How to Chain Trip |
3:00 PM | Invited Talk Sougwen Chung |
3:30 PM | Art / Coffee Break |
Session 4 | Livestream/Recording |
4:15 PM | MidiMe: Personalizing a MusicVAE model with user data Monica Dinculescu |
4:25 PM | First Steps Towards Collaborative Poetry Generation David Uthus, Maria Voitovich |
4:35 PM | Open discussion |
5:00 PM | Poster Session 2 (papers 14-22, 24-28) Mayur Saxena, Nicholas Frosst, Vivien Cabannes, Gene Kogan, Austin Dill, Anurag Sarkar, Joel Ruben Antony Moniz, Vibert Thio, Scott Sievert, Lia Coleman, Frederik De Bleser, Brian Quanz, Jonathon Kereliuk, Panos Achlioptas, Mohamed Elhoseiny, Songwei Ge, Aidan Gomez, Jamie Brew |
Accepted papers
Papers 1-13 & 23 will be presented in the first poster session. Papers 14-22, 24-28 will be presented in the second poster session. Papers 29-31 will not be presented, as the authors are unable to attend.
- Visual Indeterminacy in Generative Neural Art
- Aaron Hertzmann
- Unsupervised Doodling and Painting with Improved SPIRAL
- John Mellor, Eunbyung Park, Dan Rosenbaum, Andy Ballard, Yaroslav Ganin, Igor Babuschkin, Theophane Weber, Oriol Vinyals, Tejas Kulkarni, S. M. Ali Eslami
- Creative GANs for generating poems, lyrics, and metaphors
- Asir Saeed, Suzana Ilić, Eva Zangerle
- UGly-Net: Playful Exploration of U-Net for Glitch Effects
- Seri Lee, Eun Jee Sung, Jieun Park, Juhee Lee
- Paper Dreams: An Interactive Interface for Generative Visual Expression
- Guillermo Bernal, Lily Zhou, Haripriya Mehta, Pattie Maes
- Stylizing Audio Reactive Visuals
- Han-Hung Lee, Da-Gin Wu, and Hwann-Tzong Chen
- Breaking Speech Recognizers to Imagine Lyrics
- Jon Gillick, David Bamman
- A generative approach to Korean abstract painting Dansaekhwa
- TaeJae Han, EunJeong Kang, Jinho Bae, Junghyun Park
- Deep reinforcement learning for 2D soft body locomotion
- Junior Rojas, Stelian Coros, Ladislav Kavan
- Transform the Set: Memory Attentive Generation of Guided and Unguided Image Collages
- Nikolay Jetchev, Urs Bergmann, Gokhan Yildirim
- Neural Painters: A learned differentiable constraint for generating brushstroke paintings
- Reiichiro Nakano
- Searching for an (un)stable equilibrium: experiments in training generative models without data
- Terence Broad, Mick Grierson
- Immersions - How does music sound to artificial ears?
- Vincent Herrmann
- Game Design using Creative AI
- Anurag Sarkar
- Learned Interpolation for 3D Generation
- Austin Dill, Songwei Ge, Eunsu Kang, Chun-Liang Li, Barnabás Póczos
- Machine learning based co-creative design framework
- Brian Quanz, Wei Sun, Ajay Deshpande, Dhruv Shah, Jae-eun Park
- First Steps Towards Collaborative Poetry Generation
- David Uthus, Maria Voitovich, R.J. Mical, Ray Kurzweil
- Artist in the Cloud: Towards an Autonomous Artist
- Gene Kogan
- LucidDream: Controlled Temporally-Consistent DeepDream on Videos
- Joel Ruben Antony Moniz, Eunsu Kang, Barnabás Póczos
- Towards Sustainable Architecture: 3D Convolutional Neural Networks for Computational Fluid Dynamics Simulation and Reverse Design Workflow
- Josef Musil, Jakub Knir, Athanasios Vitsas, Irene Gallou
- Human and GAN collaboration to create haute couture dress
- Tatsuki Koga, Ema Rie, Kazuko Hirose, Jun Seita
- Towards Principled Evaluation of Creativity of Machine-Generated Art
- Lia Coleman, Panos Achlioptas, Mohamed Elhoseiny
- Location Conditional Image Generation using Generative Adversarial Networks
- Mayur Saxena, Aidan Gomez, Yarin Gal
- MidiMe: Personalizing a MusicVAE model with user data
- Monica Dinculescu, Jesse Engel, Adam Roberts
- Text Conditional Lyric Video Generation
- Nicholas Frosst, Jonathon Kereliuk
- A robot and comedian walk into a bar, and… AHA!
- Jamie Brew, Joseph Holt, Lalit Jain, Robert Mankoff, Liam Marshall, Robert Nowak, Rahul Parhi, Scott Sievert
- Neural Loops
- Vibert Thio, Chris Donahue
- Dialog on a canvas with a machine
- Vivien Cabannes, Tina Campana, Charly Ferrandes, Thomas Kerdreux, Louis Thiry
- GANDelve — a Visual Interface for Creative AI
- Frederik De Bleser
- Generative System to Assist the Artist in the Choice of 3D Composition for a Still Life Painting
- Guido Salimbeni, Frederic Fol Leymarie, William Latham
- cFineGAN: Unsupervised multi-conditional fine-grained image generation
- Gunjan Aggarwal, Abhishek Sinha
Organisers
Luba Elliott, AI Curator
Sander Dieleman, DeepMind
Rebecca Fiebrink, Goldsmiths University of London
Adam Roberts, Magenta, Google Brain
Jesse Engel, Magenta, Google Brain
Tom White, Victoria University of Wellington
Christine Payne, OpenAI
Parag K. Mital, HyperSurfaces, Mogees, Ltd
Nao Tokui, Keio University