Difference between revisions of "NN Cluster"

From Software Studies
Jump to navigation Jump to search
 
(28 intermediate revisions by 3 users not shown)
Line 1: Line 1:
NN Cluster refers to one of the many machine learning techniques called neural network and clustering. NN Cluster is an interdisciplinary initiative by early career researchers from Aarhus University in critical technical practices, posthumanities, software studies, artistic practice, digital methods and curating. Founded by artist-researcher [http://pure.au.dk/portal/en/persons/winnie-soon(061827be-c4d8-4af0-a301-835512c973e2).html Winnie Soon], curator-researcher [http://pure.au.dk/portal/en/persons/id(26ad7070-06a8-4ca4-acc1-4c04a405662c).html Magda Tyzlik-Carver] and researcher [https://pure.au.dk/portal/en/persons/pablo-rodrigo-velasco-gonzlez(7913563c-5470-47b2-be68-03ca1fd9d527).html Pablo Velasco] the goal of NN Cluster is to diversify ai practices by introducing, testing, developing, disseminating,  non-heterogenous practices of working with and researching ai and ml in the context of arts and humanities. While there is an extensive interest in researching AI/ML, and some concerns about the diversity of inputs that populate/feed its dynamics, a need for a non-heterogenous/interdisciplinary/crtical approach is essential.
NN Cluster refers to one of the many machine learning techniques called neural network and clustering. NN Cluster is an interdisciplinary initiative by early career researchers interested in critical machine learning in the realm of critical technical practices, posthumanities, software studies, artistic practice, digital methods and curating. Founded by artist-researcher [http://pure.au.dk/portal/en/persons/winnie-soon(061827be-c4d8-4af0-a301-835512c973e2).html Winnie Soon], curator-researcher [http://pure.au.dk/portal/en/persons/id(26ad7070-06a8-4ca4-acc1-4c04a405662c).html Magda Tyzlik-Carver] and researcher [https://pure.au.dk/portal/en/persons/pablo-rodrigo-velasco-gonzlez(7913563c-5470-47b2-be68-03ca1fd9d527).html Pablo Velasco] from Aarhus University the goal of NN Cluster is to diversify ai practices by introducing, testing, developing, disseminating,  non-heterogenous practices of working with and researching ai and ml in the context of arts and humanities. While there is an extensive interest in researching AI/ML, and some concerns about the diversity of inputs that populate/feed its dynamics, a need for a non-heterogenous/interdisciplinary/critical approach is essential.


===Projects===
===Projects===
A number of different projects are a part of this cluster including:
A number of different projects are a part of this cluster including:
      
      
* '''Critical Machine Learning and Technical Practice''' (Winnie Soon): Through examining various (big) datasets, tinkering with open source code libraries, writing computer code and constructing creative artworks/design, this project/study aims to develop an aesthetic and critical inquiry method to understand, analyze and reflect upon the material infrastructure and processes of machine learning, exploring the aesthetic possibilities and examining the implications of machine learning in wider computational culture.  
* '''Critical Machine Learning and Computational Practice''' (Winnie Soon): Through examining various (big/small) datasets, tinkering open source code libraries and software, writing computer code, experimenting neural network models, reading technical specification and data science books, constructing creative artworks/design, this project examines how creative, artistic and computational practices of machine learning can contribute to knowledge production, examining artificial sensing, material infrastructure, computational processes and operations of machine learning that explore the aesthetic potential, expose how machines sense, make artificial sense of the world and entail the implications of machine learning in wider computational culture.  


* '''Unerasable text''' (Winnie Soon): This is an art project working with the big Chinese dataset of the Social Media, Weibo (around 10m posts), through utilizing natural language processing and recurrent neural network to inquire the automated practice of internet censorship.  
* '''Unerasable Characters''' (Winnie Soon): This is an art project working with the big Chinese dataset from [http://weiboscope.jmsc.hku.hk/ Weiboscope], developed by [https://jmsc.hku.hk/2016/03/weiboscope/ Journalism and Media Studies Centre, The University of Hong Kong], on erased and censored text (around 10m posts with 25 GB file size). Through utilizing natural language processing and recurrent neural network, this project inquires the automated practice of internet censorship, examining questions around the poetics of erasure, authorship, control, automated censorship and labor practices.  


* '''Posthuman curating/and Affect Data Bodies'''  (Magda Tyzlik-Carver) - Posthuman curating is a project that investigates the relation betwen affect data and bodies in contermporary culture increasingly organised by practices of automation, machine learning, neural networks and user participation in social media and increasing use of affective features employed for computation. Recognising how practice of curating has been automated and distributed across human and nonhuman actors (Tyzlik-Carver 2016, 2018) the focus of this investigation is on neural networks as an organising principle in organising information and data, be it digital, biological or analogue. Posthuman curating as part of NN Cluster proposes a series of seminars on the subject where scholars, professionals and artists are invited to present their practices of data curating with the use of machine learning technologies.  
* '''Posthuman curating and AI'''  (Magda Tyzlik-Carver): this research project investigates the increasing automation of curatorial function. Sites for curatorial activities change from art and cultural spaces of galleries, museums and libraries and they now conglomerate around social media platforms such as Facebook, Instagram, SnapChat and others. Also curating is no longer an activity performed by humans but it is regularly an algorithmic function that sorts, selects and serves content and data as machine learning algorithm, neural network function and other forms of ai processing. Recognising how practice of curating has been automated and distributed across human and nonhuman actors (Tyzlik-Carver 2016, 2018) the focus of this investigation is on neural networks as an organising principle behind information and data processing as a form of posthuman curating.
 
* '''Affect Data Bodies'''  (Magda Tyzlik-Carver) - is an inquiry into the relations between data and bodies. The focus is on analyses of critical artistic projects that use different forms of ai, machine learning and neural networks for processing and creation of visual, textual, aural and other forms of digital objects. The leading questions are how bodies are mapped and represented computationally and how these artistic methods differ and/or problematize standard techniques of data collection and training for neural networks.  


* '''Procedural Generation as mode of production''' (Pablo Velasco): Artificial Intelligence (AI) techniques are progressively used to sort complex tasks among big data sets. The AI branch of Procedural Generation (PG) works in the opposite way: it exploits randomness and permutations to generate large amounts of data from a relatively small input. This study observes examples of PG among the entretainment industry and digital cultures, to unravel how PG techniques are used to generate a perception of "infinity" through computation. The study is interested in citically engaging the outsourcing of design and production activities to computation, and in researching the ways in which randomness is operationalised through AI, and how this rearticulates notions of agency, accountability, and logics of rationality.
* '''Procedural Generation as mode of production''' (Pablo Velasco): Artificial Intelligence (AI) techniques are progressively used to sort complex tasks among big data sets. The AI branch of Procedural Generation (PG) works in the opposite way: it exploits randomness and permutations to generate large amounts of data from a relatively small input. This study observes examples of PG among the entretainment industry and digital cultures, to unravel how PG techniques are used to generate a perception of "infinity" through computation. The study is interested in citically engaging the outsourcing of design and production activities to computation, and in researching the ways in which randomness is operationalised through AI, and how this rearticulates notions of agency, accountability, and logics of rationality.
Line 17: Line 19:
   [http://www.galleriimage.dk/index.php/en/component/rseventspro/event/257-screenshots-desire-and-automated-image Screenshots: Desire and Automated Images]
   [http://www.galleriimage.dk/index.php/en/component/rseventspro/event/257-screenshots-desire-and-automated-image Screenshots: Desire and Automated Images]
* Hosting workshop:  
* Hosting workshop:  
   [http://darc.au.dk/blog/nyhed/artikel/2-day-workshop-experimental-creative-writing-with-natural-language-processing-by-allison-parris/ Experimental Creative Writing with Natural Language Processing] by Allison Parrish
   [http://darc.au.dk/blog/nyhed/artikel/2-day-workshop-experimental-creative-writing-with-natural-language-processing-by-allison-parris/ Experimental Creative Writing with Natural Language Processing] by Poet-programmer Allison Parrish from NYU Tisch School of the Arts
* Hosting performance:
* Hosting performance:
   [https://www.kunsthalaarhus.dk/en/Events/Screen-Shots-Desire-And-Automated-Image Performance Drawing with Sound] by Anna Ridler
   [https://www.kunsthalaarhus.dk/en/Events/Screen-Shots-Desire-And-Automated-Image Performance Drawing with Sound] by Anna Ridler
* Hosting talks:
* Hosting talks:
   [http://cs.au.dk/research/centers/cfem/news/show/artikel/pit-talk-by-rebecca-fiebrink-on-machine-learning-as-creative-interaction-design-tool/ Machine Learning as Creative Interaction Design Tool] by Rebecca Fiebrank  
   [http://cs.au.dk/research/centers/cfem/news/show/artikel/pit-talk-by-rebecca-fiebrink-on-machine-learning-as-creative-interaction-design-tool/ Machine Learning as Creative Interaction Design Tool] by Computer Scientist and musician Rebecca Fiebrank from Goldsmiths, University of London
   [https://kunsthalaarhus.dk/en/Events/Screen-Shots-With-Rosa-Menkman-And-Mario-Klingeman Instruments of Creation (Neurography)] by Mario Klingemann
   [https://kunsthalaarhus.dk/en/Events/Screen-Shots-With-Rosa-Menkman-And-Mario-Klingeman Instruments of Creation (Neurography)] by Mario Klingemann
* Panels at conferences
* Panels at conferences
   Hard Feelings: Conversation on Computation and Affect at Transmediale festival (2017)
   Hard Feelings: Conversation on Computation and Affect at Transmediale festival (2018)


===International networks===
===International networks===
Line 42: Line 44:
* Digital Culture (MA 10 ECTS)
* Digital Culture (MA 10 ECTS)
* Developing Social Interactions for the Mobile Web (MA 10 ECTS)
* Developing Social Interactions for the Mobile Web (MA 10 ECTS)
* MA thesis supervision: The Ethical Importance of Feedback for Machine Learning Algorithms  (Kristjan Maalt, 2018) - completed.


===Publications===
===Publications===
* Automating Desire (forthcoming book in Data Browser series)  
* Automating Desire (forthcoming book project related to Screenshots: Desire and Automated Image)  
* Soon, W & Cox, G., (Forthcoming) Aesthetic Programming: A handbook for Software Studies. Open Humanities Press.
* Soon, W., (2019) ‘The (un)predictability of Text-Based Processing in Machine Learning Art‘. Proceedings of Art Machines: International Symposium on Computational Media Art.
* Soon, W., (2019) ‘The (un)predictability of Text-Based Processing in Machine Learning Art‘. Proceedings of Art Machines: International Symposium on Computational Media Art.


===Resources===
===Resources===
*[http://softwarestudies.projects.cavi.au.dk/index.php/Machine_Learning_Experiments Machine Learning Experiments]
*[http://softwarestudies.projects.cavi.au.dk/index.php/Machine_Learning_Experiments Machine Learning Experiments]

Latest revision as of 16:14, 19 August 2019

NN Cluster refers to one of the many machine learning techniques called neural network and clustering. NN Cluster is an interdisciplinary initiative by early career researchers interested in critical machine learning in the realm of critical technical practices, posthumanities, software studies, artistic practice, digital methods and curating. Founded by artist-researcher Winnie Soon, curator-researcher Magda Tyzlik-Carver and researcher Pablo Velasco from Aarhus University the goal of NN Cluster is to diversify ai practices by introducing, testing, developing, disseminating, non-heterogenous practices of working with and researching ai and ml in the context of arts and humanities. While there is an extensive interest in researching AI/ML, and some concerns about the diversity of inputs that populate/feed its dynamics, a need for a non-heterogenous/interdisciplinary/critical approach is essential.

Projects

A number of different projects are a part of this cluster including:

  • Critical Machine Learning and Computational Practice (Winnie Soon): Through examining various (big/small) datasets, tinkering open source code libraries and software, writing computer code, experimenting neural network models, reading technical specification and data science books, constructing creative artworks/design, this project examines how creative, artistic and computational practices of machine learning can contribute to knowledge production, examining artificial sensing, material infrastructure, computational processes and operations of machine learning that explore the aesthetic potential, expose how machines sense, make artificial sense of the world and entail the implications of machine learning in wider computational culture.
  • Unerasable Characters (Winnie Soon): This is an art project working with the big Chinese dataset from Weiboscope, developed by Journalism and Media Studies Centre, The University of Hong Kong, on erased and censored text (around 10m posts with 25 GB file size). Through utilizing natural language processing and recurrent neural network, this project inquires the automated practice of internet censorship, examining questions around the poetics of erasure, authorship, control, automated censorship and labor practices.
  • Posthuman curating and AI (Magda Tyzlik-Carver): this research project investigates the increasing automation of curatorial function. Sites for curatorial activities change from art and cultural spaces of galleries, museums and libraries and they now conglomerate around social media platforms such as Facebook, Instagram, SnapChat and others. Also curating is no longer an activity performed by humans but it is regularly an algorithmic function that sorts, selects and serves content and data as machine learning algorithm, neural network function and other forms of ai processing. Recognising how practice of curating has been automated and distributed across human and nonhuman actors (Tyzlik-Carver 2016, 2018) the focus of this investigation is on neural networks as an organising principle behind information and data processing as a form of posthuman curating.
  • Affect Data Bodies (Magda Tyzlik-Carver) - is an inquiry into the relations between data and bodies. The focus is on analyses of critical artistic projects that use different forms of ai, machine learning and neural networks for processing and creation of visual, textual, aural and other forms of digital objects. The leading questions are how bodies are mapped and represented computationally and how these artistic methods differ and/or problematize standard techniques of data collection and training for neural networks.
  • Procedural Generation as mode of production (Pablo Velasco): Artificial Intelligence (AI) techniques are progressively used to sort complex tasks among big data sets. The AI branch of Procedural Generation (PG) works in the opposite way: it exploits randomness and permutations to generate large amounts of data from a relatively small input. This study observes examples of PG among the entretainment industry and digital cultures, to unravel how PG techniques are used to generate a perception of "infinity" through computation. The study is interested in citically engaging the outsourcing of design and production activities to computation, and in researching the ways in which randomness is operationalised through AI, and how this rearticulates notions of agency, accountability, and logics of rationality.

Activities we have done

  • Curating Exhibition at Image Galleri
  Screenshots: Desire and Automated Images
  • Hosting workshop:
  Experimental Creative Writing with Natural Language Processing by Poet-programmer Allison Parrish from NYU Tisch School of the Arts
  • Hosting performance:
  Performance Drawing with Sound by Anna Ridler
  • Hosting talks:
  Machine Learning as Creative Interaction Design Tool by Computer Scientist and musician Rebecca Fiebrank from Goldsmiths, University of London 
  Instruments of Creation (Neurography) by Mario Klingemann
  • Panels at conferences
  Hard Feelings: Conversation on Computation and Affect at Transmediale festival (2018)

International networks

  • Co-organizing and contributing to Transmediale research wokshops on Machine Feeling (2019) and Machine Research (2017)
  • Co-organising a panel 'Unthinking Photography: cultural value and the networked image' for "Ways of Machine Seeing 2017" organized by the Cambridge Digital Humanities Network, and CoDE (Cultures of the Digital Economy Research Institute) and Cambridge Big Data

Teaching NN/ML/AI related topics in higher education

  • Digital Aesthetics (MA 20 ECTS)
  • Software Studies (BA 10 ECTS)
  • Aesthetic Programming (BA 20 ECTS)
  • Digital Culture (MA 10 ECTS)
  • Developing Social Interactions for the Mobile Web (MA 10 ECTS)
  • MA thesis supervision: The Ethical Importance of Feedback for Machine Learning Algorithms (Kristjan Maalt, 2018) - completed.

Publications

  • Automating Desire (forthcoming book project related to Screenshots: Desire and Automated Image)
  • Soon, W & Cox, G., (Forthcoming) Aesthetic Programming: A handbook for Software Studies. Open Humanities Press.
  • Soon, W., (2019) ‘The (un)predictability of Text-Based Processing in Machine Learning Art‘. Proceedings of Art Machines: International Symposium on Computational Media Art.

Resources