Difference between revisions of "Machine Learning Experiments"

From Software Studies
Jump to navigation Jump to search
 
(4 intermediate revisions by the same user not shown)
Line 49: Line 49:
===Mixed media (text/image)===
===Mixed media (text/image)===
* [https://ml5js.org/ ML5.js library] developed by NYU ITP, text training tutorial [https://blog.paperspace.com/training-an-lstm-and-using-the-model-in-ml5-js/ here]
* [https://ml5js.org/ ML5.js library] developed by NYU ITP, text training tutorial [https://blog.paperspace.com/training-an-lstm-and-using-the-model-in-ml5-js/ here]
* [https://scikit-learn.org/stable/ scikit-learn]: Machine Learning in Python


===Text related===
===Text related===
Line 62: Line 63:


===Image related===
===Image related===
* [TensorFlow.js Coco SSD's model object detection](https://github.com/juandes/tensorflowjs-objectdetection-tutorial)by Juan De Dios Santos
* Image paint: 1/ [http://cs.stanford.edu/people/karpathy/convnetjs/ ConvNetJS Library] by Andrej Karpathy 2/ [http://caza.la/synaptic/#/paint-an-image Synaptic.js] by Synaptic
* Image paint: 1/ [http://cs.stanford.edu/people/karpathy/convnetjs/ ConvNetJS Library] by Andrej Karpathy 2/ [http://caza.la/synaptic/#/paint-an-image Synaptic.js] by Synaptic
* [https://affinelayer.com/pixsrv/index.html Image-to-Image Demo: Interactive Image Translation with pix2pix-tensorflow] by Christopher Hesse  
* [https://affinelayer.com/pixsrv/index.html Image-to-Image Demo: Interactive Image Translation with pix2pix-tensorflow] by Christopher Hesse
 
===Sound related===
===Sound related===
* [http://prostheticknowledge.tumblr.com/post/170013157626/deep-roll-project-by-tero-parviainen-generates Deep roll] by Tero Parviainen | [https://codepen.io/teropa/full/zpbLOj/ source code] built with TensorFlow and js
* [http://prostheticknowledge.tumblr.com/post/170013157626/deep-roll-project-by-tero-parviainen-generates Deep roll] by Tero Parviainen | [https://codepen.io/teropa/full/zpbLOj/ source code] built with TensorFlow and js
Line 75: Line 78:
*[https://chatbotslife.com/notes-on-remixing-noon-generative-text-and-markov-chains-84ff4ec23937 Notes on remixing Noon, generative text and Markov chains] by Rev Dan Catt
*[https://chatbotslife.com/notes-on-remixing-noon-generative-text-and-markov-chains-84ff4ec23937 Notes on remixing Noon, generative text and Markov chains] by Rev Dan Catt
===Artworks===
===Artworks===
*[http://runme.org/categories/+artificial_intelligence/ AI projects in software art repository/runme.org]
*[http://concept-script.com/Errant/index.html Errant: The Kinetic Propensity of Images] by Hector Rodriguez (2018)
*[http://concept-script.com/Errant/index.html Errant: The Kinetic Propensity of Images] by Hector Rodriguez (2018)
*[https://andreasrefsgaard.dk/project/an-algorithm-watching-a-movie-trailer/ An algorithm watching a movie trailer] by Andreas Refsgaard and Lasse Korsgaard
*[https://andreasrefsgaard.dk/project/an-algorithm-watching-a-movie-trailer/ An algorithm watching a movie trailer] by Andreas Refsgaard and Lasse Korsgaard
Line 128: Line 132:


==Experiments/Tests==
==Experiments/Tests==
*01/2020: TensorFlow.js + React, object detection
[[File:objectDetection.png|none|300px|object]]
*08/2019: Runway's image to text prediction: "a collage of photos of a man on a motorcycle"  
*08/2019: Runway's image to text prediction: "a collage of photos of a man on a motorcycle"  
[[File:Runway3.png|none|300px|runway3]]
[[File:Runway3.png|none|300px|runway3]]

Latest revision as of 17:35, 12 January 2020

Introduction to Machine Learning

Cultural matters with Machine Learning

Technical explanation on Machine Learning

RNN/LSTM focus

Neural Network

Data Processing

Examples with source code

Mixed media (text/image)

Text related

Chinese text related

Image related

Sound related

Projects

Text related

Artworks

Examples/Performance/Speculative design

Exhibition

Workshop

Conference

Preconference Workshop] (2018)

Demo/Experimental Projects

Learning resource

Teaching Machine Learning

Experiments/Tests

  • 01/2020: TensorFlow.js + React, object detection
object
  • 08/2019: Runway's image to text prediction: "a collage of photos of a man on a motorcycle"
runway3
  • 08/2019: Runway's YOLACT - computer and algorithm shift our attention to something else. A lid cannot be recognized but that's the key object in the photo (ways of human seeing) actually. May be the training data contains mostly western objects.
    runway1
    runway2
  • 08/2019: Running LSTM/tensorflow with text_predictor.py and ml5 training
training both
  • 12/2018: Try running LSTM/tensorflow training on chinese text with python (again following text predictor)
weiboscope
  • 11/2018: Try running LSTM/tensorflow training with Python (following text predictor)from my PhD thesis text
PhD thesis
  • 11/2018: Try running local ml5 + python training with English text (multiple manifestos) and generate 10000 characters text from multiple manifestos
manifestos
  • 06/2018: Try running LSTM ml5js with training simplied chinese data. Source from weiboscope 2012 week 1 deleted text
weiboscope text
  • 06/2018: Running LSTM ml5js example with my own training data
Training Process
Outcome Process
  • 2018: Running ml5.js example - Simple LSTM Generator Example on a local browser
Predicting what's the text
  • Running ml5.js example - Simple Image Classification Example on a local browser
Predicting what's the image with confidence level
  • Running spam data with RecurrentJS on a local browser
Running spam data with RecurrentJS
  • Running a customized neural network on a local browser
Learning XOR with Synaptic
  • Running a PNG file with Synaptic.js on a local browser
Learning a png file with Synaptic
  • Running a jpg file with ConvNetJS on a local browser
Learning a jpg file with ConvNetJS