Deep Neural Network – Learning to draw

An interesting feature of Deep Neural Networks is their ability to tend to a simplified image using few neurons and many layers… Watch this CNN training evolution giving birth to AI artistic painting !

Using sugarcube’s Deep Learning API :

CNN cnn = new CNN(1, 1, xy.length);
for (int i = 0; i< 11; i++)
  cnn.addFull(16, CNN.RELU);
cnn.addRegression(3);

CNNTrainer trainer = cnn.trainer();
trainer.method = CNNTrainer.SGD;
trainer.learningRate = 0.01;
trainer.momentum = 0.3;
trainer.batchSize = 1;
trainer.l2Decay = 0;
trainer.reset();

CNN cnn = new CNN(1, 1, xy.length);

for (int i = 0; i< 11; i++)

cnn.addFull(16, CNN.RELU);

cnn.addRegression(3);

CNNTrainer trainer = cnn.trainer();

trainer.method = CNNTrainer.SGD;

trainer.learningRate = 0.01;

trainer.momentum = 0.3;

trainer.batchSize = 1;

trainer.l2Decay = 0;

trainer.reset();

Post written by Jean-Luc Bloechle