Pix2Pix:

Cloud Spotting

Using machine learning to mimic the past-time of Cloud Spotting.

☁️

experimental art ✔
machine learning ✔

About This Work

It uses Pix2Pix, a GAN designed for image-to-image translation, to project objects into cloud images. It forces pareidolia, the perceiving of objects or patterns in unrelated objects or patterns.

  • After Effects, Google Colab, Pix2Pix, Photoshop

  • The model is trained using an edges-to-object method. Canny edges are paired with their source image and the model learns to synthesize images based on edge image inputs.

    To mimic the phenomena of cloud watching, canny edges of objects were transposed over canny edges of cloud footage. The combined edge image was then used to generate synthesized images.