Lately, GANs (Generative Adversarial Networks) have been really successful in creating interesting content that are fairly abstract and hard to create procedurally. This paper, aptly named (Creative , instead of Generative, Adversarial Networks) explores the possibility of machine generated content. CAN creative The original paper can be found here This article assumes familiarity with neural networks , and essential aspects of them, including Loss Functions and Convolutions. How this article is structured I will follow the paper’s structure as much as I can. I will add my own bits to help better understand the material. GAN Recap GAN’s consists of two competing neural networks, namely the and the . As is suggestive of the name, the Generator is responsible for generating data from some input (this input can be noise or even some other data). The discriminator is then responsible for analysing that data and wether that data was real(if it came from our dataset) or if its fake(if it came from the ) Formally, it can be seen as a minimax game played by the and the like so: Generator Discriminator discriminating generator . Generator Discriminator Equation 1.0 RELAX! If the above equation was too complex for you, you are not alone. I will go through this equation step by step and explain what each component means. Equation 1.1 This is the notation for the The G and D subscripts stand for enerator and iscriminator respectively. It is the Generator’s job to mise the value of Equation 1.0 , while it is the Discriminator’s job to imise it. They both compete with each other endlessly(till we decide to stop). MiniMax Equation . G D Mini Max Equation 1.2 The output of Discriminator for data it thought were real , when given input ( is data from our real dataset). x x Equation 1.3 This calculates how the discriminator did on the input from the generator. denotes the that the were . Doing denotes the data the discriminator thought were NOT real. Denotes the data generated by the generator. D(G(z)) data discriminator thought real 1- D(G(z)) G(z) Putting it all together , its the Discriminator’s job to make value of Equation 1.4 As large as possible, while it is the Generator’s job to make the value of Equation 1.4 as small as possible by Maximizing the value of Equation 1.5 A more detailed explanation can be found at http://wiki.ubc.ca/Course:CPSC522/Generative_Adversarial_Networks Intuitive definition The Generator will try to modify itself to make the Discriminator pass its own creation as real, while the Discriminator will modify itself to be able to continue telling the difference. But isn’t this just plain imitation ? Yes it is! Note that it is the generator’s objective to fool the Discriminator into thinking that the data it generated matches the real data as much as possible. So whats the best way to do it? ! To make it’s outputs look very much like the real data This is a problem if you want your to be Your generator will not learn to create content, but it will just try to make its output look like the real data. network creative. new Solution? Creative Adversarial Networks The authors propose a modified GAN to generate creative content. They propose sending to the to it from that is to existing content. How did they do it? They modified the oritinal GAN loss function from Equation 1.4. an additional signal generator prevent generating content too similar Intuitive explain of CAN In the original GAN, the generator modifies its weights based on the discriminator’s output of wether or not what it generated was able to fool the discriminator. CAN extends this in two ways: The discriminator will not only discriminate if it thinks the data is real or fake, but will which the artwork belongs to. additionally also classify time period The Generator will take in the additional information about the time period from the discriminator , and use that metric along with real/fake input from the Discriminator. What is the point of doing this? The original problem of GAN was they would not explore new work. Their objective is literally to just make their data look like it came from real dataset. By having an which classifies the time period the data belongs to(along with the confidence), the generator is now getting feedback on how similar it’s creation looks to some time period. additional metric Now, the generator not only has to make its data look similar to dataset, but also make sure it doesn’t look too similar to a single category. This will allow it to prevent creating artwork that has very specific characteristics. The new loss function is: Equation 2.0 Its really simple! The first line is exactly the same as the original equation. Note that the subscript r means the discriminator’s output of real/fake, and the subscript c is the output of the discriminator’s classsification. The 2nd line is the modification for promoting creativitity. I will explain it step by step. Equation 2.1 This is the Discriminator getting the class of the input image correctly. The Discriminator will try to maximize this value. We want the discriminator to classify the images correctly. Equation 2.2 This may look complicated , but this is just the .Note that K here denotes the number of classes. You can find the detailed information about losses . This is the same loss that use as a loss function. The generator will try to minimize this value in order to maximise Equation 2.0. Multi Label Cross Entropy Loss here classifiers Intuitive explanation of Equation 2.2 The way that Equation 2.2 works is , if the value of one of the classes score approaches 1 or 0 , the value of the whole equation approaches -infinity. The largest possible value(larger is what the generator wants) that Equation 2.2 can take is when the discriminator is completely unsure about what class the input belongs to, i.e. every term in the summation has the same value. because its not possible to properly classify the input image into existing classes, so it must mean that it is its own new class. This makes sense Conclusion This paper talks about a loss function that pushes a GAN into exploring new content based on what is given to it. This was done by modifying the loss function to allow for exploration. P.S. This was my first technical post. Criticism and improvement tips are welcome and greatly appreciated. If you learned something useful from my article, please share it with others by tapping on the ❤. It lets me know I was of help.

Too Long; Didn't Read

In your car, at home, or at work — Bosch technology shapes many areas of life.

CAN (Creative Adversarial Network) — Explained

Too Long; Didn't Read

Harshvardhan Gupta

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

CAN (Creative Adversarial Network) — Explained

Too Long; Didn't Read

Harshvardhan Gupta

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

RELATED STORIES