A LEARNED REPRESENTATION FOR ARTISTIC STYLE
Vincent Dumoulin, Jonathon Shlens, Manjunath Kudlur
ICLR 2017
Abstract
construct a single, scalable deep network that can parsimoniously capture the artistic style of a diversity of paintings by reducing a painting to a point in an embedding space
Introduction
pastiche: an artistic work that imitates the style of another one
automate pastiche/style transfer: render an image in the style of another one
traditional methods: “grow” textures one pixel at a time using non-parametric sampling of pixels in an examplar image → → “growing” textures one patch at a time → → …
machine learning methods: neural style(expensive) → → feedforward style transfer network (the style transfer network is tied to a single style)
solution: conditional instance normalization(reduces each style image into a point in an embedding space)
STYLE TRANSFER WITH DEEP NETWORKS
style transfer: finding a pastiche image p p whose content is similar to that of a content image
but whose style is similar to that of a style image s s (high-level features in classifiers tend to correspond to higher levels of abstractions for visualizations)
content similarity: distance between high-level features extracted by a trained classifier
style similarity: distance between Gram matrices