在这里插入图片描述

摘要:

在这里插入图片描述

论文框架图:

在这里插入图片描述

TPFR模块:

在这里插入图片描述

论文地址:

CVPR

代码地址:

Two-Stage Peer-Regularized Feature Recombination for Arbitrary Image Style Transfer

Introduction中一些感觉有用的内容(个人喜好):
NST has seen a tremendous growth within the deep learning community and spans a wide spectrum of applications e.g. converting time-of-day, mapping among artwork and photos, transferrring facial expressions, transforming animal species, etc.
The original formulation of Gatys et al. requires a new optimization process for each transfer performed, making it impractical for many real-world scenarios. In addition, the method relies heavily on pre-trained networks which are for classification tasks. The pre-trained networks have recently been shown to be baised toward texture rather than structure.
To overcome the first limitation, deep neural networks have been proposed to approximate the length optimization procedure in a single feed forward step thereby making the models amenable for realtime processing. Of notable mention in this regard are the works of Johnson et al. and Ulyanov et al.
When a nerual network is used to overcome the computation burden of Gatys, training of a model for every desired style image is required due to the limited-capacity of conventional models in encoding multiple styles into the weights of the network. This greatly narrows down the applicability of the method for use cases where the concept of style cannot be defined a-priori and needs to be inferred from examples. Recent works attempted to separate style and content in feature space (latent space) to allow generalization to a style characterized by an additional input image, or set of images. The modst widespread work in this family is AdaIN. The current state of the art allows to control the amount of stylization applied, interpolating between different styles, and using masks to convert different regions of image into different styles (AdaIN and Avatarnet).

Logo

开放原子开发者工作坊旨在鼓励更多人参与开源活动,与志同道合的开发者们相互交流开发经验、分享开发心得、获取前沿技术趋势。工作坊有多种形式的开发者活动,如meetup、训练营等,主打技术交流,干货满满,真诚地邀请各位开发者共同参与!

更多推荐