Text Style Transfer论文笔记

 

Text Style Transfer主要是指Non-Parallel Data条件下的,具体的paper list见: https://github.com/fuzhenxin/Style-Transfer-in-Text

 

Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfer (NAACL 2018)

Transforming a sentence to alter a specific attribute while preserving its attribute-independent content.

Training data includes only sentences labeled with their attribute, but not pairs of sentences that differ only in their attributes

Our strongest method extracts content words by deleting phrases associated with the sentence's original attribute value, retrieves new phrases associated with the target attribute, and use a neural model to fluently combine these into a final output.

Training:

For DELETEONLY:

Reconstruct the sentences in the training corpus given their content and original attribute value by maximizing:

For DELETEANDRETRIEVE: apply some noise to a(x, vsrc) to produce a'(x, vsrc)

这篇文章采用Reconstruct的方法来训练模型生成风格化的描述。

 

 

Unsupervised Controllable Text Formalization (AAAI 2019)

The crux of the framework is a deep neural encoder-decoder that is reinforced with text-transformation knowledge through auxiliary modules (called scorers)

 

 

 

 

Style Transformer: Unpaired Text Style Transfer without Disentangled Latent Representation (ACL 2019)

Transfomer Network

To enable style control in the standard Transformer framework, add an extra style embedding as input to the Transformer encoder

z stands for the representation of the encoded inputs

Discriminator Network

Conditional Discriminator: a sentence x and a proposal style s are feed into discriminator and the discriminator is asked to answer whether the input sentence has the corresponding style.

Multi-class Discriminator: only one sentence is feed into the discriminator, and the discriminator aims to answer the style of this sentence.

Learning Algorithm

Discriminator Learning:

conditional discriminator

multi-class discriminator

Transformer Network Learning:

Self Reconstruction

Cycle Reconstruction

Style Controlling

转载于:https://www.cnblogs.com/czhwust/p/10969988.html

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值