语句的向量表示方法——单词向量组合…

目标：本文讨论单词向量的组合方式（composition of word vectors），一般指两个单词向量的组合方式，使得输出的新的向量能够表达组合后的短语的语义。

本文使用符号：

u,v：普通的单词向量(u_1,u_2,u_3)和(v_1,v_2,v_3)；

p:需要求出的目标短语的向量；

R：一个表征语法关系的矩阵；

K：世界知识等其他非单词语义、语法关系构成的信息；

词语组合的一些假想：

1、整体的含义是一个以部分作为自变量的函数的输出（The meaning of a whole is a function of the meaning of the parts. ）

2、整体的含义是一个以部分、以及相应的语法规则作为输入的函数（The meaning of a whole is a function of the meaning of the parts and of the way they are syntactically combined.）

3、除了上述输入之外，还应添加其他而外的信息作为输入

实现上述论断的主要困难是对于一个具体的短语，很难判断使用什么方程来进行组合（There is the fundamental difficulty of specifying what sort "function of the meanings of the parts" is involved in semantic composition.）。

为了降低困难，可以认为组成短语的单词保持了独立性，适用于这些单词的规则在这些单词出现在其他短语中时也适用。（ systematicity: The ability to understand some sentences is intrinsically connected to the ability to understand certain others. In other words, if one understands some sentence and the rules that govern its construction, one can understand a different sentence made up of the same elements according to the same set of rules. In combing parts to form a whole, the parts remain independent and maintain their identities.）当然这种假设和上文提到的Frege (1884)的论断是矛盾的。

论断三是目前普遍接受的假设，但也并不是无懈可击的。像固定搭配、成语等，是不能从单个词语的含义推断出整体的含义的，这和论断1是完全矛盾的（The difficulty in defining compositionality is highlighted by Frege (1884) himself who cautions never to ask for the meaning of a word in isolation but only in the context of a statement. In other words, it seems that the meaning of the whole is constructed from its parts, and the meaning of the parts is derived from the whole.  Linguistic structures range from fully compositional (e.g., black hair), to partly compositional syntactically f