一、时间序列
1. Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
abstract
In this paper we compare different types of recurrent units in recurrent neural networks (RNNs). Especially, we focus on more sophisticated units that implement a gating mechanism, such as a long short-term memory (LSTM) unit and a recently proposed gated recurrent unit (GRU). We evaluate these recurrent units on the tasks of polyphonic music modeling and speech signal modeling. Our experiments revealed that these advanced recurrent units are indeed better than more traditional recurrent units such as tanh units. Also, we found GRU to be comparable to LSTM.
摘要:
本文比较了递归神经网络(RNN)中不同类型的递归单元。特别是,我们关注实现门控机制的更复杂的单元,例如长短期记忆(LSTM)单元和最近提出的门控循环单元(GRU)。我们在复调音乐建模和语音信号建模任务中评估这些重复单元。我们的实验表明,这些先进的循环单元确实优于更传统的循环单元,如tanh单元。此外,我们发现GRU与LSTM相当。
@article{2014Empirical,
title={Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling},
author={ Junyoung Chung and Caglar Gulcehre and KyungHyun Cho and Yoshua Bengio },
journal={Eprint Arxiv},
year={2014},
url={https://arxiv.org/abs/1412.3555},
}
二、多层网络
2.1 The structure and dynamics of multilayer networks
abstract = {In the past years, network theory has successfully characterized the interaction among the constituents of a variety of complex systems, ranging from biological to technological, and social systems. However, up until recently, attention was almost exclusively given to networks in which all components were treated on equivalent footing, while neglecting all the extra information about the temporal- or context-related properties of the interactions under study. Only in the last years, taking advantage of the enhanced resolution in real data sets, network scientists have directed their interest to the multiplex character of real-world systems, and explicitly considered the time-varying and multilayer nature of networks. We offer here a comprehensive review on both structural and dynamical organization of graphs made of diverse relationships (layers) between its constituents, and cover several relevant issues, from a full redefinition of the basic structural measures, to understanding how the multilayer nature of the network affects processes and dynamics.}
@article{2014The,
title = {The structure and dynamics of multilayer networks},
journal = {Physics Reports},
volume = {544},
number = {1},
pages = {1-122},
year = {2014},
note = {The structure and dynamics of multilayer networks},
issn = {0370-1573},
doi = {https://doi.org/10.1016/j.physrep.2014.07.001},
url = {https://www.sciencedirect.com/science/article/pii/S0370157314002105},
author={ Boccaletti, S. and Bianconi, G. and Criado, R. and Genio, Cid and J Gómez-Gardeñes and Romance, M. and I Sendiña-Nadal and Wang, Z. and Zanin, M.},
}