Image Generation from Layout

最新推荐文章于 2024-04-25 09:48:10 发布
最新推荐文章于 2024-04-25 09:48:10 发布
阅读量1.6k 收藏 7
点赞数 2
分类专栏： 小鬼逐梦 用 0|1 看待世界
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/WinerChopin/article/details/91493630
版权

2019年CVPR的一篇文章，原文见：Image Generation from Layout，代码见：Codes & Demo。

为了节省时间，小编这里仅放PPT的插图。完整ppt可以私我哈！

1）要解决的问题

2）任务的难点

3） 关键技术：将具体对象的表示方式解耦，分为确定性的表征基本类别的部分与不确定性的表征具体外观表现的部分。

4）合成流程（测试阶段） 

5）模型框架

### 训练机制说明
"""
在每个iteration中，对每张图像：

① crop，得到如干个object的patch，与对应的坐标Li

② 对每个patch进行resize到同样大小，输入Obj Estimator（由卷积+FC组成）得到m维潜向量，希望这个向量表征的是某一种“外观表现规则”，其是独立于类别的，不过对于不同的类别会有不同的作用法则

③ 用这个潜向量预测样式的后验分布的μ与∑，构造正态分布后从中采样（但个人认为是用这个latent vector预测系数后，直接用这个vector前馈）

④ 我们在一个已知μ与∑的先验正态分布上也随机采样得到一个表征样式的潜向量

⑤ 对两组潜向量分别前馈，先经过Obj encoder，结合类别信息、外观信息、位置信息构造特征图谱Fi，将若干个Fi经过cLSTM得到目标图像的编码，对其进行解码得到图像

⑥ 前者用于重构原图像得到I帽，后者用于新合成图像I'

⑦ 对I'同样基于GT的layout作crop得到若干个patch，输入OE得到新的外观向量；理论上，z_si'与z_si应该是一样的！

** 其中，layout信息Li与类别yi或者词向量wi是公共的；这在训练过程实现了将确定性类别与大小、位置信息，和不确定性的外观特征解耦
"""

 

1）Object Estimator的结构

2）Object Composer的结构

3） Objects Fuser的选择：需要满足一下三个条件

6）Loss函数

### 我们分别说明每个loss的作用
"""
1. KL 散度用来衡量两个概率分布之间的相似性，目的是为了让Object Estimator将给定patch的样式很好地映
射到先验分布N上；其本身预测的结果是一个后验分布，我们的目的是为了拉近其与先验分布的距离但不需要绝对
相等，可能存在某种偏移或旋转，如此，在测试阶段中，我们才可以对从正态分布N随机采样，是采得到的样本向
量可以对应到某种外观表现。

2. 作用于zs的L1正则化：理由很简单，就是用于指导给定类别wi（词向量）或者yi（类别）与Layout的外观特
征向量z_si，其合成的Object再次经过Object Estimator得到的外观特征z_si'应该是不变的。这样能够直接引
导Object Estimator将外观特征正确编码；同时有了这个“回去核查”的机制，避免了Object Estimator将不同
的外观映射到同一个编码的情形。

3. 作用于输入图像I与重构图像I'的L1正则：是为了引导后边的编码器（Object Encoder）、融合器（Object Fuser）、
解码器（Image Decoder）能够合成真实的图像。

4. 对图像的对抗损失：当然就是为了让模型合成真实的图像

5. 对objects的对抗损失：让模型合成对应类别的真实图像

6. 辅助的分类误差：模型合成的objects足够真实，分类效果能更好（但这是不一定的，因为计算机对图像的理解是更加抽象的。）
"""

 

7）结果

 

萧班
关注
  • 2
    点赞
  • 踩
  • 7
    收藏
    觉得还不错? 一键收藏
  • 10
    评论
专栏目录
Image Generation from Scene Graphs 论文解读
weixin_43551972的博客
10-13 1337
论文链接: https://arxiv.org/abs/1804.01622. GitHub代码: https://github.com/google/sg2im. 对于文本生成图片（Text-to-Image）的任务，如果一开始将scene layout（场景布局）作为中间媒介，连接text domain 和 image domain，将会取得很好的结果。但是这个想法实现起来需要很多方面难题要解...
Image Generation from Scene Graph
weixin_43654661的博客
04-20 399
写一点看过的论文和code的感悟 首先看一下论文的总体实现： 我觉得这个模型与传统模型主要的两个创新点就是Graph Convolution和Cascaded Refinement Network Graph Convolution 按论文上说，他处理scene graph 是通过graph的边来传递信息的，也就是所本来一个单词向量(obj_vecs)代表graph中的一个节点对象，但是通过图卷...
LTE from A to Z
05-11
著名培训机构的LTE培训教材。 深入浅出，从基本概念到深入描述。是一份比较全面的教材。全文367页。有料有内容。是一份难得的教材。 文件比较大，所以拆成3部分。这是part3 LTE from A-Z Technology and Concepts of the 4G 3GPP Standard Table of Content Principles and Motivation of LTE............................................1 1.1 Mobile Radio: Comparison between 3G and 4G..................2 1.1.1 Performance and Mobility Management related Issues..............2 1.1.2 Architecture related Issues..........................................................4 1.1.3 Procedure and Radio related Issues...........................................6 1.2 Requirements on LTE............................................................8 1.2.1 General Requirements................................................................8 1.2.1.1 Support of Enhanced Quadruple Play Services............................10 1.2.1.2 Very High Data Rates @ flexible bandwidth deployment ((1.25) 5 – 20 MHz).....................................................................................................10 1.2.1.3 AIPN and PS services only............................................................10 1.2.2 Important Characteristics of LTE Physical Layer.......................12 1.2.2.1 General Physical Layer Characteristics.........................................12 1.2.2.1.1 OFDM ..................................................................................12 1.2.2.1.2 Scalable Bandwidth..............................................................13 1.2.2.1.3 Smart Antenna Technology..................................................14 1.2.2.1.4 Fast scheduling and AMC.....................................................14 1.2.2.1.5 No Soft(er) handover............................................................14 1.2.3.2 OFDM/OFDMA..............................................................................16 1.2.3.2.1 Traditional narrowband communication................................16 1.2.3.2.2 Problems for wideband signals.............................................17 1.2.3.2.3 OFDM...................................................................................17 1.2.3.2.4 OFDM and OFDMA..............................................................17 1.2.3.2.5 LTE and OFDM.....................................................................17 1.2.3.3 Smart Antenna Technology in LTE................................................18 1.2.3.3.1 Categorization of Smart Antenna Technologies...................18 1.2.3.3.1.1 SISO.............................................................................18 1.2.3.3.1.2 SIMO............................................................................18 1.2.3.3.1.3 MISO............................................................................19 1.2.3.3.1.4 MIMO...........................................................................19 1.2.3.3.2 Multiple Input Multiple Output (MIMO)..................................20 1.2.3.3.2.1 Multiple carrier technology...........................................21 1.2.3.3.2.2 MIMO...........................................................................21 1.2.3.3.3 Adaptive Antenna Systems (AAS)........................................22 1.2.3.3.3.1 Signal generation.........................................................23 1.2.3.3.3.2 Constructive superimposition at the intended receiver 23 1.2.3.3.3.3 Destructive superimposition at the not intended receiver .......................................................................................................23 1.2.3.3.3.4 Generation of signals for multiple UE’s........................23 1.2.3.4 Macro Diversity exploitation by SFN..............................................24 1.2.3.4.1 Requirements for MBMS services........................................24 1.2.3.4.2 MBMS operation with a SFN.................................................24 1.2.3.4.3 SFN for point to point services..............................................25 1.2.3.5 The Frequency Bands Intended for LTE.......................................26 1.2.3.5.1 Exclusive usage....................................................................27 1.2.3.5.2 Refarming.............................................................................27 1.2.3.5.3 Licensed operation................................................................27 1.2.3.5.4 Unlicensed operation............................................................27 1.2.3.6 Flexible Bandwidths, Parameters..................................................28 1.2.3.6.1 Fixed subcarrier separation..................................................28 1.2.3.6.2 Usage of carriers in the middle of the bandwidth for PBCH and synchronization signals.................................................................29 1.2.3.6.3 Deployment Scenarios..........................................................30 1.2.4 Important Characteristics of the LTE Layer 2 and 3..................32 1.2.4.1 Support of the new LTE L1............................................................32 1.2.4.2 Simple IP centric protocols supporting AIPN.................................32 1.2.4.3 Support of various inter RAT handovers (GSM, UTRA, etc.)........33 1.3 LTE and System Architecture Evolution (SAE)..................34 1.3.1 Overview...................................................................................34 1.3.1.1 Missing RNC..................................................................................34 1.3.1.2 Interconnected eNB’s....................................................................35 1.3.1.3 Separate entities for user plane and control plane in the EPC......36 1.3.1.4 Combined Serving Gateway and MME.........................................36 1.3.1.5 Combined Serving and PDN Gateways........................................36 1.3.1.6 S1-flex...........................................................................................36 1.3.1.7 Used legacy elements...................................................................36 1.3.1.8 Roaming case................................................................................36 1.3.1.9 Direct Tunnel.................................................................................36 1.3.1.10 EPS, EPC, E-UTRAN & LTE, SAE..............................................36 1.3.2 The eNB....................................................................................38 1.3.2.1 Selection of MME at attachment....................................................39 1.3.2.2 Scheduling of paging messages....................................................39 1.3.2.3 Routing of user plane data to Serving GW....................................40 1.3.2.4 PDCP.............................................................................................40 1.3.2.5 RRM/RRC......................................................................................40 1.3.2.6 RLC...............................................................................................40 1.3.2.7 MAC...............................................................................................40 1.3.2.8 Complete L1 functionality..............................................................40 1.3.3 The MME...................................................................................42 1.3.3.1 NAS signalling...............................................................................42 1.3.3.2 Inter CN node signaling (3GPP networks).....................................42 1.3.3.3 Security management....................................................................42 1.3.4 The Serving GW........................................................................44 1.3.4.1 Termination of U-plane packets for paging reasons......................44 1.3.4.2 Support of UE mobility anchoring by switching U-plane during inter eNB handover............................................................................................44 1.3.4.3 Transport Packet Marking According to QCI.................................45 1.3.4.4 Mobility anchoring for inter-3GPP mobility....................................45 1.3.4.5 Packet routing and forwarding.......................................................45 1.3.4.6 Charging support...........................................................................45 1.3.4.7 Lawful interception.........................................................................45 1.3.5 The PDN GW............................................................................46 1.3.5.1 Termination towards of PDN’s.......................................................46 1.3.5.2 Policy enforcement........................................................................46 1.3.5.3 Charging support...........................................................................46 1.3.5.4 DHCPv4 and DHCPv6 functions...................................................47 1.3.6 Identifiers of the UE and the Network Elements........................48 1.3.6.1 PLMN ID........................................................................................50 1.3.6.2 EPS Bearer ID...............................................................................50 1.3.6.3 MMEI.............................................................................................50 1.3.6.4 GUMMEI........................................................................................50 1.3.6.5 Physical Cell ID.............................................................................50 1.3.6.6 eNB/cell ID.....................................................................................50 1.3.6.7 TAI.................................................................................................50 1.3.6.8 C-RNTI..........................................................................................50 1.3.6.9 RA-RNTI........................................................................................50 1.3.6.10 SI-RNTI........................................................................................50 1.3.6.11 P-RNTI.........................................................................................50 1.3.6.12 Random Value.............................................................................50 1.3.6.13 IMSI, S-TMSI, and IMEI...............................................................52 1.3.6.14 GUTI............................................................................................52 1.3.6.15 eNB S1-AP UE ID and MME S1-AP UE ID.................................52 1.4 The E-UTRAN Protocol Stack..............................................54 1.4.1 Control Plane Protocol Stack....................................................54 1.4.1.1 Air Interface protocols....................................................................55 1.4.1.2 NAS protocols................................................................................56 1.4.2 User Plane Protocol Stack........................................................58 1.4.2.1 Air Interface protocols....................................................................58 1.4.2.2 S1 protocol....................................................................................58 1.4.3 X2 Interface Control Plane Protocol Stack................................60 1.4.4 X2 User Plane Protocol Stack...................................................62 1.5 Overview Channels of E-UTRAN.........................................64 1.5.1 Channel Types..........................................................................64 1.5.1.1 Logical Channels...........................................................................64 1.5.1.2 Transport Channels.......................................................................64 1.5.1.3 Physical Channels.........................................................................65 1.5.2 Logical Channels of E-UTRAN..................................................66 1.5.2.1 BCCH............................................................................................66 1.5.2.2 PCCH............................................................................................66 1.5.2.3 CCCH............................................................................................66 1.5.2.4 MCCH............................................................................................66 1.5.2.5 DCCH............................................................................................67 1.5.2.6 DTCH.............................................................................................67 1.5.2.7 MTCH............................................................................................67 1.5.3 Transport Channels of E-UTRAN..............................................68 1.5.3.1 RACH............................................................................................68 1.5.3.2 UL-SCH.........................................................................................68 1.5.3.3 BCH...............................................................................................68 1.5.3.4 PCH...............................................................................................68 1.5.3.5 MCH..............................................................................................69 1.5.3.6 DL-SCH.........................................................................................69 1.5.4 Physical Channels of E-UTRAN................................................70 1.5.4.1 PBCH.............................................................................................70 1.5.4.2 PDCCH..........................................................................................70 1.5.4.3 PCFICH.........................................................................................71 1.5.4.4 PUCCH..........................................................................................71 1.5.4.5 PRACH..........................................................................................71 1.5.4.6 PHICH...........................................................................................72 1.5.4.7 PDSCH..........................................................................................72 1.5.4.8 PMCH............................................................................................72 1.5.4.9 PUSCH..........................................................................................72 1.5.4.10 Downlink reference signal...........................................................72 1.5.4.11 Primary and secondary synchronization signal...........................72 1.5.4.12 Uplink reference signal or UL pilot symbol..................................72 1.5.4.13 Uplink sounding signal.................................................................72 1.5.4.14 Random Access Preamble..........................................................72 1.5.5 Mapping of Channels in E-UTRAN............................................74 1.6 Key Development Trends manifested in LTE.....................76 1.6.1 Mapping of User Plane Packets to the Resources....................76 1.6.1.1 Method 1: Fast resource allocation on optimum resources...........77 1.6.1.2 Method 2: Slow resource allocation on suboptimum resources....78 1.6.1.3 GSM..............................................................................................78 1.6.1.4 WCDMA.........................................................................................78 1.6.1.5 HSPA.............................................................................................78 1.6.1.6 LTE................................................................................................78 1.6.1.7 General trend.................................................................................78 1.6.2 All IP Network and Simple Packet Service Driven Protocols.....80 1.6.2.1 Reduced User Plane Latency........................................................82 1.6.2.1 Reduced Control Plane Latency....................................................84 1.7 LTE Key Feature Summary..................................................86 1.7.1 Air Interface Technology...........................................................86 1.7.2 System Architecture..................................................................87 1.7.3 Service Aspects........................................................................87 Key Technologies of the LTE Physical Layer......................89 2.1 Introduction OFDM Technology..........................................90 2.1.1 Impact of Orthogonality in the Frequency Domain – 3 Steps....90 2.1.2 Practical Exercise: Physical Basics of OFDM / OFDMA...........96 2.1.3 Practical Exercise: Scaling of OFDM / OFDMA-Systems..........98 2.1.4 The In-Phase – Quadrature (I/Q) Presentation.......................100 2.1.5 OFDM / OFDMA and IFFT......................................................102 2.1.5.1 Considering the Discrete Oscillator Array Option........................103 2.1.5.2 Details of the IFFT Option...........................................................103 2.1.5.3 Why is it called F a s t Fourier Transformation?..........................103 2.1.6 Modulation Scheme Overview.................................................104 2.1.8 Tackling Inter-Symbol Interference (ISI)..................................108 2.1.8.1 Introduction..................................................................................108 2.1.8.1.1 Delay Spread......................................................................108 2.1.8.2 Cyclic Prefix.................................................................................110 2.1.8.2.1 Variable Duration and other Assets of the Cyclic Prefix.....111 2.1.8.2.2 Cyclic Prefix in OFDMA in LTE...........................................111 2.1.9 Layout of a Typical OFDM System..........................................112 2.1.9.1 Remarks on the Brick Wall Image...............................................113 2.1.9.2 Subchannelization ......................................................................113 2.1.9.3 Pilot Subcarriers..........................................................................113 2.1.9.4 Null Subcarriers...........................................................................113 2.2 Introduction to MIMO Technology....................................114 2.2.1 The Basics: Signal Fading Physics between TX and RX........114 2.2.2 Multiplexing Dimensions.........................................................116 2.2.2 Multiplexing Dimensions.........................................................118 2.2.3 The Multipath Dimension........................................................120 2.2.6 MIMO General Operation........................................................122 The Physical Layer of E-UTRAN..........................................125 3.1 The Use of OFDM/OFDMA in LTE.....................................126 3.1.1 Frame Structure......................................................................126 3.1.1.1 The generic frame structure........................................................126 3.1.1.2 The downlink slots.......................................................................127 3.1.1.3 The uplink slots............................................................................127 3.1.1.4 The frame structure type 2..........................................................127 3.1.2 LTE Parameters......................................................................128 3.1.2.1 The normal configuration.............................................................128 3.1.2.2 The extended configuration with 15 kHz subcarrier separation...128 3.1.2.3 The extended configuration with 7.5 kHz subcarrier separation..129 3.1.2 Resource Element and Resource Block Definition..................130 3.1.2.1 Definition Resource Element.......................................................130 3.1.2.2 Definition Resource Block...........................................................130 3.1.2.3 Definition Subframe.....................................................................130 3.1.2.4 Number of resource blocks in a given bandwidth........................131 3.1.3 Choice of the UL Transmission Scheme (UL Data Symbols only) .........................................................................................................132 3.1.3.1 What would happen if OFDM would be used in the UL...............133 3.1.3.2 SC-FDMA is used for the UL.......................................................133 3.1.4 FDD and TDD Operation in E-UTRAN....................................134 3.1.4.1 Reciprocity...................................................................................134 3.1.4.1.1 Reciprocity of the mobile radio channel..............................134 3.1.4.1.2 Speed of scheduling decisions...........................................135 3.1.4.2 UL / DL Asymmetry and Others...................................................136 3.1.4.2.1 UL/DL symmetry.................................................................136 3.1.4.2.2 Interference scenarios........................................................136 3.1.4.2.3 TRX architecture.................................................................137 3.1.4.2.4 Deployment in a given frequency band...............................137 3.1.4.3 Summary FDD vs. TDD...............................................................138 3.2 The DL Physical Channels and their Frame Structures. .140 3.2.1 Allocation of DL Physical Channels to Resource Elements....140 3.2.1.1 Not used subcarriers...................................................................142 3.2.1.2 Primary Synchronization Signal...................................................142 3.2.1.3 Secondary Synchronization Signal..............................................142 3.2.1.4 Pilot or Reference Signal.............................................................142 3.2.1.5 PBCH...........................................................................................142 3.2.1.6 PCFICH.......................................................................................142 3.2.1.7 PHICH.........................................................................................142 3.2.1.8 PDCCH........................................................................................142 3.2.1.9 PDSCH (and PMCH)...................................................................142 3.2.2 System Information on PBCH and PDSCH.............................144 3.2.2.1 Split of the BCH on the PBCH and the PDSCH..........................144 3.2.3 PCFICH, PDCCH, and PHICH................................................146 3.2.3.1 The PCFICH................................................................................147 3.2.3.2 The PDCCH.................................................................................148 3.2.3.3 The PHICH..................................................................................148 3.2.4 The Downlink Processing Chain.............................................150 3.2.4.1 Encoded transport block bits.......................................................150 3.2.4.2 Scrambling...................................................................................150 3.2.4.3 Modulator.....................................................................................152 3.2.4.4 Layer Mapper..............................................................................152 3.2.4.5 Precoding....................................................................................152 3.2.4.6 OFDM signal generation..............................................................152 3.2.4.7 CP and IFFT................................................................................152 3.3 The UL Physical Channels and their Frame Structures. .154 3.3.1 Overview UL Physical Channels (RRC_CONNECTED).........154 3.3.1.1 Scheduling Request (SR) on the PUCCH...................................154 3.3.1.2 Small amount of L1 information on the PUCCH..........................155 3.3.1.3 Big amount of L1 information on the PUSCH..............................155 3.3.1.4 L1 information on the PUSCH multiplexed with the TrCH data...155 3.3.1.5 Sounding reference symbols PUSCH resources.........................155 3.3.2 Overview PUCCH...................................................................156 3.3.3 PUCCH Mapping for ACK/NACK only and Scheduling Request .........................................................................................................158 3.3.3.1 Usage of Zadoff-Chu sequences.................................................158 3.3.3.2 Spreading of repeated data Zadoff-Chu symbols........................160 3.3.3.3 Spreading of reference Zadoff-Chu symbols...............................160 3.3.3.3 PUCCH Format 1........................................................................160 3.3.3.4 PUCCH Formats 1a and 1b.........................................................160 3.3.3.5 Shortened PUCCH Formats 1a and 1b.......................................160 3.3.3.6 Multiple access of the PUCCH....................................................160 3.3.4 Shared usage of Resources with CAZAC Sequences............162 3.3.4.1 Zadoff-Chu sequences are CAZAC sequences..........................163 3.3.4.2 Separation of different UE’s with cyclic shifted Zadoff-Chu sequences...............................................................................................163 3.3.5.1 PUCCH Format 2........................................................................164 3.3.5.2 PUCCH Formats 2a and 2b.........................................................165 3.3.6 The Uplink Processing Chain..................................................166 3.3.6.1 Transport block bits.....................................................................166 3.3.6.2 Scrambling...................................................................................166 3.3.6.3 Modulator.....................................................................................166 3.3.6.4 DFT pre-coder.............................................................................166 3.3.6.5 Demultiplexing of signals other than data....................................167 3.3.6.6 Resource element mapper..........................................................167 3.3.6.7 IFFT.............................................................................................167 3.3.6.7 CP................................................................................................167 3.4 Overview all Physical Channels........................................168 3.4.1 Special usage of the 6 RB around the DC carrier...................169 3.4.2 Multiplexing of the PCFICH, PDCCH and the PDSCH/PMCH in the normal DL subframe...................................................................170 3.4.3 Sounding reference signal.......................................................170 3.4.4 Modulation of the physical channels.......................................170 3.4.5 Channel coding.......................................................................170 3.5 Physical Layer Procedures...............................................172 3.5.1 Timing Advance Control..........................................................174 3.5.1.1 Principle.......................................................................................174 3.5.1.2 Procedure....................................................................................178 3.5.1.2.1 TA while the UE is not synchronized to the eNB................178 3.5.1.2.2 TA while the UE is synchronized to the eNB......................179 3.5.2 Channel Estimation DL...........................................................180 3.5.2.1 Channel Estimation Principle of LTE...........................................180 3.5.2.1.1 The description of the mobile radio channel.......................180 3.5.2.1.2 Coping with a frequency selective mobile radio channel....182 3.5.2.2 Channel Estimation Downlink......................................................184 3.5.2.2.1 Normal configuration with 4 TX antennas...........................184 3.5.2.2.2 Normal configuration with less than 4 TX antennas...........185 3.5.2.2.3 Extended configuration with 15 kHz subcarrier spacing.....185 3.5.2.2.4 Extended configuration with 15 kHz subcarrier spacing for MBSFN..............................................................................................185 3.5.2.2.5 Extended configuration with 7.5 kHz subcarrier spacing for MBSFN..............................................................................................185 3.5.3 Power Control Principle (PUSCH)...........................................186 3.5.4.1 The Transmission Diversity Problem...........................................188 3.5.4.1.1 Receive diversity.................................................................188 3.5.4.1.2 Unsuccessful transmit diversity...........................................189 3.5.4.2 AAS in LTE............................................................................190 3.5.4.2.1 Practical Exercise: Draw the Antenna Diagram of AAS......192 3.5.4.3 CDD.............................................................................................194 3.5.4.3.1 Delay diversity.....................................................................194 3.5.4.3.2 Cyclic delay diversity...........................................................194 3.5.4.3.3 Cyclic delay diversity and MIMO.........................................195 3.5.4.4 SFBC...........................................................................................196 3.5.4.4.1 Space Frequency Block Codes...........................................197 3.5.4.4.2 Space Time Block Codes....................................................197 3.5.4.5 MIMO...........................................................................................198 3.5.4.5.1 MIMO and AAS combined = multiple rank beamforming....199 3.5.4.5.2 When MIMO fails................................................................199 3.5.4.6 The Codebook.............................................................................200 3.5.4.6.1 Optimum beamforming weights..........................................201 3.5.4.6.2 Signaling of sub-optimum beamforming weights................201 3.5.5 Initial Cell Search ...................................................................202 3.5.5.1 Primary and Secondary Synchronization Signals........................202 3.5.5.2 Procedure....................................................................................204 3.5.6 Random Access......................................................................206 3.5.6.1 PRACH Structure Format 0.........................................................206 3.5.6.2 Random Access Procedure.........................................................208 3.5.7 Inter Cell Interference Mitigation.............................................210 3.5.7.1 Traditional frequency reuse in LTE..............................................210 3.5.7.1.1 Frequency reuse bigger than 1...........................................211 3.5.7.1.2 Frequency reuse 1 with low initial load...............................211 3.5.7.1.3 Frequency reuse 1 strongly increased load........................211 3.5.7.1.4 Frequency reuse 1 after “the party”....................................211 3.5.7.2 Fractional Frequency Reuse with Intercell Interference Coordination............................................................................................212 3.6 UE Classes..........................................................................214 3.6.1 Overview.................................................................................214 3.6.1.1 Classes 1-4..................................................................................214 3.6.1.2 UE class 5...................................................................................215 3.6.2 Calculation of the DL Peak Throughput for LTE UE Class 5...216 The Higher Layers of E-UTRAN...........................................219 4.1 Overview.............................................................................220 4.1.1 E-UTRAN Architecture Control Plane.....................................220 4.1.2 E-UTRAN Architecture User Plane.........................................222 4.2 Features of MAC.................................................................224 4.2.1 Overview.................................................................................224 4.2.1.1 Data transfer logical channels ←→ transport channels..............224 4.2.1.2 Radio resource allocation............................................................224 4.2.2 MAC Random Access Procedure............................................226 4.2.2.1 Contention based random access procedure..............................226 4.2.2.2 Non-contention based random access procedure.......................227 4.2.3 Structure of MAC-PDU............................................................228 4.2.3.1 MAC control element...................................................................229 4.2.3.2 Normal MAC SDU.......................................................................229 4.2.4 MAC Control Elements............................................................230 4.2.4.1 Contention resolution ID..............................................................231 4.2.4.2 Timing Advance...........................................................................231 4.2.4.3 DRX.............................................................................................231 4.2.4.4 Padding.......................................................................................231 4.2.4.5 Short, long and truncated buffer status reports...........................231 4.3 Features of RLC.................................................................232 4.3.1 Overview.................................................................................232 4.3.1.1 Data transfer................................................................................232 4.3.1.2 Error detection and recovery.......................................................232 4.3.1.3 Reset...........................................................................................233 4.3.2 Structure of RLC PDU.............................................................234 4.3.3 Structure of RLC AM with PDCP PDU Segments...................236 4.4 Features of PDCP...............................................................238 4.4.1 Overview.................................................................................238 4.4.1.1 RoHC...........................................................................................238 4.4.1.2 Numbering of PDCP PDU’s.........................................................238 4.4.1.3 In-sequence delivery of PDU’s....................................................238 4.4.1.4 Duplicate deletion........................................................................238 4.4.1.5 Encryption....................................................................................239 4.4.1.6 Integrity Protection.......................................................................239 4.4.2 Structure of PDCP PDU..........................................................240 4.5 Features of RRC.................................................................242 4.5.1 Overview.................................................................................242 4.5.1.1 Transmission of broadcast information........................................243 4.5.1.2 Establish and maintain services..................................................243 4.5.1.3 QoS control..................................................................................243 4.5.1.4 Transfer of dedicated control information....................................243 4.5.2 State Characteristics of RRC..................................................244 4.5.2.1 RRC_IDLE...................................................................................244 4.5.2.2 RRC_CONNECTED....................................................................244 4.6 NAS Protocol States and Transitions...............................246 4.6.1 EMM-DEREGISTERED & ECM-IDLE.....................................246 4.6.2 EMM-REGISTERED & ECM-IDLE..........................................246 4.6.3 EMM-REGISTERED & ECM-CONNECTED...........................247 4.7 Mobility...............................................................................248 4.7.1 Mobility Management in the EMM-DEREGISTERED & ECMIDLE State........................................................................................248 4.7.2 Mobility Management in the EMM-REGISTERED & ECM-IDLE State.................................................................................................250 4.7.3 Mobility Management in the EMM-REGISTERED & ECMCONNECTED State.........................................................................252 4.7.4 Inter RAT Mobility Management..............................................254 4.7.4.1 Cell Reselection (EMM-REGISTERED & ECM-IDLE).................255 4.7.4.2 Handover (EMM-REGISTERED & ECM-CONNECTED)............255 4.8 QoS in LTE..........................................................................256 4.8.1 Bearer Architecture.................................................................256 4.8.2 QoS Parameters.....................................................................258 4.8.2.1 ARP.............................................................................................259 4.8.2.2 Label............................................................................................259 4.8.2.3 GBR.............................................................................................259 4.8.2.4 MBR.............................................................................................259 4.8.2.5 AMBR..........................................................................................259 4.8.3 QoS Classes Identifier............................................................260 4.9 Security in LTE...................................................................262 Selected E-UTRAN Scenarios..............................................265 5.1 Initial Context Setup Procedure........................................266 5.2 Tracking Area Update........................................................268 5.1.1 Inter MME tracking area update..............................................268 5.1.2 Intra MME tracking area update..............................................269 5.3 PDP Context Establishment..............................................270 5.4 Intra MME Handover...........................................................274 5.4.1 Practical Exercise: Intra eNB Handover..................................278 5.5 Inter MME Handover...........................................................280 5.6 How a TCP/IP MTU is reaching the UE / the Internet.......284 5.6.1 TCP/IP layer............................................................................284 5.6.2 PDCP layer.............................................................................284 5.6.3 RLC layer................................................................................284 5.6.4 MAC layer...............................................................................285 5.6.5 PHY layer................................................................................285 Solutions for Practical Exercises........................................287
Python-ImageGenerationfromLayout的官方PyTorch实现
08-11
Official PyTorch Implementation of Image Generation from Layout - CVPR 2019
探索深度学习之美：VQ-VAE 2 PyTorch 实现详解
最新发布
gitblog_00020的博客
04-25 380
探索深度学习之美：VQ-VAE 2 PyTorch 实现详解 项目地址:https://gitcode.com/rosinality/vq-vae-2-pytorch 该项目（https://gitcode.com/rosinality/vq-vae-2-pytorch）是一个基于 PyTorch 的 VQ-VAE 2（Vector Quantized Variational Autoencode...
Image Generation
studyeboy的专栏
04-22 2006
Image-to-Image Translation Unsupervised Image-to-Image Translation Unsupervised image-to-image translation is the task of doing image-to-image translation without ground truth image-to-image pairings. One Shot Image to Image Translation One-Shot Unsuperv
AMiner会议论文推荐第二十八期——IJCAI 2020杰出论文奖两篇
AI_Conf的博客
01-12 355
AMiner平台由清华大学计算机系研发，拥有我国完全自主知识产权。平台包含了超过2.3亿学术论文/专利和1.36亿学者的科技图谱，提供学者评价、专家发现、智能指派、学术地图等科技情报专业化服务。系统2006年上线，吸引了全球220个国家/地区1000多万独立IP访问，数据下载量230万次，年度访问量超过1100万，成为学术搜索和社会网络挖掘研究的重要数据和实验平台。 IJCAI 2020 论文推荐 Unsupervised Scene Adaptation with Memory Regulariza.
Image Generation from Scene Graphs基于场景图构造图像
jinking01的专栏
05-13 1130
利用图卷积模型大大提高生成图像语意丰富性的文章，一作是来自李飞飞实验组的 Justin Johnson，这位小哥的文章总是会有开源代码保证，点个赞先。由语意到生成图像，需要神经网络具有创造能力。所以，本文开头就引用了一句名言: What I cannot create, I do not understand. 神经网络要想真正理解我们的视觉世界，只有识别能力是不行的，还需要有创造的本领。 ...
Layout2Im
Forlogenの解忧杂货铺
07-05 1304
论文地址：https://arxiv.org/abs/1811.11389 GitHub：https://github.com/zhaobozb/layout2im 收录于：CVPR 2019 Demo: 本文主要完成的任务仍然是Text-to-Image，只不过在中间过程中使用了布局（Layout）来帮助生成具有多个实体的复杂布局的图像。Layout2Im的基本原理是：给定一个粗粒度的布局信...
text to image（八）:《Image Generation from Scene Graphs》
zlrai5895的博客
07-27 6139
最近在翻阅文本生成图像的相关工作，目前比较新的有突破性的工作是李飞飞工作团队18年cvpr发表的《Image Generation from Scene Graphs》 。        论文地址：https://arxiv.org/abs/1804.01622        源码地址： https://github.com/google/sg2im        这篇主要就是介绍该论文的工...
【2018CVPR】Image Generation from Scene Graphs论文分享
zn0412的博客
07-21 445
现有的根据文本生成图像的方法难以生成语言描述中包含多个对象以及对象之间关系的图。于是，作者提出了用图卷积处理输入图像，根据bounding box等计算场景布局，然后用级联细化网络和对抗生成网络把布局转换成图。
LTE from A to Z (part1 of 3)
05-11
LTE from A-Z Technology and Concepts of the 4G 3GPP Standard Table of Content Principles and Motivation of LTE............................................1 1.1 Mobile Radio: Comparison between 3G ...
LTE from A-Z 培训教材 （part2 of 3)
05-13
LTE from A-Z Technology and Concepts of the 4G 3GPP Standard Table of Content Principles and Motivation of LTE............................................1 1.1 Mobile Radio: Comparison between 3G ...
attribute-guided_GaN_
09-30
This is the code repository complementing the paper attribute-guided image generation from layout. The pretrained model can be downloaded here: (TODO)
论文代码中的 bug 们
blauschneiden的博客
09-14 466
Image Generation from Layout Pillow 模块的版本 bug 作者在 requirements.txt 上规定了 Pillow=5.1.0，但是运行代码时会出现导入 bug，具体的报错没有记下来，但把 Pillow 的版本降低就可以解决这一问题，我自己使用了 Pillow=4.3.0 就解决了这个 bug。 挑食的函数 crop_bbox_batch() 这是一个非常好用的函数，最早使用在论文 Image Generation from Scene Graph 中
图像编辑系列之（2）基于StyleGAN（3）GAN逆映射（4）人脸 （5）语义生成 | ICCV2021生成对抗GAN梳理汇总...
idol24的博客
03-19 1578
二、图像编辑-基于StyleGAN11、StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery受 StyleGAN 启发，最近许多工...
VQ-VAE-2
weixin_38858621的博客
04-01 3753
原文链接：Generating Diverse High-Fidelity Images with VQ-VAE-2 加载速度慢点这里：中科院镜像 由于科研需要，最近在学习图像生成相关的文献知识，VQ-VAE-2是我目前了解到的比较新的生成模型，一开始搜索到的其实是PixelCNN，然后发现它是16年的工作，然后继续搜索相关工作，在Google DeepMind找到了VQ-VAE-2，由此发现了一...
多模态GLIGEN论文精读
m0_52474839的博客
04-14 984
具体来说，我们使用hc = [h c 1，···，hc L] = ftext©获得标题特征序列(图2中的黄色标记),其中 最后一个单词hc L就是caption的上下文特种(类比BERT的CLS)尽管LDM在互联网规模数据上的预训练已经显示出令人印象深刻的语言到图像生成结果，但在可以指示额外基础输入的情况下合成图像仍然具有挑战性，因此这是我们论文的重点。请注意，现有的layout2img只能处理闭集设置(例如，COCO类别)，因为它们通常学习每个实体的向量嵌入u，以替换(5)中的ftext(e)。
场景图生成图像
qq_44462711的博客
10-06 616
论文摘要 为了能真正理解视觉世界，模型不仅要能够识别图像，还要能够生成它们。近期在自然语言描述生成图片方面取得了令人兴奋的进展。这些方法在有限的领域（例如鸟类或花卉的描述）上提供了令人惊叹的结果，但对于具有许多对象和关系的复杂句子却很难成功复制。为了克服这个限制，作者提出了一种从场景图生成图像的方法，能够明确地推理对象及其关系。作者开发的模型使用图形卷积来处理输入图，通过预测对象的边界框和分割掩模来计算场景布局，并且将布局转换为具有级联精化网络的图像。论文作者使用对抗训练网络对抗一组鉴别器，以确保实际输出
image generation from scene graphs
04-07
“从场景图生成图片”的意思是指利用计算机图像生成技术，根据输入的场景描述信息（也就是场景图），自动生成对应的图像。场景图是一个结构化的数据形式，可以包含场景中的物体、位置、大小、颜色等信息。在图像生成过程中，计算机会根据这些信息，自动计算出场景中各个物体的位置、大小、颜色、光照等视觉特征，从而生成一张与描述信息对应的图像。这种技术在虚拟现实、游戏开发等领域有广泛应用。

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 10
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值