【Fourier Convolution】傅里叶卷积

原文地址: https://terpconnect.umd.edu/~toh/spectrum/Convolution.html

什么是卷积

Convolution is an operation performed on two signals which involves multiplying one signal by a delayed or shifted version of another signal, integrating or averaging the product, and repeating the process for different delays.
Convolution is a useful process because it accurately describes some effects that occur widely in scientific measurements, such as the influence of a frequency filter on an electrical signal or of the spectral bandpass of a spectrometer on the shape of a recorded optical spectrum.

卷积是对两个信号执行的操作,包括将一个信号与另一个信号的延迟或移位版本相乘,积分或求积平均,并对不同的延迟重复该过程。 卷积是一个有用的过程,因为它准确地描述了科学测量中广泛发生的一些影响,例如,频率滤波器对电信号的影响或光谱仪的光谱带通对记录的光谱形状的影响。

如何计算傅里叶卷积

In practice, the calculation is usually performed by point-by-point multiplication of the two signals in the Fourier domain.
First, the Fourier transform of each signal is obtained. Then the two Fourier transforms are multiplied point-by-point by the rules for complex multiplication and the result is then inverse Fourier transformed. Fourier transforms are usually expressed in terms of “complex numbers”, with real and imaginary parts; if the Fourier transform of the first signal is a + ib, and the Fourier transform of the second signal is c + id, then the product of the two Fourier transforms is (a + ib)(c + id) = (ac - bd) + i(bc + ad).
Although this seems to be a round-about method, it turns out to be faster then the shift-and-multiply algorithm when the number of points in the signal is large.
Convolution can be used as a powerful and general algorithm for smoothing and differentiation. Many computer languages will perform this operation automatically when the two quantities divided are complex.

实际上,通常通过在傅立叶域中两个信号的逐点相乘来执行计算。

首先,获得每个信号的傅立叶变换。然后将两个傅立叶变换逐点乘以复杂乘法的规则,然后对结果进行傅立叶逆变换。
傅立叶变换通常用“复数”来表示,具有实部和虚部。如果第一个信号的傅立叶变换为a + ib,第二个信号的傅立叶变换为c + id,则两个傅立叶变换的乘积为 ( a + i b ) ( c + i d ) = ( a c − b d ) + i ( b c + a d ) (a + ib)(c + id)=(ac-bd )+ i(bc + ad) a+ibc+id=acbd+ibc+ad

尽管这似乎是一种环回方法,但事实证明,当信号中的点数很大时,它比移位和乘法算法要快。卷积可以用作一种强大且通用的平滑和微分算法。当两个被除数复杂时,许多计算机语言将自动执行此操作。

Fourier convolution can also be used as a very general algorithm for the smoothing and differentiation of digital signals, by convoluting the signal with a (usually) small set of numbers representing the convolution vector.
Smoothing is performed by convolution with sets of positive numbers, e.g. [1 1 1] for a 3-point boxcar. Convolution with [–1 1] computes a first derivative; [1 -2 1] computes a second derivative.
Successive convolutions by Conv1 and then Conv2 is equivalent to one convolution with the convolution of Conv1 and Conv2. First differentiation with smoothing is done by using a convolution vector in which the first half of the coefficients are negative and the second half are positive (e.g.[-1 -2 0 2 1]).

傅立叶卷积还可以用作数字信号的平滑和微分的非常通用的算法,方法是使用代表卷积矢量的(通常)小数字集对信号进行卷积。

通过对正数集进行卷积执行平滑处理,例如 [1 1 1]适用于三点棚车。 与[–1 1]的卷积计算一阶导数; [1-2-1]计算二阶导数。 由Conv1然后由Conv2进行的连续卷积等效于一次具有Conv1和Conv2的卷积的卷积。 通过使用卷积向量来完成带平滑的一次微分,其中系数的前半部分为负,后半部分为正(例如[-1 -2 0 2 1])。

实际使用样例

此处使用傅里叶卷积来确定当用光谱仪扫描时窗口1(左上)的光谱将如何出现,该光谱仪的狭缝功能(光谱分辨率)由窗口2(右上)的高斯函数描述。 高斯函数已经旋转,因此其最大值落在x = 0处。 产生的回旋光谱(底部中心)显示,x = 110和120附近的两条线将无法分辨,但x = 40处的线将被部分分辨。 在吸收光谱法的“ Tfit”方法中,以这种方式使用傅里叶卷积来校正由光谱仪分辨率引起的分析曲线非线性。
图例: 此处使用傅里叶卷积来确定当用光谱仪扫描时窗口1(window 1)的光谱将如何出现,该光谱仪的狭缝功能(光谱分辨率)由窗口2(window 2)的高斯函数描述。 高斯函数已经倒转,因此其最大值落在x = 0处。 产生的回旋光谱(window 3)显示,x = 110和120附近的两条线将无法分辨,但x = 40处的线将被部分分辨。

快速傅里叶卷积(FFC)是一种神经算子,它允许在神经网络中执行非局部推理和生成。FFC的结构包括本地分支和全局分支。局部分支使用传统的卷积进行特征图的局部更新,而全局分支对特征图进行傅里叶变换并在影响全局上下文的频谱域内进行更新。具体来说,FFC会先对特征图的频率维度进行傅里叶变换,然后再进行卷积操作和傅里叶反变换。这使得FFC在涉及到傅里叶变换的维度上对输入张量有全局影响。 此外,研究发现将FFC层合并到U-Net架构中是有益的。在U-Net结构的每一层,可以使用几个剩余的FFC块与卷积上采样或下采样。通常,使用FFC的U-Net级别时,参数α(进入快速傅里叶卷积全局分支的通道的比率)的选择对于性能的提升是有益的。 另外,FFC也可以应用于语音增强问题。研究表明,基于快速傅里叶卷积的神经网络架构在语音增强质量、相位估计和参数效率方面明显优于基于普通卷积的架构。因此,所提出的FFC架构在语音降噪基准测试中表现出最先进的结果。<span class="em">1</span><span class="em">2</span><span class="em">3</span> #### 引用[.reference_title] - *1* *2* *3* [FFC-SE: Fast Fourier Convolution for Speech Enhancement](https://blog.csdn.net/weixin_48994423/article/details/124190533)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_2"}}] [.reference_item style="max-width: 100%"] [ .reference_list ]
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值