转自:http://blog.csdn.net/u011202336/article/details/9238699
背景:回声与啸叫的产生 http://blog.csdn.net/u011202336/article/details/9238397
参考资料: http://www.speex.org/docs/manual
从代码分析,下边是Speex test demo
- #include <stdio.h>
- #include <stdlib.h>
- #include <sys/types.h>
- #include <sys/stat.h>
- #include <fcntl.h>
- #include "speex/speex_echo.h"
- #include "speex/speex_preprocess.h"
-
-
- #define NN 128
- #define TAIL 1024
-
- int main(int argc, char **argv)
- {
- FILE *echo_fd, *ref_fd, *e_fd;
- short echo_buf[NN], ref_buf[NN], e_buf[NN];
- SpeexEchoState *st;
- SpeexPreprocessState *den;
- int sampleRate = 8000;
-
- if (argc != 4)
- {
- fprintf(stderr, "testecho mic_signal.sw speaker_signal.sw output.sw\n");
- exit(1);
- }
- echo_fd = fopen(argv[2], "rb");
- ref_fd = fopen(argv[1], "rb");
- e_fd = fopen(argv[3], "wb");
-
- st = speex_echo_state_init(NN, TAIL);
- den = speex_preprocess_state_init(NN, sampleRate);
-
-
- speex_echo_ctl(st, SPEEX_ECHO_SET_SAMPLING_RATE, &sampleRate);
- speex_preprocess_ctl(den, SPEEX_PREPROCESS_SET_ECHO_STATE, st);
-
- while (!feof(ref_fd) && !feof(echo_fd))
- {
- fread(ref_buf, sizeof(short), NN, ref_fd);
- fread(echo_buf, sizeof(short), NN, echo_fd);
-
-
-
-
- speex_echo_cancellation(st, ref_buf, echo_buf, e_buf);
- speex_preprocess_run(den, e_buf);
- fwrite(e_buf, sizeof(short), NN, e_fd);
- }
-
-
- speex_echo_state_destroy(st);
- speex_preprocess_state_destroy(den);
- fclose(e_fd);
- fclose(echo_fd);
- fclose(ref_fd);
- return 0;
- }
Speex 源码中附带的这个例子,只适合于串行的链式媒体流,当媒体播放、媒体采集、媒体网络数据接口分属在不同现成时,就会存在同步问题,异步线程会导致信号延迟加大,回声消除收敛效果不好。其中Speex 回声消除必须按照建议的流程:
- write_to_soundcard(echo_frame, frame_size);
- read_from_soundcard(input_frame, frame_size);
- speex_echo_cancellation(echo_state, input_frame, echo_frame, output_frame);
在典型的VOIP类型应用中:
echo_frame: 从RTP接收的数据包解码后,送入声卡播放,获取的数据。
input_frame: 本地麦克采集到的数据
output_frame: 回声消除后的数据,送入encodec,并构造rtp数据包,传输到远端。
典型的应用模式:
Thread A: 接收audio rtp -> decodec -----> sound card
|__> echo_frame queue
Thread B: 获取麦克数据input_frame --> speex_echo_cancellation( speex_state, input_frame, echo_frame,out_frame ) -> rtp packet -> network
也可以将rtp packet 与network 传输放到另外一个线程。