exp()函数快速算法实现

最新推荐文章于 2023-06-22 22:30:48 发布

DBC12345666

最新推荐文章于 2023-06-22 22:30:48 发布

阅读量9.3k

点赞数 4

本文链接：https://blog.csdn.net/DBC12345666/article/details/41871621

版权

Using Faster Exponential Approximation

2 Replies

In some scenarios/applicatons, where the precision may not be so critically important but the speed (performance) is, you may be willing to sacrifice some extent of accuracy for the speed.

In neutral networks, where the math function $e^n$ where n is usually small (less than 2, for instance), you can avoid the expensive exp() provided by math.h (for other programming languages, similar inbuilt system functions are provided)

The $e^x$ (exponential function) can be considered as the following:

Using Faster Exp Approximation (Exponential function)

In practice, n cannot approach to the infinity but we can achieve a relatively good accuracy by using a large n.

For example, if we put $n = 256$ , then we can multiply $1 + 1/256$ by itself 8 times due to the fact $x^{256} = {x^2}^{128} = {{x^2}^{2}}^{64} \dots$

With this in mind, we can come up with the following approximation:

 
    inline
double exp1(double x) {
  x = 1.0 + x / 256.0;
  x *= x; x *= x; x *= x; x *= x;
  x *= x; x *= x; x *= x; x *= x;
  return x;
} 
   

We can also multiply a few more times, to increase the accuracy.

 
    inline
double exp2(double x) {
  x = 1.0 + x / 1024;
  x *= x; x *= x; x *= x; x *= x;
  x *= x; x *= x; x *= x; x *= x;
  x *= x; x *= x;
  return x;
} 
   

Now, you have the pattern, but for now, we need to test how accurate these approximations are:

Using Faster Exp Approximation (Exponential function)

The above plots 3 curves, which are the exp provided by math.h, the exp 256 and the exp 1024. They show very good agreement for input smaller than 5.

We plot the difference to make it easier to see.

Using Faster Exp Approximation (Exponential function)

Wow, it really can be a faster alternative if the required input range smaller than 5. For negative inputs, the difference won’t be so noticeable because the value itself is so tiny that can’t be observed visually in graph.

The exp 256 is 360 times faster than the traditional exp and the exp 1024 is 330 times faster than the traditional exp.