论文标题

迭代方法以较低的精度

Iterative Methods at Lower Precision

论文作者

Chen, Yizhou, Gong, Xiaoyun, Ji, Xiang

论文摘要

由于计算机中的数字用固定数量的位表示,因此在计算过程中的准确性损失是不可避免的。在高精度下,将更多位分配给每个数字的位(例如64)通常很小。另一方面,以较低的精度计算,例如一半(16位),其优点是要快得多。这项研究的重点是在不同的精度水平上实验大规模逆问题的算术,这些问题由具有不良条件矩阵的线性系统表示。我们通过MATLAB CHOP函数在较低的精度下对最小二乘(CGL)和Chebyshev半数法(CS)进行了修改,并使用MATLAB CHOP函数在较低的精度上进行算术,并且我们从图像处理中进行了实验,并在不同的精确级别上进行了实验。我们得出的结论是,CGLS是一种更稳定的算法,但是由于内部产品的计算而容易溢出,而CS的溢出的可能性较小,但其收敛行为更不稳定。当噪声水平较高时,CS在溢出之前能够运行更多迭代来优于CGL。当噪声水平接近零时,CS似乎更容易受到圆形错误的积累。

Since numbers in the computer are represented with a fixed number of bits, loss of accuracy during calculation is unavoidable. At high precision where more bits (e.g. 64) are allocated to each number, round-off errors are typically small. On the other hand, calculating at lower precision, such as half (16 bits), has the advantage of being much faster. This research focuses on experimenting with arithmetic at different precision levels for large-scale inverse problems, which are represented by linear systems with ill-conditioned matrices. We modified the Conjugate Gradient Method for Least Squares (CGLS) and the Chebyshev Semi-Iterative Method (CS) with Tikhonov regularization to do arithmetic at lower precision using the MATLAB chop function, and we ran experiments on applications from image processing and compared their performance at different precision levels. We concluded that CGLS is a more stable algorithm, but overflows easily due to the computation of inner products, while CS is less likely to overflow but it has more erratic convergence behavior. When the noise level is high, CS outperforms CGLS by being able to run more iterations before overflow occurs; when the noise level is close to zero, CS appears to be more susceptible to accumulation of round-off errors.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源