Results 1 to 10 of about 83,923 (165)
Round-Off Error Suppression by Statistical Averaging
AxiomsRegarding round-off errors as random is often a necessary simplification to describe their behavior. Assuming, in addition, the symmetry of their distributions, we show that one can, in unstable (ill-conditioned) computer calculations, suppress their ...
Andrej Liptaj
doaj +2 more sources
Integrated volatility and round-off error
Bernoulli, 2009 Published in at http://dx.doi.org/10.3150/08-BEJ170 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)
Mathieu Rosenbaum
exaly +5 more sources
Bounding the Round-Off Error of the Upwind Scheme for Advection
IEEE Transactions on Emerging Topics in Computing, 2022 Numerical simulations are carefully-written programs, and their correctness is based on mathematical results. Nevertheless, those programs rely on floating-point arithmetic and the corresponding round-off errors are often ignored. This article deals with a specific simple scheme applied to advection, that is a particular equation from hydrodynamics ...
Sylvie Boldo, William Weens
exaly +3 more sources
On Round-off Error for Adaptive Finite Element Methods
Procedia Computer Science, 2012 AbstractRound-off error analysis has been historically studied by analyzing the condition number of the associated matrix. By controlling the size of the condition number, it is possible to guarantee a prescribed round-off error tolerance. However, the opposite is not true, since it is possible to have a system of linear equations with an arbitrarily ...
David Pardo +2 more
exaly +2 more sources
Design and Implementation of Multithreaded Reproducible DGEMV for Phytium Processor [PDF]
Jisuanji kexue, 2022 In high-performance computing,the accumulation of rounding error in the process of solving the large-scale,long time and ill-conditioned problem will lead to invalidated results.These results are useful for the developers to debug programs and check ...
CHEN Lei, TANG Tao, QI Hai-jun, JIANG Hao, HE Kang
doaj +1 more source
Modeling Round-Off Errors in Hydrodynamic Simulations [PDF]
, 2022 The growth of the computing capacities makes it possible to obtain more and more precise simulation results. These results are often calculated in binary64 with the idea that round-off errors are not significant. However, exascale is pushing back the known limits and the problems of accumulating round-off errors could come back and require increasing ...
Weens, William +2 more
openaire +2 more sources
Accounting for Round-Off Errors When Using Gradient Minimization Methods
Algorithms, 2022 This paper discusses a method for taking into account rounding errors when constructing a stopping criterion for the iterative process in gradient minimization methods.
Dmitry Lukyanenko +2 more
doaj +1 more source
Setting process control chart limits for rounded-off measurements
Heliyon, 2023 Measurements can often be imprecise and subjected to rounding-off. Typically, this rounding-off is ignored and assumed to have little to no effect. However, when the measuring scale step is not negligible, it may affect statistical control tools such as ...
Ran Etgar, Sarit Freund
doaj +1 more source
Accurate Goertzel Algorithm: Error Analysis, Validations and Applications
Mathematics, 2022 The Horner and Goertzel algorithms are frequently used in polynomial evaluation. Each of them can be less expensive than the other in special cases. In this paper, we present a new compensated algorithm to improve the accuracy of the Goertzel algorithm ...
Chuanying Li +5 more
doaj +1 more source
Nonlinear optimization algorithm using monotonically increasing quantization resolution
ETRI Journal, 2023 We propose a quantized gradient search algorithm that can achieve global optimization by monotonically reducing the quantization step with respect to time when quantization is composed of integer or fixed-point fractional values applied to an ...
Jinwuk Seok, Jeong-Si Kim
doaj +1 more source