Results 21 to 30 of about 26,950 (290)
A quantitative probabilistic investigation into the accumulation of rounding errors in numerical ODE solution. [PDF]
, 2009 We examine numerical rounding errors of some deterministic solvers for systems of ordinary differential equations (ODEs) from a probabilistic viewpoint. We show that the accumulation of rounding errors results in a solution which is inherently random and
Turner, Amanda G. +2 more
core +1 more source
Lossless audio coding using the IntMDCT and rounding error shaping
, 2022 S.2201-2211In this paper, lossless audio coding using the integer modified discrete cosine transform (IntMDCT) is discussed. The IntMDCT is constructed as an integer approximation of the MDCT using the lifting scheme and is reversible. The rounding error
Schuller, G.D.T. +4 more
core +1 more source
Cancer Informatics, 2021 Researchers often report a measure to several decimal places more than what is sensible or realistic. Rounding involves replacing a number with a value of lesser accuracy while minimizing the practical loss of validity.
Jimmy T Efird
doaj +1 more source
Respondent behavior and data quality aspects in panel surveys : four empirical contributions [PDF]
, 2006 The four essays of this dissertation provide a number of new and unique insights on diverse issues of respondent behavior and aspects of data quality in surveys.
Serfling, Oliver
core +1 more source
Discretization vs. rounding error in Euler's method [PDF]
, 2011 The article of record as published may be located at http://dx.doi.org/10.4169/college.math.j.42.5.399Euler’s method for solving initial value problems is a good vehicle for observing the relationship between discretization error and rounding error in ...
Carlos F. Borges, Borges, Carlos F.
core +1 more source
Probabilistic Rounding Error Analysis of Householder QR Factorization [PDF]
, 2022 When an $m\times n$ matrix is premultiplied by a product of $n$ Householder matrices the worst-case normwise rounding error bound is proportional to $mnu$, where $u$ is the unit roundoff.
Connolly, Michael P. +1 more
core +3 more sources
An improved cordic for digital subdivision of Moiré signal
Metrology and Measurement Systems, 2020 The contradiction between the restriction of grating manufacturing technology and high-resolution measurement requirements has been the focus of attention.
Zhu Weibin +3 more
doaj +1 more source
Computing a correct and tight rounding error bound using rounding-to-nearest [PDF]
, 2016 International audienceWhen a floating-point computation is done, it is most of the time incorrect. The rounding error can be bounded by folklore formulas, such as ε|x| or ε| o (x)|.
Boldo, Sylvie
core +2 more sources
Cryptography, 2023 In this paper, we present new variants of Newton–Raphson-based protocols for the secure computation of the reciprocal and the (reciprocal) square root.
Stan Korzilius, Berry Schoenmakers
doaj +1 more source
ROUNDING ERRORS AND THEIR EFFECTS
Far East Journal of Mathematical Education, 2021 The motivation to write this paper is the fact that students often blindly trust the results of a computation with the computer and rarely question the results. The general opinion is that the computer is perfect and errors only come into the game because of human errors such as faulty programs or incorrect operation.
openaire +1 more source