Results 141 to 150 of about 3,259,619 (178)

A new iterative refinement with roundoff error analysis

Numerical Linear Algebra with Applications, 2011
AbstractIn this paper we present a novel improvement of Wilkinson's iterative refinement for the solution of linear system by using stability results of numerical solution for a dynamic system associated with the linear system. The convergence analysis is shown and roundoff error analysis is considered for this new refinement. Numerical experiments are
Xinyuan Wu, Zhengyu Wang
openaire   +2 more sources

Roundoff error analysis of the pipelined ADPCM coder

1993 IEEE International Symposium on Circuits and Systems, 2002
Roundoff error analysis of a pipelined adaptive differential pulse code modulation (ADPCM) coder is presented. The pipelined coder has been developed by employing the relaxed look-ahead technique. It is shown that the precision of the quantized prediction error and those of the predictor coefficients are critical.
Naresh R. Shanbhag, Keshab K. Parhi
openaire   +1 more source

Limit distribution of a roundoff error

Statistics & Probability Letters, 2012
Denote by \([x]:=\sup\{m\in\mathbb{Z}:\,m\leq x\}\) the integral part of \(x\in\mathbb{R}\) and by \(\{x\}:=x-[x]\in[0,1)\) its fractional part. Let \(X\) be a random variable. The conditional distribution function \(F_n(x):=P(\{X\}\leq x \mid [X]=n)\) for an integer \(n\in\mathbb{N}\) is investigated. Characterizations of the limit of \(F_n\) when \(n\
openaire   +2 more sources

Roundoff error analysis of the PCA networks

IEEE Instrumentation and Measurement Technology Conference Sensing, Processing, Networking. IMTC Proceedings, 2002
This paper deals with some of the effects of finite precision data representation and arithmetics in principal component analysis (PCA) neural networks. The PCA networks are single layer linear neural networks that use some versions of Oja's learning rule.
T. Szabo, G. Horvath
openaire   +1 more source

Comments on "Roundoff Errors in Signal Averaging Systems"

IEEE Transactions on Biomedical Engineering, 1987
In this paper1 the author finds the degradation in signal-to-noise ratio (SNR) of a signal averaging system output as a function of A/D bits. The results stated are based on certain assumptions which do not hold for low values of A/D bits. Under these conditions the results seriously overestimate the SNR degradation.
openaire   +2 more sources

Formally Verified Roundoff Errors Using SMT-based Certificates and Subdivisions

World Congress on Formal Methods, 2019
Joachim Bard, Heiko Becker, Eva Darulova
semanticscholar   +1 more source

Roundoff Error and Double Precision

1977
As we have seen, most applications of computers to calculus involve the evaluation of several terms in a sequence. The evaluations continue until some criterion is satisfied. In Figure 1–5 for example, the criterion was that the terms of two sequences differ by less than 10-3. In EXERCISE 5–5 the values of the sequence \( \frac{{f(1.8 + {{10}^{{ - n}}})
openaire   +1 more source

On the variance of a centered random value roundoff error

Signal Processing, 2015
We derive two expressions for roundoff error variance, one for a rounded off random value with a zero mean and a given variance under uniform distribution and another for such a value under a normal. Also, an expression for truncation error variance for values under uniform distribution is obtained.
openaire   +1 more source

Numerical Optimization Problems of Sine-Wave Fitting Algorithms in the Presence of Roundoff Errors

IEEE Transactions on Instrumentation and Measurement, 2016
B. Renczes, I. Kollár, A. Moschitta, P. Carbone   +3 more
semanticscholar   +1 more source

Roundoff errors in fixed-point FFT

IEEE International Symposium on Intelligent Signal Processing,, 2009
V. Pálfi, I. Kollár
semanticscholar   +1 more source