Rational Orthonormal Functions on the Unit Circle and on the Imaginary Axis, with Applications in System Identification (original) (raw)

In this report we present a collection of results concerning two families of rational orthonormal functions, one on the unit circle, and another on the imaginary axis. We also describe in detail an interesting link between the two families. Special cases of these rational orthonormal functions include the Laguerre and Kautz orthonormal functions, as well as the orthonormal functions recently introduced by Heuberger, Van den Hof and Bosgra. Among the results presented herein are completeness and uniform boundedness conditions, and their respective proofs, for the above mentioned families of rational orthonormal functions, as well as some interpolatory properties of truncated orthonormal expansions based on these functions. We will only discuss the case of (rational) functions orthonormal with respect to a unit weighting function. The general case of a non constant (non-negative) weighting function is much more involved and will be described in a future report. We derive the rational orthonormal functions by two methods. The first one is essentially the classical approach, and is based on the Gram-Schmidt orthonormalization of a set of exponentials. This method was the one used by Lee and Wiener, Kautz, and others, and is based on certain elementary properties of contour integrals of rational functions. The second one, which may be called the modern approach, is based on balanced realizations of rational all-pass transfer functions. To the best of our knowledge this method was developed by Roberts and Mullis and is at the root of the Heuberger et al. family of rational orthonormal functions. Some interesting elementary properties of linear models constructed from rational orthonormal functions are also presented. Special cases of these models include the very well known FIR model and the recently studied Laguerre and "two-parameter" Kautz models, as well as the Heuberger et al. model. Curiously, these models have many properties in common with the FIR model, such as the theoretical upper bound of the condition number of the auto-correlation matrix of their internal signals. Together with the inherent structure of these models this leads to a simple LMS-like algorithm to adapt its weights that can use the same adaptation step size as the standard LMS algorithm for transversal filters. Institute of Technology (KTH), Stockholm, Sweden, for bringing to my attention their work and the important book of Roberts and Mullis [1987], in which certain interconnections of balanced all-pass transfer functions are shown to remain balanced and all-pass. Without their mention of that book the entire chapter 4 would not have existed! (However, section 4.6 would probably have been placed somewhere else in a somewhat modified form.) In fact, it was that book that prompted me to write this report. I want to extend my thanks to Dr. Ir. Bert den Brinker and to Harm Belt, of the Eindhoven University of Technology (TUE), Eindhoven, The Netherlands. Their kind hospitality allowed me to conduct a first bibliographic search that provided a large part of the base material for this report. Finally, I want to thank Prof. Príncipe, of the University of Florida (UF), Gainesville, USA, not only for his generous hospitality, but also for his guidance in the past. His kind hospitality allowed me to conduct a second bibliographic search that provided some of the older material for this report. 4 x, y = x + y 2 + i x + iy 2 − x − y 2 − i x − iy 2 = 3 n=0 i n x + i n y 2 , a one to one isometry between two Hilbert spaces actually preserves inner products. 9 This definition also holds if ℓ 2 (Z) is replaced by ℓ 2 (S), with an obvious change in the range of the summation. Alternatively, the sequences of ℓ 2 (S) can be regarded as sequences of ℓ 2 (Z) that vanish for k / ∈ S. 10 We recall that the elements of L 2 (T) are actually classes of equivalence of functions that are equal a.e. on T. The utilization of these classes of equivalence is fundamental to make the correspondence between elements of ℓ 2 (Z) and L 2 (T) well defined and one to one.