Uniform in bandwidth consistency of conditional U-statistics

We introduce a general method to prove uniform in bandwidth consistency of kernel-type function estimators. Examples include the kernel density estimator, the Nadaraya-Watson regression estimator and the conditional empirical process. Our results may be useful to establish uniform consistency of data-driven bandwidth kernel-type function estimators.

We generalize a method for proving uniform in bandwidth consistency results for kernel type estimators developed by the two last named authors. Such results are shown to be useful in establishing consistency of local polynomial estimators of the regression function.

A notion of local $U$-statistic process is introduced and central limit theorems in various norms are obtained for it. This involves the development of several inequalities for $U$-processes that may be useful in other contexts. This local $U$-statistic process is based on an estimator of the density of a function of several sample variables proposed by Frees [J. Amer. Statist. Assoc. 89 (1994) 517--525] and, as a consequence, uniform in bandwidth central limit theorems in th...

U-statistics constitute a large class of estimators, generalizing the empirical mean of a random variable $X$ to sums over every $k$-tuple of distinct observations of $X$. They may be used to estimate a regular functional $\theta(P_{X})$ of the law of $X$. When a vector of covariates $Z$ is available, a conditional U-statistic may describe the effect of $z$ on the conditional law of $X$ given $Z=z$, by estimating a regular conditional functional $\theta(P_{X|Z=\cdot})$. We pr...

Consider the following local empirical process indexed by $K\in \mathcal{G}$, for fixed $h>0$ and $z\in \mathbb{R}^d$: $$G_n(K,h,z):=\sum_{i=1}^n K \Bigl(\frac{Z_i-z}{h^{1/d}}\Big) - \mathbbE \Bigl(K \Bigl(\frac{Z_i-z}{h^{1/d}}\Big)\Big),$$ where the $Z_i$ are i.i.d. on $\mathbb{R}^d$. We provide an extension of a result of Mason (2004). Namely, under mild conditions on $\mathcal{G}$ and on the law of $Z_1$, we establish a uniform functional limit law for the collections of p...

This paper examines the local linear regression (LLR) estimate of the conditional distribution function $F(y|x)$. We derive three uniform convergence results: the uniform bias expansion, the uniform convergence rate, and the uniform asymptotic linear representation. The uniformity in the above results is with respect to both $x$ and $y$ and therefore has not previously been addressed in the literature on local polynomial regression. Such uniform convergence results are especi...

Generalized linear statistics are an unifying class that contains U-statistics, U-quantiles, L-statistics as well as trimmed and winsorized U-statistics. For example, many commonly used estimators of scale fall into this class. GL-statistics only have been studied under independence; in this paper, we develop an asymptotic theory for GL-statistics of sequences which are strongly mixing or L^1 near epoch dependent on an absolutely regular process. For this purpose, we prove an...

We prove a uniform functional law of the logarithm for the local empirical process. To accomplish this we combine techniques from classical and abstract empirical process theory, Gaussian distributional approximation and probability on Banach spaces. The body of techniques we develop should prove useful to the study of the strong consistency of d-variate kernel-type nonparametric function estimators.

We use local polynomial fitting to estimate the nonparametric M-regression function for strongly mixing stationary processes $\{(Y_{i},\underline{X}_{i})\}$. We establish a strong uniform consistency rate for the Bahadur representation of estimators of the regression function and its derivatives. These results are fundamental for statistical inference and for applications that involve plugging in such estimators into other functionals where some control over higher order term...

In this paper, we are concerned with the stochastic process \begin{equation} \beta_{n}(q_{t},t)=\beta_{n}(t)=\frac{1}{\sqrt{n}}\sum_{j=1}^{n}\left\{G_{t,n}(Y(t))-G_{t}(Y_{j}(t))\right\} q_{t}(Y_{j}(t)), \tag{A} \end{equation} where for $n\geq1$ and $T>0$, the sequences $\{Y_{1}(t),Y_{2}(t),...,Y_{n}(t),t\in [0,T]\}$ are independant observations of some real stochastic process ${Y(t),t\in [0,T]}$, for each $t \in [0,T]$, $G_{t}$ is the distribution function of $% Y(t)$ and $G_...