Nonparametric Divergence Estimators for Independent Subspace Analysis (2011)

Barnabas Poczos, Zoltan Szabo, Jeff Schneider

Abstract

In this paper we propose new nonparametric Renyi, Tsallis, and L2 divergence estimators and demonstrate their applicability to mutual information estimation and independent subspace analysis.
Given two independent and identically distributed samples, a "naive" divergence estimation approach would simply estimate the underlying densities, and plug these densities into the corresponding integral formulae. In contrast, our estimators avoid the need to consistently estimate these densities, and still they can lead to consistent estimations. Numerical experiments illustrate the efficiency of the algorithms.

Full text

Download (application/pdf, 457.6 kB)

Approximate BibTeX Entry

@inproceedings{poczos11EUSIPCO_ISA,
    Howpublished = {EUSIPCO 2011},
    Year = {2011},
    Booktitle = {EUSIPCO 2011},
    Author = { Barnabas Poczos, Zoltan Szabo, Jeff Schneider },
    Title = {Nonparametric Divergence Estimators for Independent Subspace Analysis}
}