## covariance shrinkage:
nonlinear: http://www.econ.uzh.ch/dam/jcr:ffffffff-935a-b0d6-ffff-ffff9fd1f079/AOS989.pdf
http://www.econ.uzh.ch/dam/jcr:ed299b2a-26bb-45cd-a563-bb795a4139d3/jmva_2015.pdf
## spectral density matrix shrinkage
## covariance shrinkage:
nonlinear: http://www.econ.uzh.ch/dam/jcr:ffffffff-935a-b0d6-ffff-ffff9fd1f079/AOS989.pdf
http://www.econ.uzh.ch/dam/jcr:ed299b2a-26bb-45cd-a563-bb795a4139d3/jmva_2015.pdf
## spectral density matrix shrinkage
shalin, thanks for these links---great stuff. I screened through the papers, and below is a short sketch of how this connects to what was discussed yesterday. but first, a quick reminder of the linear shrinkage ansatz I stressed yesterday several times: the shrunken estimator of the functional relation between X and Y is where
is chosen in a way minimizing some distance to the true function
. for me
where the
might be eigenvectors with respect to some PDE problem, or cubic splines, or whatever.
COVARIANCE SHRINKAGE: this is about a shrinkage method for sample eigenvalues when estimating a covariance. therefore, the corresponding eigenvectors don't play the same role as the
in my structure for
. the shrinkage is nonlinear because the shrunken estimator is obtained by
. here
plays the role of
but it is not found by simply minimizing some distance, and hence further thinking is required when applying this in other contexts. Furthermore, the reference point
is not a vector in
but a constant being the same for all principal directions, though the shrinkage is different in each direction. Applying this to my smoothing spline example would mean to shrink each
separately by a similar method, which is different to shrinking things
by
as discussed yesterday.
SPECTRAL DENSITY MATRIX SHRINKAGE: this is about a -dimensional weakly stationary discrete time series, and one is after the spectral density matrix denoted by
. so, this
is a matrix-valued function depending on frequencies
, and the shrunken estimate for
is
. this is linear shrinkage as discussed yesterday. First, the shrinkage is worked out
by
, and
plays the role of
, of course. Second,
plays the role of
with
being the time horizon of the time series (this time dependence should change when the series is NOT stationary). Third,
and
are a parametric and a nonparametric estimate of
, respectively, with
playing the role of
. So, this is indeed the same I wanted to do, because I wanted to take a linear regression for
and do the whole thing
by
.
ALL IN ALL, what was suggested yesterday for smoothing splines is applied in practice, and one could even go beyond the linear shrinkage ansatz though this might be less inuitive. the next step to be discussed in january would be to bring in bootstrapping and to understand how this can be applied repeatedly. for christmas, everybody is welcome to think about what shrinks to what and how much when bootstrapping repeatedly.