Strong Oracle Optimality of Folded Concave Penalized Estimation

Add to your list(s) Download to your calendar using vCal

• Jianqing Fan, Princeton University
• Friday 15 February 2013, 16:00-17:00
• MR12, CMS, Wilberforce Road, Cambridge, CB3 0WB.

If you have a question about this talk, please contact Richard Samworth.

Folded concave penalization methods such as SCAD have been shown to enjoy the strong oracle property for high-dimensional sparse estimation.

However, a folded concave penalization problem usually has multiple local solutions and the oracle property is established only for one of the unknown local solutions. A challenging fundamental issue still remains that it is not clear whether the local optimal solution computed by a given optimization algorithm possesses those nice theoretical properties. To close this important theoretical gap in over a decade, we provide a unified theory to show explicitly how to obtain the oracle solution using the local linear approximation algorithm. For a folded concave penalized estimation problem, we show that as long as the problem is localizable and the oracle estimator is well behaved, we can obtain the oracle estimator by using the one-step local linear approximation. In addition, once the oracle estimator is obtained, the local linear approximation algorithm converges, namely produces the same estimator in the next iteration. We show that the LASSO is a good initial estimator, which produces the oracle estimator using the one-step LLA algorithm for folded concave penalization methods. This is demonstrated by using three classical sparse estimation problems, namely, the sparse linear regression, the sparse logistic regression and the sparse precision matrix estimation, and illustrates the power of combining the LASSO and SCAD to solve sparse inartistic estimation problem.

(Joint work with Lingzhou Xue and Hui Zou.)

This talk is part of the Statistics series.

This talk is included in these lists:

• All CMS events
• All Talks (aka the CURE list)
• CMS Events
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• DPMMS Lists
• DPMMS info aggregator
• DPMMS lists
• Guy Emerson's list
• Hanchen DaDaDash
• Interested Talks
• MR12, CMS, Wilberforce Road, Cambridge, CB3 0WB
• Machine Learning
• School of Physical Sciences
• Statistical Laboratory info aggregator
• Statistics
• Statistics Group
• bld31
• custom
• rp587

Note that ex-directory lists are not shown.