BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//CREST - ECPv5.1.3//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:CREST
X-ORIGINAL-URL:https://crest.science
X-WR-CALDESC:Events for CREST
BEGIN:VTIMEZONE
TZID:Europe/Helsinki
BEGIN:DAYLIGHT
TZOFFSETFROM:+0200
TZOFFSETTO:+0300
TZNAME:EEST
DTSTART:20220327T010000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0300
TZOFFSETTO:+0200
TZNAME:EET
DTSTART:20221030T010000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=Europe/Helsinki:20220131T140000
DTEND;TZID=Europe/Helsinki:20220131T151500
DTSTAMP:20260711T220342
CREATED:20210922T060153Z
LAST-MODIFIED:20220118T085941Z
UID:12992-1643637600-1643642100@crest.science
SUMMARY:Yihong Wu (Yale University) - "Self-regularizing Property of Nonparametric Maximum Likelihood Estimator in Mixture Models"
DESCRIPTION:Statistical Seminar: Every Monday at 2:00 pm.\nTime: 2:00 pm – 3:15 pm\nDate: 31th of January 2022\nPlace: en visio \nYihong Wu (Yale University) – “Self-regularizing Property of Nonparametric Maximum Likelihood Estimator in Mixture Models” \nAbstract: Introduced by Kiefer and Wolfowitz 1956\, the nonparametric maximum likelihood estimator (NPMLE) is a widely used methodology for learning mixture models and empirical Bayes estimation. Sidestepping the non-convexity in mixture likelihood\, the NPMLE estimates the mixing distribution by maximizing the total likelihood over the space of probability measures\, which can be viewed as an extreme form of overparameterization. \nIn this work we discover a surprising property of the NPMLE solution. Consider\, for example\, a Gaussian mixture model on the real line with a subgaussian mixing distribution. Leveraging complex-analytic techniques\, we show that with high probability the NPMLE based on a sample of size n has O(\log n) atoms (mass points)\, significantly improving the deterministic upper bound of n due to Lindsay 1983. Notably\, any such Gaussian mixture is statistically indistinguishable from a finite one with O(\log n) components (and this is tight for certain mixtures). Thus\, absent any explicit form of model selection\, NPMLE automatically chooses the right model complexity\, a property we term self-regularization. Statistical applications and extensions to other exponential families will be given. Time permitting\, we will discuss recent progress and open problems on the optimal regret in empirical Bayes and the role of NPMLE. This is based on joint work with Yury Polyanskiy (MIT): https://arxiv.org/abs/2008.08244 and https://arxiv.org/abs/2109.03943 \n  \nOrganizers:\nCristina BUTUCEA (CREST)\, Alexandre TSYBAKOV (CREST)\, Karim LOUNICI (CMAP) \, Jaouad MOURTADA (CREST)\nSponsors:\nCREST-CMAP \n
URL:https://crest.science/event/yihong-wu-yale-university-tba/
CATEGORIES:Statistics
ATTACH;FMTTYPE=:
END:VEVENT
END:VCALENDAR