{"id":791,"date":"2018-07-08T12:04:52","date_gmt":"2018-07-08T10:04:52","guid":{"rendered":"https:\/\/www.labex-palm.fr\/approximate-survey-propagation-for-statistical-inference\/"},"modified":"2020-10-14T10:33:22","modified_gmt":"2020-10-14T08:33:22","slug":"approximate-survey-propagation-for-statistical-inference","status":"publish","type":"post","link":"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/","title":{"rendered":"Approximate survey propagation for statistical inference"},"content":{"rendered":"\n<h3 class=\"wp-block-heading\">Fabrizio Antenucci, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborov\u00e1<\/h3>\n\n\n\n<p><strong>A generic inference problem can be described in the following way: given a set of measurements (that can be noisy or even non linear), how can we reconstruct the original signal from which they come from? What is the reconstruction error? Which kind of algorithms can we use?&nbsp;&nbsp;These questions can be addressed in simple generative models in which one generates a set of artificial data from a given signal through a known process (the teacher) and play the inference game (which is assigned to a student). This is a probabilistic setting that naturally brings to disordered statistical physics models.<\/strong><\/p>\n\n\n<div class=\"art-article\">\n<p style=\"text-align: center;\" align=\"center\"><img decoding=\"async\" loading=\"lazy\" src=\"\/images\/Highlights\/urbani.png\" alt=\"urbani\" width=\"400\" height=\"279\"><\/p>\n<p style=\"text-align: justify;\"><span lang=\"EN-US\">In the last work we have analyzed what happens when, in the inference game, the information about the statistical nature of the generative models is not used properly. In this case the student does not know perfectly the probabilistic informations about the teacher and we have shown that the reconstruction ability of a simple algorithm, called Approximate Message Passing (AMP), is degraded. This is due to glassiness in the statistical distribution (the posterior) over the signal. Therefore we have introduced a new algorithm, that we have called Approximate Survey Propagation (ASP) that extends AMP to include glassy effect<\/span><span lang=\"EN-US\">s. We have shown that this algorithm perform much better than AMP. This is shown in the figure where we plot the Mean Squared Error (MSE) between the reconstructed signal (through the two different algorithms) and the true one. The orange line represents the MSE that can be achieved when the student uses properly the information on the teacher.<\/span><\/p>\n<\/div>\n\n\n<p class=\"has-background\" style=\"background-color:#e3e6e7\">Fabrizio Antenucci, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborov\u00e1,&nbsp;<em>Approximate Survey Propagation for Statistical Inference, <\/em>J. Stat. Mech. (2019)&nbsp;arXiv:1807.01296<\/p>\n\n\n\n<p class=\"has-text-color\" style=\"color:#0071a1\">R\u00e9sultats obtenus dans le cadre du projet <strong>StatPhysDisSys<\/strong> financ\u00e9par le th\u00e8me 2 du LabEx PALM et port\u00e9par&nbsp;Pierfrancesco Urbani (IPhT)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Fabrizio Antenucci, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborov\u00e1 A generic inference problem can be [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":4011,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[45],"tags":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.8.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Approximate survey propagation for statistical inference - Labex-Palm<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Approximate survey propagation for statistical inference - Labex-Palm\" \/>\n<meta property=\"og:description\" content=\"Fabrizio Antenucci, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborov\u00e1 A generic inference problem can be [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/\" \/>\n<meta property=\"og:site_name\" content=\"Labex-Palm\" \/>\n<meta property=\"article:published_time\" content=\"2018-07-08T10:04:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-10-14T08:33:22+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.labex-palm.fr\/wp-content\/uploads\/2020\/10\/journal_cover.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"250\" \/>\n\t<meta property=\"og:image:height\" content=\"250\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Kroox\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kroox\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/\",\"url\":\"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/\",\"name\":\"Approximate survey propagation for statistical inference - Labex-Palm\",\"isPartOf\":{\"@id\":\"https:\/\/www.labex-palm.fr\/#website\"},\"datePublished\":\"2018-07-08T10:04:52+00:00\",\"dateModified\":\"2020-10-14T08:33:22+00:00\",\"author\":{\"@id\":\"https:\/\/www.labex-palm.fr\/#\/schema\/person\/b6ac215c0a50acc10c0f5a7549d1574e\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.labex-palm.fr\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Approximate survey propagation for statistical inference\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.labex-palm.fr\/#website\",\"url\":\"https:\/\/www.labex-palm.fr\/\",\"name\":\"Labex-Palm\",\"description\":\"Physique Atomes Lumi\u00e8re Mati\u00e8re\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.labex-palm.fr\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.labex-palm.fr\/#\/schema\/person\/b6ac215c0a50acc10c0f5a7549d1574e\",\"name\":\"Kroox\",\"url\":\"https:\/\/www.labex-palm.fr\/en\/author\/kroox\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Approximate survey propagation for statistical inference - Labex-Palm","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/","og_locale":"en_US","og_type":"article","og_title":"Approximate survey propagation for statistical inference - Labex-Palm","og_description":"Fabrizio Antenucci, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborov\u00e1 A generic inference problem can be [&hellip;]","og_url":"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/","og_site_name":"Labex-Palm","article_published_time":"2018-07-08T10:04:52+00:00","article_modified_time":"2020-10-14T08:33:22+00:00","og_image":[{"width":250,"height":250,"url":"https:\/\/www.labex-palm.fr\/wp-content\/uploads\/2020\/10\/journal_cover.jpeg","type":"image\/jpeg"}],"author":"Kroox","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Kroox","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/","url":"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/","name":"Approximate survey propagation for statistical inference - Labex-Palm","isPartOf":{"@id":"https:\/\/www.labex-palm.fr\/#website"},"datePublished":"2018-07-08T10:04:52+00:00","dateModified":"2020-10-14T08:33:22+00:00","author":{"@id":"https:\/\/www.labex-palm.fr\/#\/schema\/person\/b6ac215c0a50acc10c0f5a7549d1574e"},"breadcrumb":{"@id":"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.labex-palm.fr\/en\/approximate-survey-propagation-for-statistical-inference\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.labex-palm.fr\/en\/"},{"@type":"ListItem","position":2,"name":"Approximate survey propagation for statistical inference"}]},{"@type":"WebSite","@id":"https:\/\/www.labex-palm.fr\/#website","url":"https:\/\/www.labex-palm.fr\/","name":"Labex-Palm","description":"Physique Atomes Lumi\u00e8re Mati\u00e8re","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.labex-palm.fr\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.labex-palm.fr\/#\/schema\/person\/b6ac215c0a50acc10c0f5a7549d1574e","name":"Kroox","url":"https:\/\/www.labex-palm.fr\/en\/author\/kroox\/"}]}},"_links":{"self":[{"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/posts\/791"}],"collection":[{"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/comments?post=791"}],"version-history":[{"count":3,"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/posts\/791\/revisions"}],"predecessor-version":[{"id":4014,"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/posts\/791\/revisions\/4014"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/media\/4011"}],"wp:attachment":[{"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/media?parent=791"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/categories?post=791"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.labex-palm.fr\/en\/wp-json\/wp\/v2\/tags?post=791"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}