{"id":215,"date":"2022-04-05T18:30:00","date_gmt":"2022-04-05T18:30:00","guid":{"rendered":"https:\/\/groups.cs.umass.edu\/equate-ml\/?p=215"},"modified":"2022-04-07T18:16:27","modified_gmt":"2022-04-07T18:16:27","slug":"paper-realmvp-a-change-of-variables-method-for-rectangular-matrix-vector-products","status":"publish","type":"post","link":"https:\/\/groups.cs.umass.edu\/equate-ml\/2022\/04\/05\/paper-realmvp-a-change-of-variables-method-for-rectangular-matrix-vector-products\/","title":{"rendered":"Paper: RealMVP: A Change of Variables Method For Rectangular Matrix-Vector Products"},"content":{"rendered":"\n<p>Rectangular matrix-vector products are used extensively throughout machine learning and are fundamental to neural networks such as multi-layer perceptrons, but are notably absent as normalizing flow layers. This paper identifies this methodological gap and plugs it with a tall and wide MVP change of variables formula. Our theory builds up to a practical algorithm that envelops existing dimensionality increasing flow methods such as augmented flows. We show that tall MVPs are closely related to the stochastic inverse of wide MVPs and empirically demonstrate that they improve density estimation over existing dimension changing methods.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link\" href=\"https:\/\/proceedings.mlr.press\/v130\/cunningham21a.html\">Paper<\/a><\/div>\n\n\n\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link\" href=\"https:\/\/github.com\/Information-Fusion-Lab-Umass\/NuX\/blob\/master\/nux\/flows\/surjective\/rectangular_mvp.py\">Github<\/a><\/div>\n<\/div>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Rectangular matrix-vector products are used extensively throughout machine learning and are fundamental to neural networks such as multi-layer perceptrons, but are notably absent as normalizing flow layers. This paper identifies this methodological gap and plugs it with a tall and wide MVP change of variables formula. Our theory builds up to a practical algorithm that &hellip; <a href=\"https:\/\/groups.cs.umass.edu\/equate-ml\/2022\/04\/05\/paper-realmvp-a-change-of-variables-method-for-rectangular-matrix-vector-products\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Paper: RealMVP: A Change of Variables Method For Rectangular Matrix-Vector Products&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":179,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[32,29,26],"class_list":["post-215","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-ml","tag-32","tag-aistats","tag-paper","group-blog","hfeed"],"_links":{"self":[{"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/posts\/215","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/comments?post=215"}],"version-history":[{"count":1,"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/posts\/215\/revisions"}],"predecessor-version":[{"id":216,"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/posts\/215\/revisions\/216"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/media\/179"}],"wp:attachment":[{"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/media?parent=215"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/categories?post=215"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/groups.cs.umass.edu\/equate-ml\/wp-json\/wp\/v2\/tags?post=215"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}