{"id":176,"date":"2020-08-16T03:00:07","date_gmt":"2020-08-16T03:00:07","guid":{"rendered":"https:\/\/groups.cs.umass.edu\/infofusion\/?page_id=176"},"modified":"2020-08-16T03:00:08","modified_gmt":"2020-08-16T03:00:08","slug":"4thought-early-forecasting-of-alzheimers-disease","status":"publish","type":"page","link":"https:\/\/groups.cs.umass.edu\/infofusion\/4thought-early-forecasting-of-alzheimers-disease\/","title":{"rendered":"4Thought: Early Forecasting of Alzheimer&#8217;s Disease"},"content":{"rendered":"\n<p>Project 4Thought aims to preemptively forecast Alzheimer\u2019s disease. We are looking to identify subjects who will get Alzheimer&#8217;s at least 2 years ahead of the standard diagnosis, based on brain structural MRIs and cognitive test scores.<\/p>\n\n\n\n<p>4Thought was homegrown here at CICS in the Information Fusion Lab, supported by the Manning\/IALS Innovation Award. 4Thought was initially led by Joie Wu, and is now led by Sidong Zhang. Our mentors from IALS are Peter Reinhart and Karen Utgoff.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong><em>Detailed Description of Project 4Thought<\/em><\/strong><\/h4>\n\n\n\n<p>Alzheimer\u2019s disease (AD)&nbsp; is a degenerative condition that causes major changes in the brain, leading to cognitive decline and death in a matter of a few years. AD is incurable, many treatments have been tried, immense effort has been expended into clinical trials and nothing has worked so far. The main reason is that, by the time AD is diagnosed, 60% of brain matter is gone and the process is irreversible. The sketch on the left in the image below shows this degeneration. In this project, we\u2019re trying to identify people that will almost definitely get Alzheimer\u2019s at least 2 years ahead of an official diagnostic. We\u2019ve used data from the ADNI study that monitors people every 6 months over a period of a few years. In that study, some people go from cognitively normal (CN), to cognitively impaired (MCI), to then being diagnosed with AD. ADNI contains brain MRIs and pet scans that document these transitions &#8211; these are shown on the right in the image below.<\/p>\n\n\n\n<p><img fetchpriority=\"high\" decoding=\"async\" width=\"512\" height=\"296\" src=\"https:\/\/lh5.googleusercontent.com\/3L4CspufJzt9HFmkaQAnrze09IKffyqbieMXQW-v3erD7ewcl2nNDN2L98JWC1pTd80OvPbiOPG1JZeWz02W6i0W2emcYndCTbTpjcH5qCDKBVJ0G2P08R3PoWphV4Ozpc1u-JsN\"><\/p>\n\n\n\n<p>The question we are trying to answer is: can we identify those that will get AD while they\u2019re still in the CN stage? If so, we could try to preemptively treat them.<\/p>\n\n\n\n<p>To achieve this, we came up with a framework called FLARe, which focuses on long-term forecasting. The idea behind it is that we learn some abstractions of the subject\u2019s health state and we forecast this abstraction. Then, we learn how to map the abstract health status to a diagnosis. Intuitively, FLARe works as the deep learning version of an HMM.<\/p>\n\n\n\n<p><img decoding=\"async\" width=\"564\" height=\"322\" src=\"https:\/\/lh3.googleusercontent.com\/TAvbhVtps2rU2CD-pGhfwgaciMF88wgY7bZHQtJUQDN3zSAk3KXDDG7qqr2G6-7Ctblcylgl099y6aPNK0BlyQW8at2aHQbhr_hTwgrOxMg2agxy2odIQdN3f5hQvw3qT545o-qa\"><\/p>\n\n\n\n<p><img decoding=\"async\" src=\"https:\/\/lh5.googleusercontent.com\/NXIhGQeBLaHJ_ccwb1RT0ELRKEF4NE-HD-JZ0--mOGF3mAw21hMmWd3yXskLCRNScWYoha9kxo28aFPf1ZX8WWcEKUMUhUmmwrUzN57Nu4NCbblpQM2ZVExaiWDT9yo9tYqzh0Wt\" width=\"521\" height=\"297\"><\/p>\n\n\n\n<p>Below are some preliminary results. First, we compared against the s.o.t.a. Most of the existing algorithms are only evaluated for a forecasting window of 6 months in advance, which we know is insufficient. The green bar shows the contender which does ok for a forecasting window of 6-12 months, but once we go beyond that the F1 score plummets. FLARe is better across the board, but especially over long-term time windows, which is exactly what we\u2019ve designed it for.<\/p>\n\n\n\n<p><img loading=\"lazy\" decoding=\"async\" width=\"563\" height=\"322\" src=\"https:\/\/lh6.googleusercontent.com\/LugvSbRjF5AeV7nFPbEs0thI1y7rue4SfjEoUVZjp7b4JI8n0BIhH8g73fT1VkUjzYVFx7GGLGXkfXOiWAhgruHa-k8XBIH0KnN5oA3rgnt6wg617RO0MSkntHu_q87oEAOiagYh\"><\/p>\n\n\n\n<p>More recently, we obtained preliminary results showing that the fusing of several modalities, cognitive test scores, volumetric features from the brain, raw brain images, in the forecasting framework results in performance improvement over relying on any single modality. We are researching different ways to integrate these modalities, some using the same principles as ShortFuse, while others considering the redundancy of information encoded with different modalities. We are also incorporating domain knowledge about affected areas of the brain and considering differences in scans between consecutive visits.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/hH62AZy2lvp3GA2e6nSVYejjnQa26GBEPZ9dBNiXCIkVmbgyhzN8zxYXvo6iAy0tHZXbcyqmZrQlPxyj6kpP7R_mPdE-q4lIaXoMfeytQTSezFIH2ARxLdeLTS213G5OMnhifTN8\" width=\"194\" height=\"195\"><\/td><td><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/J5m-DguwJiTyWHUD0Y8lD8px_EMdl7eAoeMe8SSwSbHBd79jlQvWooS1SJFMpGXqJNQMIlrpNKlbPeiJwZBRA0rt41kPdS_7cHzMP3Mxm_nV2zPFH1jG2Yk6Xps4CsKJc4A6as2R\" width=\"194\" height=\"195\"><\/td><td><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/lh5.googleusercontent.com\/gaBSd0qdiMI2Etyv7yE_cI3IDXSbDuVyyfQPgBINy9l1b8RACtCphFPYNHAHGFZJrgz2TPdafaAduO_xJ7hvhpMgg25ETh6SNuN0e1HFyf95FZLkRYhLfrmV04SdJtem2x5oGX26\" width=\"194\" height=\"195\"><\/td><\/tr><\/tbody><\/table><figcaption>Areas of the brain that are affected by AD, as seen on MRIs.<\/figcaption><\/figure>\n\n\n\n<p>One of the long-term objectives of this study is to provide some analysis of the images to radiologists and identify some areas of interest in the MRIs.<\/p>\n\n\n\n<p>Also, once completed, our framework will be included in a multi-stage selection procedure of study subject cohorts for clinical trials of AD prevention drugs.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong><em>Resources<\/em><\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>Link to FLARe blog post and code<\/li><\/ul>\n\n\n\n<p><a href=\"https:\/\/github.com\/Information-Fusion-Lab-Umass\/flare\">https:\/\/github.com\/Information-Fusion-Lab-Umass\/flare<\/a><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Link to code for AD diagnostics replication study<\/li><\/ul>\n\n\n\n<p><a href=\"https:\/\/github.com\/Information-Fusion-Lab-Umass\/alzheimers-cnn-study\">https:\/\/github.com\/Information-Fusion-Lab-Umass\/alzheimers-cnn-study<\/a><\/p>\n\n\n\n<p><\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong><em>Publications&nbsp;<\/em><\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>Yeahuay Joie Wu, Surya Teja Devarakonda and Madalina Fiterau, FLARe: Forecasting by Learning Anticipated Representations, Machine Learning in Healthcare Conference August 2019. <a href=\"https:\/\/arxiv.org\/abs\/1904.08930\">https:\/\/arxiv.org\/abs\/1904.08930<\/a><\/li><li>Yi Ren Fung, Ziqiang Guan, Ritesh Kumar, Yeahuay Joie Wu and Madalina Fiterau, Alzheimer&#8217;s Disease Brain MRI Classification: Challenges and Insights, IJCAI ARIAL Workshop August 2019. <a href=\"https:\/\/arxiv.org\/abs\/1906.04231\">https:\/\/arxiv.org\/abs\/1906.04231<\/a><\/li><li>Ziqiang Guan, Ritesh Kumar, Yi Ren Fung, Yeahuay Wu and Madalina Fiterau, A Comprehensive Study of Alzheimer&#8217;s Disease Classification Using Convolutional Neural Networks, Tech Report. ArXiv April 2019. <a href=\"https:\/\/arxiv.org\/abs\/1904.07950\">https:\/\/arxiv.org\/abs\/1904.07950<\/a><\/li><\/ul>\n\n\n\n<p><\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong><em>Acknowledgements<\/em><\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>Manning\/IALS Innovation Award: funding for the 4Thought project, focused on providing tools for the early detection of Alzheimer\u2019s Disease from brain fMRIs and patient records.<\/li><li>The data used for this research were obtained from the Alzheimer\u2019s Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu). The ADNI was launched in 2003 as a public-private partnership, led by Principal Investigator Michael W. Weiner, MD. The primary goal of ADNI has been to test whether serial magnetic resonance imaging (MRI), positron emission tomography (PET), other biological markers, and clinical and neuropsychological assessment can be combined to measure the progression of mild cognitive impairment (MCI) and early Alzheimer\u2019s disease (AD). For up-to-date information, see <a href=\"http:\/\/www.adni-info.org\">www.adni-info.org<\/a>.<\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Project 4Thought aims to preemptively forecast Alzheimer\u2019s disease. We are looking to identify subjects who will get Alzheimer&#8217;s at least 2 years ahead of the standard diagnosis, based on brain structural MRIs and cognitive test scores. 4Thought was homegrown here at CICS in the Information Fusion Lab, supported by the Manning\/IALS Innovation Award. 4Thought was &hellip; <a href=\"https:\/\/groups.cs.umass.edu\/infofusion\/4thought-early-forecasting-of-alzheimers-disease\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;4Thought: Early Forecasting of Alzheimer&#8217;s Disease&#8221;<\/span><\/a><\/p>\n","protected":false},"author":35,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-176","page","type-page","status-publish","hentry","group-blog","no-sidebar","hfeed"],"_links":{"self":[{"href":"https:\/\/groups.cs.umass.edu\/infofusion\/wp-json\/wp\/v2\/pages\/176","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/groups.cs.umass.edu\/infofusion\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/groups.cs.umass.edu\/infofusion\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/groups.cs.umass.edu\/infofusion\/wp-json\/wp\/v2\/users\/35"}],"replies":[{"embeddable":true,"href":"https:\/\/groups.cs.umass.edu\/infofusion\/wp-json\/wp\/v2\/comments?post=176"}],"version-history":[{"count":7,"href":"https:\/\/groups.cs.umass.edu\/infofusion\/wp-json\/wp\/v2\/pages\/176\/revisions"}],"predecessor-version":[{"id":192,"href":"https:\/\/groups.cs.umass.edu\/infofusion\/wp-json\/wp\/v2\/pages\/176\/revisions\/192"}],"wp:attachment":[{"href":"https:\/\/groups.cs.umass.edu\/infofusion\/wp-json\/wp\/v2\/media?parent=176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}