AMIA ... Annual Symposium Proceedings

In 2021, the Association of American Medical Colleges published Telehealth Competencies Across the Learning Continuum, a roadmap for designing telemedicine curricula and evaluating learners. While this document advances educators' shared understanding of telemedicine's core content and performance expectations, it does not include turn-key-ready evaluation instruments. At the University of Oklahoma School of Community Medicine, we developed a year-long telemedicine curriculum for third-year medical and second-year physician assistant students...

Despite the high prevalence and burden of mental health conditions, there is a global shortage of mental health providers. Artificial Intelligence (AI) methods have been proposed as a way to address this shortage, by supporting providers with less extensive training as they deliver care. To this end, we developed the AI-Assisted Provider Platform (A2P2), a text-based virtual therapy interface that includes a response suggestion feature, which supports providers in delivering protocolized therapies empathetically...

Growing digital access accelerates digital transformation of clinical trials where digital solutions (DSs) are increasingly and widely leveraged for improving trial efficiency, effectiveness, and accessibility. Many factors impact DS success including technology barriers, privacy concerns, or user engagement activities. It is unclear how those factors are considered or reported in the literature. Here, we perform a formative feasibility scoping review to identify gaps impacting DS quality and reproducibility in trials...

The performance of deep learning models in the health domain is desperately limited by the scarcity of labeled data, especially for specific clinical-domain tasks. Conversely, there are vastly available clinical unlabeled data waiting to be exploited to improve deep learning models where their training labeled data are limited. This paper investigates the use of task-specific unlabeled data to boost the performance of classification models for the risk stratification of suspected acute coronary syndrome. By leveraging large numbers of unlabeled clinical notes in task-adaptive language model pretraining, valuable prior task-specific knowledge can be attained...

Low-yield repetitive laboratory diagnostics burden patients and inflate cost of care. In this study, we assess whether stability in repeated laboratory diagnostic measurements is predictable with uncertainty estimates using electronic health record data available before the diagnostic is ordered. We use probabilistic regression to predict a distribution of plausible values, allowing use-time customization for various definitions of "stability" given dynamic ranges and clinical scenarios. After converting distributions into "stability" scores, the models achieve a sensitivity of 29% for white blood cells, 60% for hemoglobin, 100% for platelets, 54% for potassium, 99% for albumin and 35% for creatinine for predicting stability at 90% precision, suggesting those fractions of repetitive tests could be reduced with low risk of missing important changes...

Data Augmentation is a crucial tool in the Machine Learning (ML) toolbox because it can extract novel, useful training images from an existing dataset, thereby improving accuracy and reducing overfitting in a Deep Neural Network (DNNs). However, clinical dermatology images often contain irrelevant background information,such as furniture and objects in the frame. DNNs make use of that information when optimizing the loss function. Data augmentation methods that preserve this information risk creating biases in the DNN's understanding (for example, that objects in a particular doctor's office are a clue that the patient has cutaneous T-cell lymphoma)...

Electronic medical records (EMRs) are stored in relational databases. It can be challenging to access the required information if the user is unfamiliar with the database schema or general database fundamentals. Hence, researchers have explored text-to-SQL generation methods that provide healthcare professionals direct access to EMR data without needing a database expert. However, currently available datasets have been essentially "solved" with state-of-the-art models achieving accuracy greater than or near 90%...

The National Library of Medicine (NLM)'s Value Set Authority Center (VSAC) is a crowd-sourced repository with a potential for substantial discrepancy among value sets for the same clinical concepts. To characterize this potential problem, we identified the most common chronic conditions affecting US adults and assessed for discrepancy among VSAC ICD-10-CM value sets for these conditions. An analysis of 32 value sets for 12 conditions identified that a median of 45% of codes for a given condition were potentially problematic (included in at least one, but not all, theoretically equivalent value sets)...

Widespread adoption of electronic health records (EHR) in the U.S. has been followed by unintended consequences, overexposing clinicians to widely reported EHR limitations. As an attempt to fixing the EHR, we propose the use of a clinical context ontology (CCO), applied to turn implicit contextual statements into formally represented data in the form of concept-relationship-concept tuples. These tuples form what we call a patient specific knowledge base (PSKB), a collection of formally defined tuples containing facts about the patient's care context...

Natural Language Processing (NLP) methods have been broadly applied to clinical tasks. Machine learning and deep learning approaches have been used to improve the performance of clinical NLP. However, these approaches require sufficiently large datasets for training, and trained models have been shown to transfer poorly across sites. These issues have led to the promotion of data collection and integration across different institutions for accurate and portable models. However, this can introduce a form of bias called confounding by provenance...

The lack of relevant annotated datasets represents one key limitation in the application of Natural Language Processing techniques in a broad number of tasks, among them Protected Health Information (PHI) identification in Norwegian clinical text. In this work, the possibility of exploiting resources from Swedish, a very closely related language, to Norwegian is explored. The Swedish dataset is annotated with PHI information. Different processing and text augmentation techniques are evaluated, along with their impact in the final performance of the model...

Amyotrophic lateral sclerosis (ALS) is a rare and devastating neurodegenerative disorder that is highly heterogeneous and invariably fatal. Due to the unpredictable nature of its progression, accurate tools and algorithms are needed to predict disease progression and improve patient care. To address this need, we developed and compared an extensive set of screener-learner machine learning models to accurately predict the ALS Function-Rating-Scale (ALSFRS) score reduction between 3 and 12 months, by paring 5 state-of-arts feature selection algorithms with 17 predictive models and 4 ensemble models using the publicly available Pooled Open Access Clinical Trials Database (PRO-ACT)...

Search for information is now an integral part of healthcare. Searches are enabled by search engines whose objective is to efficiently retrieve the relevant information for the user query. When it comes to retrieving biomedical text and literature, Essie search engine developed at the National Library of Medicine (NLM) performs exceptionally well. However, Essie is a software system developed for NLM that has ceased development and support. On the other hand, Solr is a popular opensource enterprise search engine used by many of the world's largest internet sites, offering continuous developments and improvements along with the state-of-the-art features...

The types of clinical notes in electronic health records (EHRs) are diverse and it would be great to standardize them to ensure unified data retrieval, exchange, and integration. The LOINC Document Ontology (DO) is a subset of LOINC that is created specifically for naming and describing clinical documents. Despite the efforts of promoting and improving this ontology, how to efficiently deploy it in real-world clinical settings has yet to be explored. In this study we evaluated the utility of LOINC DO by mapping clinical note titles collected from five institutions to the LOINC DO and classifying the mapping into three classes based on semantic similarity between note t itl es and LOINC DO codes...

Communicating health-related probabilities to patients and the public presents challenges, although multiple studies have demonstrated that we can promote comprehension and appropriate application of numbers by matching presentation formats (e.g., percentage, bar charts, icon arrays) to communication goal (e.g., improving recall, decreasing worry, taking action). We used this literature to create goal-driven, evidence-based guidance to support health communicators in conveying probabilities. We then conducted semi-structured interviews with 39 health communicators to understand: communicators' goals for expressing probabilities, formats they choose to convey probabilities, and perceptions of prototypes of our "communicating numbers clearly" guidance...

Clinical trials are indispensable in developing new treatments, but they face obstacles in patient recruitment and retention, hindering the enrollment of necessary participants. To tackle these challenges, deep learning frameworks have been created to match patients to trials. These frameworks calculate the similarity between patients and clinical trial eligibility criteria, considering the discrepancy between inclusion and exclusion criteria. Recent studies have shown that these frameworks outperform earlier approaches...

The structure and semantics of clinical notes vary considerably across different Electronic Health Record (EHR) systems, sites, and institutions. Such heterogeneity hampers the portability of natural language processing (NLP) models in extracting information from the text for clinical research or practice. In this study, we evaluate the contextual variation of clinical notes by measuring the semantic and syntactic similarity of the notes of two sets of physicians comprising four medical specialties across EHR migrations at two Mayo Clinic sites...

Electronic health records (EHRs) contain a wealth of information that can be used to further precision health. One particular data element in EHRs that is not only under-utilized but oftentimes unaccounted for is missing data. However, missingness can provide valuable information about comorbidities and best practices for monitoring patients, which could save lives and reduce burden on the healthcare system. We characterize patterns of missing data in laboratory measurements collected at the University of Pennsylvania Hospital System from long-term COVID-19 patients and focus on the changes in these patterns between 2020 and 2021...

Acute Respiratory Distress Syndrome (ARDS) is a life-threatening lung injury, hallmarks of which are bilateral radiographic opacities. Studies have shown that early recognition of ARDS could reduce severity and lethal clinical sequela. A Convolutional Neural Network (CNN) model that can identify bilateral pulmonary opacities on chest x-ray (CXR) images can aid early ARDS recognition. Obtaining large datasets with ground truth labels to train CNNs is challenging, as medical image annotation requires clinical expertise and meticulous consideration...

Three major telehealth delivery models-home-based, community-based, and telephone-based-have been adopted to enable remote patient monitoring of older adults to improve patient experience and reduce healthcare costs. Even though prior work has evaluated each of these delivery models, we know less about the perceptions and user experiences across these telehealth delivery models for older adults. In the present work, we addressed this research gap by interviewing 16 older adults who had experience using all these telehealth delivery models...