AI-enabled imaging and diagnostics previously thought impossible
In partnership with healthcare organizations globally, we’re researching robust new AI-enabled tools focused on diagnostics to assist clinicians. Drawing from diverse datasets, high-quality labels, and state-of-the-art deep learning techniques, we are making models that we hope will eventually support medical specialists in diagnosing disease. We’re excited to further develop this research towards new frontiers—and to demonstrate that AI has the ability to enable novel, transformative diagnostics.
Using AI to help doctors address eye disease
Automated Retinal Disease Assessment (ARDA) is being used to help clinicians detect diabetic retinopathy, a leading cause of blindness, in India and across the world. With widespread adoption, perhaps millions of patients with diabetes could keep their vision in part to ARDA assisting doctors. Our research was published in JAMA and Ophthalmology. Additional research, published in Lancet Digital Health, showed that we can predict whether patients will develop diabetic retinopathy in the future, which can help doctors customize both treatment and eye screening frequencies for their patients. The solution is currently being evaluated in clinical studies in the United States as well as in Thailand. Learn more.
Novel biomarkers for non-eye related conditions
Detecting hidden signs of anemia from the eye
The human eye can reveal signs of underlying diseases like anemia, a condition that affects 1.6 billion people worldwide causing tiredness, weakness, dizziness and drowsiness. In research published in Nature Biomedical Engineering, we were able to use deep learning to quantify hemoglobin levels and detect anemia with de-identified photographs of the back of the eye. This result means it’s possible that someday providers may be able to detect the disease with a simple non-invasive screening tool. Read the post
Using computer vision to assess cardiovascular risk
Assessing the risk of cardiovascular diseases is the first and most critical step toward reducing the likelihood that a patient suffers a cardiovascular event in the future. By applying deep learning techniques to retinal images, we’ve been able to reveal factors associated with the risk of a major cardiovascular event like a heart attack or stroke, as published in Nature Biomedical Engineering. This research could help scientists generate more targeted hypotheses and drive a wide range of future research. Read the post
Using AI to improve breast cancer detection
Studying how AI can help breast cancer screening in clinical practice
Breast cancer screening helps detect cancer earlier, but diagnosing breast cancer accurately and consistently remains a challenge, with half of all women experiencing a false-positive over a 10-year period. In Nature, we demonstrated the potential of our AI model to analyze de-identified retrospectively collected screening mammograms with similar or better accuracy than clinicians. Now, we’re collaborating on an investigative device research study to understand how the model can help in clinical practice to reduce the time from screening mammography to diagnosis, narrowing the assessment gap and improving the patient experience. Read the post
Applying deep learning to metastatic breast cancer detection
Further research in imaging and diagnostics
We continue to advance AI-enabled imaging research in other domains, expanding this technology to facilitate transformative diagnostics.
Exploring AI advancements in radiotherapy planning to improve efficiency
Building off of work done with the University College London Hospitals and published in JMIR Publications, we are collaborating with Mayo Clinic to study the use of AI to help clinicians plan radiotherapy treatment for cancer. We’ve joined forces to research, train and validate an algorithm to assist physicians with segmenting healthy tissue and organs from tumors to reduce treatment planning time and improve the efficiency of radiotherapy, hopefully allowing clinicians to spend less time planning and more time with their patients. Read the post
Using machine learning to detect deficient coverage in colonoscopy screenings
Colorectal cancer (CRC) is a global health problem and the second deadliest cancer in the United States, resulting in an estimated 900K deaths per year. By alerting physicians to missed regions of the colon wall, our algorithm has the potential to lead to the discovery of more adenomas, thereby increasing the adenoma detection rate and decreasing the rate of interval colorectal cancer, as published in IEEE Transactions on Medical Imaging. Read the post
Using AI to identify the aggressiveness of prostate cancer
To diagnose the severity of prostate cancer, biopsies are analyzed and given a Gleason grade, which is scored on comparisons to healthy cells. In work published in JAMA Oncology and JAMA Network Open, we explored whether an AI system could accurately Gleason grade prostate biopsies, and our results indicated that the deep learning system has the potential to support expert-level diagnoses. Read the post