Autonomous Reliability Assessment Boosts Sensitivity of Rapid Diagnostic Tests
The Californer/10348802

LOS ANGELES - Californer -- Researchers at the University of California, Los Angeles (UCLA) have developed an uncertainty quantification framework that autonomously identifies and excludes unreliable neural network predictions in computational point-of-care diagnostic platforms. As a testbed, they used a paper-based vertical flow assay for rapid diagnosis of Lyme disease—the most common tick-borne disease worldwide.

The vertical flow assay platform combines a disposable paper-based assay, a handheld smartphone-based optical reader, and a deep learning inference algorithm to deliver Lyme disease diagnostic results in under 20 minutes using only a droplet of patient serum. Unlike conventional single-analyte rapid tests that display a single test line, the vertical flow assay contains a multiplexed panel of 25 spots, each coated with proteins that specifically bind to antibodies developed in response to Lyme exposure. After activation, the assay produces a rich image-based signal pattern that is interpreted by a neural network, which delivers a binary Lyme-positive or Lyme-negative result.

More on The Californer

• Serelora Acquires ACTIN Care Groups' Risk-Stratification Software
• J. Kenton Pierce Wins Prometheus Award for Best Novel
• City of Long Beach Experienced a 9% Decrease of Fireworks-Related Reports on July 4
• California: ICYMI: Newsom administration advances historic return of Blues Beach to local tribal stewardship 
• IEI's Custom Design and Manufacturing Scale a Rail Monitoring Fleet

To improve the reliability of this vertical flow assay platform, UCLA researchers developed an uncertainty quantification framework based on Monte Carlo dropout (MCDO). In this framework, each sample is processed not only by the baseline diagnostic neural network, but also by 1,000 additional models, termed MCDO models. These models share the same architecture and trained weights as the baseline model, but during inference, a random subset of their neurons is temporarily deactivated, producing a distribution of 1,000 additional predictions. By comparing this distribution with the baseline disease prediction, the researchers introduced a score termed the uncertainty figure of merit, which autonomously quantifies the reliability of each diagnostic result.

Tests with low figure-of-merit values are deemed unreliable and automatically flagged as "Do not use". Such tests are excluded from clinical decision-making. Tests with high figure-of-merit values are labeled "Trust", and their diagnostic predictions can be reported to clinicians for follow-up care and treatment.

More on The Californer

• Inaugural Cohort of Leadership Program Celebrated Across Ventura County Community College District
• Class is in session: Black Beauty Block Party returns to Los Angeles for fourth annual festival
• Heavy Duty Journal Surpasses 1000 Technical Articles for Diesel Technicians and Fleet Managers
• Digital Entrepreneur Manuel Jesse Lopez Launches Exclusive Amazon Deals Portal
• Governor Newsom signs legislation enacting long-recommended changes to improve TK-12 school governance in California

With this MCDO-based approach, the researchers specifically aimed to reduce false negative predictions — cases where a patient with Lyme disease is incorrectly diagnosed as Lyme-negative. In blinded testing on new patient samples, applying the uncertainty quantification pipeline improved the sensitivity of the vertical flow assay from 88.2% to 95.7%, while preserving 100% specificity.

The approach is designed to also work with any rapid diagnostic test processed by a neural network, including tests for other infectious diseases, cardiovascular conditions, and various clinical biomarker panels.

The study was supervised by Professors Aydogan Ozcan and Dino Di Carlo of UCLA. The other authors include Artem Goncharov, Rajesh Ghosh, and Hyou-Arm Joung.

Article: https://doi.org/10.1021/acsnano.6c06616