Daina V.
Baker‡
,
Jasmine
Bernal-Escalante‡
,
Christine
Traaseth‡
,
Yihao
Wang
,
Michael V.
Tran
,
Seth
Keenan
and
W. Russ
Algar
*
Department of Chemistry, University of British Columbia, 2036 Main Mall, Vancouver, BC V6T 1Z1, Canada. E-mail: algar@chem.ubc.ca
First published on 7th February 2025
Over the past 15 years, smartphones have had a transformative effect on everyday life. These devices also have the potential to transform molecular analysis over the next 15 years. The cameras of a smartphone, and its many additional onboard features, support optical detection and other aspects of engineering an analytical device. This article reviews the development of smartphones as platforms for portable chemical and biological analysis. It is equal parts conceptual overview, technical tutorial, critical summary of the state of the art, and outlook on how to advance smartphones as a tool for analysis. It further discusses the motivations for adopting smartphones as a portable platform, summarizes their enabling features and relevant optical detection methods, then highlights complementary technologies and materials such as 3D printing, microfluidics, optoelectronics, microelectronics, and nanoparticles. The broad scope of research and key advances from the past 7 years are reviewed as a prelude to a perspective on the challenges and opportunities for translating smartphone-based lab-on-a-chip devices from prototypes to authentic applications in health, food and water safety, environmental monitoring, and beyond. The convergence of smartphones with smart assays and smart apps powered by machine learning and artificial intelligence holds immense promise for realizing a future for molecular analysis that is powerful, versatile, democratized, and no longer just the stuff of science fiction.
Contemporary “lab on a chip” (LOC) devices1–3 hold promise for a future with portable molecular analyses but are nonetheless more aspirational than realized. Microfluidics have done much to advance the LOC concept—including methods for the automation of fluid handling, reduction of sample and waste volumes, faster analyses, precision in mixing, and other benefits from miniaturization—but a key challenge lies beyond the chip, where many microfluidic systems require peripheral equipment for their operation and for the detection of analytes. Examples of such equipment include pumps, pressure generators, power supplies, voltage sequencers, temperature controllers, light sources, microscopes, photodetectors, potentiostats, and other hardware for optical and electrochemical detection. There is a push toward passive microfluidics that eliminate pumping,4 and rapid progress in microelectronics has helped to scale down and lower the cost of hardware, but further reductions in the size, cost, and complexity of off-chip components are still needed.5 LOC systems that require specialized laboratory equipment for their operation are not logistically different than a traditional benchtop analysis.
Laboratories and their specialized equipment are principally located in populous and well-resourced urban centres. These facilities tend to be poorly accessible or inaccessible to residents of rural and remote communities, who represent an underserved 45% of the current global population.6,7 Moreover, laboratory facilities either do not exist at field sites or, when pop-up infrastructure is possible, are necessarily limited in their resources. Examples of field sites where molecular information has high value include sites suspected of a disease outbreak, sites suspected of environmental contamination, farms for agriculture and aquaculture, biomanufacturing plants, workplaces with potential for unsafe conditions, and frontiers of scientific exploration such as the ocean depths and outer space. Even when lab facilities are available in urban centers, restrictions on budget and throughput may hinder the implementation of analyses at the desired scale or frequency—something that is often the case for personalized medicine, environmental surveillance, food and water testing, and process monitoring in manufacturing. Although largely beyond the scope of this review, science education also faces challenges with the costs and access limitations associated with sophisticated scientific instruments and facilities.8,9 In short, there are numerous unmet needs for LOC technologies that offer rapid and quantitative chemical and biological analysis, straightforward and lab-free operation, multitasking between more than one type of analysis, and democratization in the form of being able to be built, distributed, maintained, and utilized without substantial financial or other barriers.
A convergence of microfluidics and many other technologies will be required to create LOC devices and assays that translate to society and industry with global impact. These enabling technologies will originate from electronics, materials science, biotechnology, electrochemistry, optics, photonics, data science, and other fields of research and development. Of course, such a scope is too broad for a single review. Instead, this review focuses on the emergence of smartphones as an enabler of LOC, point-of-care, point-of-need, and other portable devices for chemical and biological analyses. Smartphones already integrate numerous technologies and thereby represent a shortcut to the convergence needed for translatable LOC systems. The review begins by discussing the motivation for adopting smartphones as a portable analysis platform, summarizes their potentially useful features, and highlights technologies and materials that are complementary to those features. It then provides a short tutorial on optical detection methods with a singular focus on use of the smartphone camera. A meta-analysis is presented as a preamble to a categorical and critical summary of the recent literature, including examples of how microfluidic platforms have been advantageously paired with smartphone-based devices. The review closes with a perspective on challenges and opportunities for research and development that will advance the technology from prototypes to authentic tools for molecular analysis. When the global ubiquity and ease of use of smartphones are achievements that LOC technologies aspire to emulate, why not leverage the technology of smartphones to help reach that goal?
For a similar set of capabilities, smartphones will better minimize size and weight than custom MCU or SBC devices. Of course, the cost for this benefit is a higher purchase price, a closed hardware system that limits customization, and barriers to replacing individual components rather than the whole device. It contrast, MCUs and SBCs are inexpensive and are designed to be modular and enable custom applications. The open-source options for MCUs and SBCs are also beneficial for democratizing and advancing the technology,17–25 albeit countered by the aforementioned global ubiquity of smartphones.
The technical features (vide infra) and form factors of smartphones are also unmatched. As such, common trade-offs for developing analytical devices around MCUs and SBCs include lower performance from lower-cost components, loss of benefits from the scale of the smartphone market, the need for external power and user interfaces, and the time, effort, expense, and learning curve of reengineering features that are already prepackaged in a smartphone. A smartphone is a more rugged and user-friendly platform, and its many integrated sensors are generally superior to the external options for MCUs and SBCs. Lastly, smartphones will best facilitate the integration of analytical devices and assay outcomes with electronic information systems. These systems are, for example, of ever-growing importance for the delivery of health care, and are a source of big data for gaining new health insights from machine learning (ML) and artificial intelligence (AI).
![]() | ||
Fig. 2 Important technical components of a smartphone camera. (A) Examples of the exterior view of smartphone camera modules (marked with arrows). (B) Simplified general design of the camera module. (C) Typical arrangements of the Bayer and quad-Bayer color filter arrays (CFAs). (D) An RGB test image decomposed into the corresponding R, G, and B channel images. (E) Typical relative spectral responses of the smartphone camera's R, G, and B color channels. The solid lines in panel E represent the average response across 13 different models and 4 manufacturers of smartphones; the shaded regions reflect the highest and lowest responses at a given wavelength. The response data is from Tominaga et al.28 |
The CMOS image sensor generates data from an array of millions of photodetector elements, each corresponding to an individual pixel. More pixels per image sensor improves the nominal resolution, but does not necessarily improve image quality due to the smaller amount of light per pixel. Modern smartphones are now compensating with camera modules that offer pixel binning and one of the multiple camera modules having a larger sensor and pixels.
An infrared (IR)-blocking filter and a Bayer mosaic or similar color filter array (CFA) of red, green (×2), and blue (RGGB) filters are applied over the image sensor to enable color imaging (Fig. 2C and D). A few smartphone camera models were produced with modified CFAs that substituted yellow (Y) pixels for green pixels (i.e. RYYB), added non-selective white (W) pixels (i.e. RGBW), or were monochrome (no CFA), all with the goal of higher light capture in non-scientific photography. For otherwise similar sensor specifications, a study found that a monochrome sensor measured a fluorescence signal that was more than double the signal measured with a color sensor.29 For many smartphones, a quad-Bayer array (Fig. 2C) improves performance at low light levels by supporting pixel binning. To date, the smartphones adopted for portable analyses have almost exclusively had RGB color filters. Most spectroscopists and microscopists would characterize these filters as poor by scientific standards because the transmission spectra overlap and lack a flat top (Fig. 2E). These limitations inform how to optimally use a smartphone camera for optical detection.
Video rates for smartphone cameras range from 24 fps (standard video rate) up to 3840 fps (see Fig. 1). Resolution typically decreases as frame rate increases, but high-end smartphones will support high-definition resolution (720 p or 1080 p) even at hundreds of frames per second. Light capture also decreases as frame rate increases.
The flashlight is a useful illumination source for spectroscopic and imaging applications. Peripheral devices with mirrors, optical fibers, and diffusers have been used to direct white light from the flashlight for a variety of brightfield measurements and imaging,30–37 but direct illumination from the flashlight has also been satisfactory for many applications and devices. Other devices have used optical filters to transmit only the blue light from the flashlight for excitation of fluorescence that is imaged in the R and G channels of the camera,38–41 and transmit only red light for SPR measurements.42–45
In principle, the smartphone display is another source of light for spectroscopy and imaging experiments. The display has, for example, been used as a source of red light for surface plasmon resonance (SPR) measurements,46 a source of blue light for excitation of fluorescence (albeit still in combination with a bandpass filter),47 and as a source of white light for brightfield,48 phase contrast,49 and darkfield imaging.47 A non-smartphone OLED display unit has also been used for multimodal imaging with a smartphone camera, suggesting similar capability for a smartphone display.50 Potential drawbacks of the smartphone display as a light source include a lower intensity than other options and only three pseudo-monochromatic color choices. The spectrum of white light is also non-uniform, although this limitation equally applies to an external white-light LED. Benefits of the display as a light source include the elimination of a component external to the smartphone and the configurability of illumination, the latter of which has been leveraged to enable photochemistry in an array format.51
For biometrics, many smartphone-integrated fingerprint scanners operate based on capacitance or ultrasound imaging, whereas others use a combination of capacitive and optical readout via reflected IR light. Imaging reflected IR light is also the basis for iris recognition on some smartphones. These sensors are not anticipated to be directly useful for molecular analyses, but are a potential means of linking measurement data to relevant identifiers (e.g. patient, analyst) and for data security.
ALS have spectral responses that approximate the photopic response of the human eye. The sensor response is often used to automatically adjust display brightness and apps are available to measure light intensity quantitatively via the ALS. Although this sensor has some latent ability for imaging,54 the capability is far from practical for molecular analyses. To date, the main analytical application of the ALS is non-imaging smartphone-based photometry, where the ALS has a larger dynamic range and bit depth than the smartphone camera. Cuvette-accommodating smartphone attachments have been developed to use the ALS to assess bacterial growth via measurements of turbidity,55 to measure enzyme activity and inhibition by heavy metals through a pH indicator dye,34 and to quantify Cr6+ (aq) in water samples through a chromogenic chelator.56 Smartphone ALS-based devices have also been developed for quantitative analysis of colorimetric dipstick57 and lateral flow assays58 for organophosphate pesticides, and for lateral flow tests of wild-type pseudorabies virus infection,59 blood bilirubin levels,60 prostate-specific antigen (PSA) in patient blood,61 and ampicillin residue in animal milk.61
Multi-channel sensors that measure both the color and intensity of ambient light are the latest generation of ALS technology. These sensors enable automatic adjustment of color temperature for smartphone photography and device displays. This capability will support more robust colorimetric assays under ambient light and help minimize the number of peripheral components (e.g. box, specific light source) needed for reliable smartphone-based measurements.
Despite the capability of the smartphone battery to power external components, most smartphone-based analytical devices still incorporate separate batteries (e.g. 1.5 V AA size, 9 V PP3 size) for this purpose. In some cases, these external batteries provide more direct access to a higher voltage (no need for a voltage converter in a circuit) or current, or might usefully extend the operating time of the smartphone device between recharges (i.e. less drain on the smartphone battery). In other cases, the use of external batteries is a preference for prototyping with no significant functional advantage over the smartphone battery. In both cases, downstream circuit components can modify the electrical output to what is required for an application.
Smartphones also transmit data globally through Wi-Fi and cellular networks based on LTE (long term evolution) and other standards categorized as 3G, 4G, and 5G. For applications in some low resource settings, smartphone-based analytical devices will need to be fully functional in the absence of a network connection (although satellite connectivity for data transmission is reasonably anticipated for smartphones in the future). Connectivity adds processing and storage capacity via cloud services and makes support from human expertise accessible around the globe.
An on-board global positioning system (GPS) and other location services are available to tag data with geographical and temporal information—features that are especially useful for documenting field-based measurements. Most smartphones use assisted (or augmented) GPS (A-GPS) in normal operation, but do contain GPS receivers that function in the absence of cellular service or network connectivity.
Smartphones run operating systems (OS) to connect hardware with apps. The two dominant OS are Android (∼71% of the global market) and iOS (∼28%).66 Most researchers adopt Android devices due to the larger market share, and for the more open and flexible ecosystem for app development and distribution. Nonetheless, there are concerns that Android is moving toward a more closed system with increasing reliance on proprietary software and a closed-source version of Android from Google. A closed system like iOS has potential advantages in terms of security and privacy, seamless integration with other devices (e.g. desktop and notebook computers, tablets), and a smaller number of smartphone models with which an app needs to be compatible. Although some researchers code their own apps for smartphone-based measurements, there are pre-existing apps that support research and development. Examples include native and third-party apps that provide users with substantial manual control over camera settings for photography (vide infra), mobile development apps for MATLAB and Python, and support for integration of these codes into custom Android or iOS apps written in Android Studio or Apple Xcode integrated development environments (IDEs).
FDM/FFF printers are available at low to modest cost ($200–5000) and offer print resolution ≥0.2 mm, reasonable print speeds, potentially large build areas, and printing materials such as acrylonitrile butadiene styrene (ABS) and polylactic acid (PLA). These printers have been widely adopted for fabricating the housing of smartphone-based devices, as well as holders, mounts, and supports for optical components, circuit boards, and other peripheral components.
Photopolymerizable resin-based 3D printers are available in stereolithography (SLA), digital light processing (DLP), and masked stereolithography (MSLA; also known as LCD) varieties that use epoxy, acrylic and methacrylic monomers. The purchase prices are similar to FDM/FFF printers. Although post-processing such as UV curing and solvent washes are sometimes needed, the prints are macroscopically smooth, watertight, robust, and (for colorless resins) semi-transparent. The technology is suitable for the fabrication of watertight flow cells and making molds for the soft-lithographic preparation of microfluidic chips.70–72 Lenses can also be fabricated but will tend to require post-print smoothing by sanding or coating procedures to obtain sufficient transparency for practical use.73–75
Collectively, a smartphone, an FDM/FFF 3D printer and filament, a photopolymerization 3D printer and resin, and some basic tools (e.g. sandpaper, knife, rotary tool and bits) have the potential to function as a near-complete kit for prototyping or maintaining a smartphone-based analytical device. Depending on the measurement modality and assay designs, some additional kit may also be warranted: light sources (e.g. LEDs), electronic components (e.g. wire, resistors, connectors, solder, soldering iron), simple optical components (e.g. lenses, mirrors, colored filters), mild solvents (e.g. isopropyl alcohol), and simple plasticware (e.g. tubing, syringes). Although these resources are not household items and not without cost, they are realistic and common for professional and at-home workshops to stock and utilize. Examples of LEGO®-based smartphone devices,76,77 including with deep-learning-based computer vision, further show that analytical function is not predicated on sophisticated hardware external to the smartphone.
Laser diodes are also components in consumer devices (e.g. optical drives, laser pointers, barcode readers, 3D printers, laser printers) and are available at low to high cost ($10–1000) with small size, milliwatt powers, and wavelengths from the UV to the near-infrared. Although cost will generally favor the use of LEDs, the monochromatic output of laser diodes (FWHM ≤ 1 nm; Fig. 5) can be a technical advantage for photoluminescence (PL) measurements—the application where a majority of laser diodes29,81–86 and non-white LEDs have been utilized—because a greater fraction of a smartphone camera RGB channel remains accessible.
Many LEDs and laser diodes are operable with the voltage and current output available from a smartphone USB-C connector, power bank, or common consumer batteries. A simple circuit can step voltage up or down as needed. LED wavelengths have ranged between 285 nm (UVB) and 625 nm (red). Laser diode wavelengths have ranged from 365 nm (UVA) to 638 nm (red), with powers ranging from 20 mW up to 180 mW. The notable exception has been measurements with upconversion materials, which utilize 808 nm or 980 nm wavelengths. For applications with non-trivial illumination requirements (e.g. PL measurements, microscopy, spectroscopy), laser diodes have been adopted as the excitation source about 15% of the time, whereas LEDs have been adopted about 65% of the time (or 70% when including the smartphone flashlight, vide infra).
In contrast to SBCs, MCUs have the potential to complement smartphones as a technology for operating portable analytical instruments. The open-source Arduino boards are popular for rapid prototyping,87 and their combination with 3D printing has been reported to reduce costs by an order of magnitude for scientific technology.88 Arduinos integrate features like a modest central processing unit (8–84 MHz), memory (up to 8 MB RAM), wireless communication (e.g. Wi-Fi, Bluetooth), and 5 V pins for digital input/output, analog output, and pulse-width modulation output (a digital means of mimicking analog output). These devices require external power, do not have built-in user interfaces, and do not utilize an OS, but there is software for writing and uploading code (e.g. Arduino IDE, based on C++, or MicroPython). The Arduino hardware catalog also includes external “shields” that interface with the main boards to provide additional features (e.g. motor drivers). Some non-Arduino MCUs, such as ESP32 and Teensy models, have higher processing power (up to 240 MHz and more RAM) but lower output voltage (3.3 V). With prices that range from $10–100 USD and minimal duplication of smartphone capability and features, MCUs add versatility by supplementing smartphone-to-peripheral connections with smartphone-to-MCU-to-peripheral connections. Several devices reported in the literature have paired smartphones with MCUs.89–97
Common materials for microfluidic chips include glass, polymers, and even paper.104 Although long associated with fabrication in clean rooms, channel microfluidics are now broadly accessible through commercially available glass capillaries, 3D printing of molds for polydimethylsiloxane (PDMS)-based soft lithography, and 3D printing of complete chips.70–72 Do-it-yourself hardware is increasingly common: syringe pumps and peristaltic pumps that drive fluid flow have been built using 3D-printed components and low-cost motors that can be powered by batteries or spring loading,105–112 and a low-cost 3D printer kit has been transformed into multiple syringe pumps.113 Alternatively, microfluidic paper analytical devices (μPADs)114 and capillaric chips115 do not need pumps because flow is driven by capillary action—an operational simplicity that is ideal for portability. Paper also has the advantages of being lightweight, inexpensive, biodegradable, incinerable (e.g. if samples are biohazardous), and capable of sample cleanup via filtering action. Despite the discontinuation of commercial wax ink office printers, wax printing remains the most common method for patterning channels and zones on paper, but alternative methods of creating hydrophobic barriers have been developed.116,117
Beyond channels, digital microfluidics based on electrowetting are promising because of the complex operations that are possible in this format, and the potential to miniaturize the driving electronics and use optical actuation.118–123
For smartphone-based analyses, a microfluidic chip must have optical characteristics and a design that are suitable for the desired type of measurement. For example, reflection colorimetry often needs a white background, such as from a paper substrate or μPAD. PL detection benefits from transparent optical paths for emission and excitation light, avoidance of strong camera-directed reflections of excitation light, and low autofluorescence from the chip material. Nominally transparent polymers such as poly(methyl methacrylate),124 polycarbonate, polyethylene terephthalate,125–127 cyclic olefin copolymer,128,129 and PDMS are useful materials for microfluidic chips.130 These polymers transmit wavelengths longer than 400 nm, but transmission is usually lost between 300–400 nm, which has implications for excitation in PL measurements. The nominally transparent resins for photopolymerization 3D printing have a narrower range of transmission, with short-wavelength cut-offs nearer to ca. 430 nm, and often require polishing to be more transparent than translucent. Microfluidic chips made entirely of glass or with a glass face (e.g. PDMS-on-glass chips) typically provide the widest range of wavelength transmission. Autofluorescence and the scattering and reflection of light are sometimes challenging to address with smartphone-based devices, where considerations such as cost, robustness, and compact design may restrict the practical range of solutions to these problems.
Under approximate white-light illumination, molecular dyes produce color in smartphone images based on the wavelengths of light absorbed relative to the RGB color channel responses (Fig. 7A). In the dark, the imaged color of a fluorescent dye corresponds to the wavelengths of light emitted relative to the RGB channel responses (Fig. 8A).
![]() | ||
Fig. 7 Normalized extinction spectra of selected materials. (A) Examples of common dyes: oxidized TMB,132 phenol red,133 eosin Y,133 bromocresol green (BCG). (B) Different diameters of AuNPs. (C) Dispersed and aggregated AuNPs. The spectra are superimposed on the typical RGB channel responses of a smartphone camera (dotted lines). Note: the spectrum for oxidized TMB is for its charge transfer complex with TMB, which is usually the first colored product from the catalyzed oxidation of TMB. Uncomplexed oxidized TMB has an absorption maximum at 450 nm (not shown) and is usually isolated by the addition of acid. The source data for dye spectra are cited. AuNP and BCG spectra were measured for this review. |
![]() | ||
Fig. 8 PL emission spectra of selected materials: (A) common fluorescent dyes (DAPI = 4′,6-diamidino-2-phenylindole, fluorescein, TAMRA = carboxytetramethylrhodamine, Alexa Fluor 647, and the emissive product from turnover of furimazine by NanoLuc (dye spectral data from http://fpbase.org/); (B) different sizes of QDs; and (C) some trivalent lanthanide ions (data replotted form ref. 134). These spectra are superimposed on the typical RGB channel responses of a smartphone camera (dotted lines). |
Borrowing directly from classic ELISA methods, the enzyme-catalyzed (e.g. horseradish peroxidase, HRP) and nanomaterial-catalyzed oxidation of 3,3′,5,5′-tetramethylbenzidine (TMB) to yield a blue color has been the most widely adopted chromogenic reaction for smartphone-based assays. Peroxidase mimics and other nanoparticle (NP) catalysts that are able to turnover a chromogenic substrate under ambient conditions (a.k.a. nanozymes) are of interest because of their potentially greater robustness and shelf life, lower manufacturing cost, and ease of modification versus conventional enzymes.135,136 Analogous to enzymes, nanozymes are not immune to inhibition by components of a sample matrix, and inhibitory effects are sometimes useful for the detection of certain analytes. Nanozyme-based amplification will benefit from the microfluidic automation of fluid handling to reduce multiple assay steps to a single user step.
In most applications, AuNPs are adopted as a label for generating contrast in binding assays. Silver enhancement—the reductive growth of a thick layer of silver on AuNPs—has been used to generate even greater optical contrast, but the post-assay development steps are not ideal for a portable analysis without on-chip automation. The aggregative behavior of AuNPs also functions as a “mix-and-measure” sensor, but ensuring robust selectivity sometimes requires more careful and challenging design than for molecular indicator dyes.
The PL properties of QDs are an ideal match to smartphone cameras: high brightness mitigates the modest sensitivity of the image sensor versus research-grade cameras and photodetectors; the resistance to photobleaching enables longer image exposure times to further enhance signals; the narrow PL emission can be aligned to one of the RGB color channels to maximize sensitivity while minimizing crosstalk with other channels; and the broad absorption enables all colors of QD to be optimally excited with violet or UV light, leaving all of the camera RGB channels available for PL emission measurements. Most organic fluorescent dyes do not offer the same capability. At present, QDs are the material that most readily enables up to three-color multiplexed detection with a smartphone camera.139 QDs also function as “mix-and-measure” sensors for smartphone-based analyses through processes such as Förster resonance energy transfer (FRET),139,140 where these sensors can be sufficiently bright for detection directly in whole blood.141
The main drawback of QDs is the frequent inclusion of cadmium in the best-in-class materials. This inclusion is often framed as a toxicity issue, but such framing is an oversimplification.142–144 Toxicity has limited relevance to in vitro analyses, where measurements of biological samples are ex vivo, minute quantities of material are needed per test, and some assay formats will already include some level of containment for the sample. Rather, the more relevant challenge is one of environmentally conscious or regulated disposal in low-resource settings and, ultimately, sustainability for use at a global scale.
The main advantage of UCNPs with smartphone cameras is the near-IR excitation, which is a spectral region that is already blocked by the IR filter in the smartphone camera assembly and induces negligible autofluorescence from most samples and materials. UCNPs thereby enable imaging without an emission filter, with very low background, and with potentially less pre-processing of crude samples. For assay formats with short optical path lengths through samples, there is significant potential for the suppression of autofluorescence background from the assay vehicle (e.g. lateral flow membranes, paper test strips, microfluidic chips) to be a greater benefit than the suppression of autofluorescence from the sample itself.
A potential disadvantage of UCNPs is their modest brightness from relatively low absorption coefficients, modest upconversion quantum yields, and low emission rates. The emerging technology of organic-based triplet-triplet annihilation (TTA) upconversion NPs has the potential to provide higher brightness, but color multiplexing will typically be limited by the broad emission spectra.131 Although some UCNP compositions have an narrow emission line that is well aligned with an RGB color channel, other compositions have lines that are detected in multiple color channels. Results with smartphone-based imaging of luminescent lanthanide complexes (LLCs) suggest that the combination of Tb(III) and Eu(III) emitters is effective for two-color multiplexing between the G and R channels,150 and there is potential for Tm(III) to leverage the blue channel as well. With their typical UV excitation, molecular luminescent lanthanide complexes are arguably less appealing for smartphone imaging than UCNPs because of the technical need for a time-gated imaging mechanism to supress autofluorescence, which is more demanding than simple inclusion of a NIR laser diode. Otherwise, LLCs are expected to perform similarly to lanthanide-based UCNPs, with the possible added benefit of being directly substitutable for fluorescent dyes in assays.
The primary advantage of PLNPs is the temporal separation of excitation and detection. An imaging camera is able to be turned off when the excitation light is turned on, and vice versa. This capability eliminates background from stray excitation light and sample autofluorescence. Persistent luminescence makes it possible for device designs to omit an optical filter (something that is essential for conventional fluorescence measurements) and to avoid background from autofluorescence. The potential drawbacks of PLNPs are concerns related to some of their metal-based compositions, the lower brightness that is an outcome of their slow emission rate, and additional parameters to keep constant for intensity-based calibration (e.g. excitation duration, time between the end of excitation and the start of imaging). In principle, the most suitable applications for PLNPs are those where the decrease in background more than offsets the decrease in signal compared to another type of luminescent material. In practice, it is difficult to fully benchmark the advantages and disadvantages of PLNPs because of the few studies with smartphone-based detection.
![]() | ||
Fig. 9 Conceptualization and characteristic features of (A) linked, (B) dongle, and (C) integrated devices that utilize smartphones. |
Linked and dongle devices are often bespoke and therefore adopt designs and components that are optimized for the analytical measurement and user context. The smartphone functions as a user interface and as a platform for data processing, storage, and sharing. Compared to other benchtop and portable instrument systems, linked and dongle devices benefit from offloading bulkier components (e.g. power, display, user input) to the phone. This approach decreases the size and cost of the analytical device when an analyst already has access to a smartphone. The anticipated worldwide standardization of smartphone charging ports to USB-C (already implemented in European Union152) will also enable linked and dongle devices to function independent of the make and model of smartphone. Indeed, dongle devices are an inevitable future for portable electrochemical analysis. The future for optical analysis is less certain because cameras and light sources are built into smartphones.
Given their bespoke designs and mere “connected” role for the smartphone, linked and dongle devices for molecular analysis are not discussed further in this review. Rather, the focus is on integrated devices that adopt, at minimum, the smartphone camera as an essential component. This approach requires fewer external components and less secondary engineering than linked and dongle devices, leading to simpler device prototyping (especially by non-engineers) and greater potential for democratization. The highly competitive consumer market also ensures that smartphones provide access to best-in-class image sensors, regularly upgraded technology, and opportunities to utilize non-imaging features to enhance measurements or data collection.
Potential advantages of colorimetric methods include operation in ambient light, simplification or elimination of hardware peripheral to the smartphone, and human vision as a redundancy and quality control measure for camera-obtained results—all of which contribute to the status of colorimetry as the most popular detection modality with smartphone-based devices. Potential disadvantages include less favorable detection limits than luminescence methods, interference from samples that are naturally colored, and a functional dependence on the color temperature or spectrum of the illumination. Approaches that have been used to address the last challenge are the use of a box155–159 or an attachment160 that excludes ambient light and provides reproducible and optimized illumination from a built-in source, and the use of color standards to calibrate ambient lighting.161–165
Most devices for colorimetric detection have been designed for use with cuvettes, lateral flow membranes, μPADs, and other test strips. Additionally, some devices for absorbance measurements have been designed for 96-well plates. One technical approach is to use an array of 96 optical fibers to deliver light transmitted through each well to a defined spatial position on the smartphone camera image. Examples of light sources for this type of configuration include an array of blue LEDs166 and an electroluminescent plate as a white light source.167 An alternate approach is to use a large-diameter convex lens for concurrent imaging of an 8 × 8 array of wells without significant optical distortion.168
The main drawback of luminescence detection is the additional components that are required for a functional device. A box or compartment is needed to exclude ambient light and provide a dark imaging environment. An excitation light source is also needed for PL measurements, along with an emission filter to prevent reflected or scattered excitation light from reaching the smartphone camera. External single-color LEDs and laser diodes are common excitation light sources. Violet and UV wavelengths enable full utilization of the camera's RGB channels, whereas longer wavelengths preclude imaging in one or more color channels. Excitation filters are needed to isolate a band of wavelengths when the smartphone flash or another white-light source is used for PL excitation.38,41,145,172 Although infrequent, narrow bandpass filters have also been used with single-color LEDs to minimize the leakage of excitation light into the camera color channel to be used for detection.173,174 This approach avoids reducing the range of wavelengths useful for PL detection, which can sometimes be a consequence of using an emission filter that blocks the full spectrum of an excitation LED. Such filtering also has the side-effect of reducing the excitation intensity. Monochromatic laser diodes do not pose the same challenge because long-pass and notch filters are able to block the excitation light from reaching the camera while maximizing the remaining wavelength range for PL detection.
Although of minimal importance for brightfield colorimetric imaging, the distance between the sample and the smartphone camera (or another primary imaging lens) is a relevant design consideration because PL, CL and BL exhibit isotropic emission. The measured intensity thus scales as the inverse square of this distance and greatly impacts assay sensitivity.
An additional consideration for PL detection is that components in the path of the excitation light and in the field of view of the camera must not be autofluorescent, and should be transparent to the excitation wavelength to maximize sensitivity. These requirements are sometimes more challenging than anticipated when working with violet and ultraviolet excitation: some paper,175 plastic,176,177 and (more rarely) glass materials generate significant levels of autofluorescence. Some low-cost colored glass filters will also exhibit autofluorescence when incident excitation light (e.g. from a reflection) is too intense.178 Common clear plastics and glasses are transparent to NIR light (at 808 nm and 980 nm) and, as noted earlier, the use of UCNPs and PLNPs will avoid autofluorescence from samples and device materials alike. Nonetheless, UCNP users should also be cognizant of materials that could burn from extended exposure to the IR laser. UV light sources and NIR lasers suitable for upconversion PL both pose safety risks to skin and eyes that will need to be mitigated by suitable engineering of any device.
In contrast to PL detection, CL, BL, and ECL detection do not need an excitation source and optical filters. Nevertheless, there is intricacy associated with the temporal decay of CL and BL signals as a reaction progresses. In many cases, a greater number of reagents and assay steps are needed to generate signal. ECL provides a greater level of spatial and temporal control because the luminescence is restricted to an electrode interface and requires an applied voltage to be initiated.179,180 ECL emitters can sometimes also be regenerated on the fly. In general, the emission rates for CL, BL, and ECL have a lower ceiling than with fluorescence, such that competitive detection limits are predicated on the background being darker than what is possible with PL, whether due to technical considerations or sample autofluorescence.
![]() | ||
Fig. 11 Examples of the two main optical approaches for SPR with a smartphone. (A) An optical fiber format: (i) measurement setup; (ii) optical axis; (iii) examples of smartphone images of the reference (RC) and measurement (MC) fibers. Other abbreviations: TR, transition region; FR, flat region. Figure adapted with permission from ref. 44 Copyright 2019 Optical Society of America. (B) A Kretschmann configuration with a planar gold film on a chip in a flow cell (left) and an example of a smartphone-captured SPR image of the chip. Figure adapted from ref. 45 Copyright 2022 Royal Society of Chemistry. |
Beyond external magnification lenses, the components utilized for smartphone-based microscopy are similar to the components utilized for non-microscopy measurements. Devices for brightfield microscopy will incorporate a peripheral white LED source or redirect the smartphone flash for sample illumination because ambient light is not sufficiently intense for high magnification.192 Although most microscope devices have been built around a single smartphone, there have been instances of using two smartphones—one for the flashlight to illuminate the sample and one for the camera to image the sample—to simplify optical design and avoid any circuits.193
Although uncommon, the smartphone display has been used as a light source for microscopy. Examples include the use of a liquid light guide to collect light from the display for downstream modulation by a digital micromirror device for hybrid illumination (HiLo) optical sectioning with 12 μm axial resolution,194 and the use of the display as a dynamic and programmable light source to replace the typical two-dimensional LED array for Fourier ptychographic microscopy to obtain half-pitch resolution of 0.87 μm with a field of view of 3 mm2 (Fig. 12).195 An arguably simpler design used a separate OLED display, operated by a microcontroller, to act as a programmable light source for smartphone microscopy, demonstrating six different imaging modes: bright-field, dark-field, oblique illumination, Rheinberg, differential phase contrast, and fluorescence.50 More commonly, single-color LEDs and laser diodes are used with appropriate optical filters for PL microscopy. Theater stage lighting gel films and acrylic films have been used as a low-cost alternative to conventional scientific-grade emission filters.196,197 A related advance has been the development of colored polymer lenses that mount directly on a smartphone camera to concurrently magnify and block excitation light in PL imaging.198 Another example of custom imaging is a tunable optofluidic design, based on hydraulic deformation of an elastomeric membrane, that offers an adjustable focus.199 Simple mechanical approaches to focus adjustment have included spring-loaded screws to attach a phone cradle as the lid of a dark box,84 and a screw-actuated 3D-printed seesaw mechanism that offers as small as 5 μm adjustments.200
![]() | ||
Fig. 12 A smartphone-based Fourier ptychographic microscope using the display screen for illumination. (A) Optical layout and (B) rendering and photograph of the microscope. Diagram abbreviations: OL, objective lens; TL, tube lens; M, mirror; FL, field lens, EP, eyepiece lens. (C) Working principle of the microscope. (D) Full field-of-view color reconstruction result of cross-section of a Tilia stem. (The blue and red boxes indicate image regions that are enlarged in the original publication). Figure adapted with permission from ref. 195 Copyright 2021 American Chemical Society. |
Most smartphone-based absorption spectrometry devices have been designed to utilize cuvettes. A plurality of designs use a piece of a DVD201–203 or CD204,205 as a proxy for a made-for-purpose diffraction grating. The grating is typically used in a transmission format, although some reflection designs have been reported. Low-cost thin film gratings designed for classroom education have also been adopted,206–208 as have research-grade transmission209 and reflection gratings.210 When reported, spectral resolutions have been <1 nm per pixel.204,209,211 Although most devices have 3D-printed housing, some devices have been made with laminated paper,201 cardboard and wood,203 and Plexiglas.202 The most common light source is a white LED external to the smartphone,201 although some designs have utilized a tungsten halogen lamp (i.e. incandescent bulb),203,209 a flashlight-sized xenon bulb,212 and redirection of the phone flash via a light guide.211,213 Two versatile designs implemented a bifurcated optical fiber to deliver light from the flash to the sample and to send reflected light back to the grating assembly and smartphone camera.32,208 Other interesting device designs have included a double-beam system,207 an eight-channel spectrometer based on a prism array for working with 96-well plates212 and 8-well strips,214 and endoscope designs.213,215 Two designs have also omitted a light source, once for flexibility in source selection216 and once for use with the Sun.204 The Sun offers the advantage of a broader and more uniform spectrum than an LED or lamp, but poses challenges with ensuring consistent incident light intensity between samples and blanks, and with weather-dependent utility.
Regarding the smartphone, a study evaluated more than 60 models for spectral measurements and highlighted the importance of manual control over image acquisition and processing settings, the trade-off between higher signal-to-noise ratios from larger camera pixel sizes and higher wavelength resolution from more pixels, and the generally superior analytical performance of newer phones versus older phones.211
The advantage of smartphone-based spectroscopy over imaging is wavelength-resolved data that is more analogous to lab-based spectrometers. In principle, this resolution will support more robust or higher levels of spectral multiplexing and facilitate differentiation of analytical signals from background. In practice, smartphone spectrometers are often better suited to education and citizen science than for chemical and biomolecular analyses. The built-in RGB channels of the smartphone camera intrinsically provide some wavelength-related information, and few studies to date have demonstrated an application where the extra resolution from a grating provides essential new information.
A full discussion of image compression algorithms are beyond the scope of the review and can be found elsewhere.217–219 In brief, JPEG is a lossy format that simplifies the pixel data in the original image based, in part, on the limits of human vision and color perception. Nominally redundant data in the form of less perceivable detail is eliminated to conserve memory. Pixels in JPEG images can, in principle, adopt 28 = 256 different (i.e. 8-bit) levels of red, green, and blue (R, G, and B), for a total of 224 = 16777
216 (i.e. 24-bit) colors. Compared to the JPEG format, the HEIC format uses less memory to store higher quality images, with the potential for up to 16-bit depth for each RGB color channel.
For both JPEG and HEIC images, an acquired raw image is first processed by demosaicing. This process uses pixel interpolation and correlation algorithms to assign a full triplet of R, G, and B values to an image pixel, even though each image sensor pixel was sensitive to only one of these colors. Subsequent processing includes color space conversion, white balance or color temperature adjustment, and file compression steps. Notably, the color processing steps alter the quantitative data from the image sensor. Most image sensors have a linear response to light intensity and the pixel signals are typically digitized on 10-bit up to 14-bit scales. In addition to reducing the bit depth in a stored image, standard JPEG or HEIC conversion will also apply a gamma correction that transforms the original linear correlation between pixel value and light intensity to a non-linear one that better mimics human vision. Increasingly, there are also other behind-the-scenes actions by the smartphone camera app: various computational methods are used to further enhance and optimize image quality, thereby better mitigating the hardware compromises necessary for a small form factor, user friendliness, and versatility. Although these operations add value to the popular uses of smartphone cameras, autonomous image processing algorithms may not be well calibrated to scenarios encountered in scientific imaging and measurements. For example, many smartphone cameras and their default apps will attempt to make dim light brighter by altering both the hardware parameters for image capture and the downstream digital image processing. Such processing risks a low luminescence signal from a low concentration of analyte falsely appearing to be high signal from a high concentration of analyte. In short, undefined image processing algorithms are anathema to quantitative analysis and are to be avoided.
One strategy for avoiding non-quantitative data is to use smartphone camera apps that offer control over important settings used for image capture and processing. Examples of such settings include the focus, exposure, ISO level, and white balance/color temperature. Manual control provides a level of consistency between images and is sometimes adequate for quantitative analysis even when storing images or videos in compressed formats. An alternative to JPEG and HEIC is to store images in RAW format. The RAW format provides a digital image with the highest fidelity to what the image sensor recorded, including greater bit depth, with the trade-off of requiring more memory. RAW files ideally retain the linear response of the image sensor and are minimally processed. Acquiring RAW images will thus be the best approach to any quantitative analysis that is based on the light intensity measured in one or more of the camera's RGB color channels. Numerous apps are available to enable RAW image acquisition with manual control over the aforementioned camera settings, including the advanced or “pro” modes of some default camera apps for newer smartphones. Examples of non-default apps include Adobe Lightroom, OpenCamera, Camera FV5, Halide Mark II, and several apps that have “Pro Camera” (or similar) in their name. Apps capable of RAW video acquisition have been rare but do exist (e.g. MotionCam). There are also tools available for researchers to code their own custom camera apps using application programming interfaces (APIs) and software development kits (SDKs) that are available for smartphone operating systems such as Android, iOS, and HarmonyOS.
With smartphones, the precise details of the processing applied to the exported RAW image (e.g. digital negative, DNG, file format) depends on the device and app, but typically includes a demosaicing (a.k.a. debayering) process to obtain a full color image. Note that some image processing and analysis programs may require that the bit depth of an imported RAW image (e.g. 10-bit) be downscaled or upscaled to a supported value (e.g. 8-, 16-, 32-bit). Downscaling will reduce image detail and dynamic range, and add quantization noise. Upscaling will add gaps in the pixel intensity histogram of an image but otherwise retains the original quality of the data. Upscaling cannot undo the effects of a prior downscaling.
The hue-saturation-value color space (HSV; also called hue-saturation-brightness, HSB; Fig. 13B) is an alternative model to the RGB color space. HSV space uses a single coordinate, hue (H), to identify colors, where H is expressed in degrees (0–360°) on a cone or cylinder. For example, the RGB hues of red (255, 0, 0; 8-bit RGB coordinates), yellow (255, 255, 0), green (0, 255, 0), cyan (0, 255, 255), blue (0, 0, 255), and magenta (255, 0, 255) are at 60° intervals starting at 0° for red and ending at 300° for magenta, with brightness and saturation at 100%. The saturation (S) is expressed as a radial coordinate (0–100%) and quantifies the amount of a given hue versus a neutral white. The value (V) is expressed as the axial coordinate (0–100%) and is a measure of the perceived brightness of the hue. White has 8-bit RGB coordinates of (255, 255, 255) and HSV coordinates of (H, 0%, 100%). The corresponding coordinates for black are (0, 0, 0) and (H, S, 0%). There are defined equations for converting between the RGB and HSV color spaces.
Other examples of color spaces are the International Commission on Illumination (CIE) Lab model, its still-common predecessor, the CIE XYZ model, and two-dimensional representations commonly referred to as CIE 1931 (xy) and CIE 1976 (u′v′) (Fig. 13C). These models are perhaps less intuitive than the HSV color space, but are better mimics of the human perception of color. The CIE XYZ model defines X, Y, and Z coordinates as tristimulus values that nominally reflect the degree to which different wavelengths of light stimulate the three types of cone cells in an average human eye. Equations are defined to convert RGB coordinates to XYZ coordinates. In turn, equations are defined to convert the XYZ coordinates to the (x, y) and (u′, v′) coordinates for two-dimensional representation, and to convert XYZ to the L*a*b* coordinates of the CIE Lab model. This latter and newer model aligns with how the average human actually experiences four pure color stimuli (red, green, blue, yellow) due to cone-opponent neurons that combine signals from the three types of cone cells. The L* coordinate is the lightness of a color. The a* and b* coordinates reflect the redness-greenness and yellowness-blueness of a color, respectively, where a positive value indicates a predominance of the first color in a pair and a negative value indicates a predominance of the second color.
RGB is the natural color space for smartphone image analysis and has been adopted in close to half of published studies (vide infra). Many studies have also used HSV and L*a*b* coordinates, where a few of these studies have advanced a notion that these color spaces have the potential to enhance the data. This idea is a misconception: the HSV and L*a*b* coordinates are calculated directly from the original RGB values and thus cannot improve the quality of the data. Rather, conversion to these alternate color spaces has the potential to function as a form of data reduction, enabling fewer coordinates to reflect trends in the data and better correlating data with human perception. Grayscale conversion is likewise a data reduction mechanism because it is a weighted average of the RGB triplet values. Ad hoc color space conversions are not a substitute for knowledge of the optical spectroscopy relevant to a smartphone-based assay. The optimum approach to data analysis will emerge from careful consideration of the sources of signal, background and noise in an experiment, the sensitivity of the camera's RGB pixels to each source, and the contributions of each source to the coordinates of an image color space. Coordinates that maximize signal-to-background and signal-to-noise ratios will maximize analytical performance.
Signaling between low and high contrast states usually takes the form of a colorless to colored transition for colorimetric measurements, or a transition from dark to bright for luminescence measurements. For luminescence assays with a single luminophore, the transition is simply and effectively quantified via changes in the magnitude of the RGB channel values. The relevant channels will be determined by the overlap between the emission spectrum of the luminophore and the RGB channel responses, where the channel that provides the highest signal-to-background ratio will most often provide the highest quality data. Image analysis programs and coded scripts will output RGB coordinate values for pixels of interest and will split a color image into a separate monochrome image for each of the three channels. Background subtraction is important and should not be neglected.
Despite being adopted for data analysis in almost one quarter of studies (vide infra), the best-case scenario is that grayscale conversion has a neutral effect on data quality for colorimetric and luminescence measurements. It is equally likely to have a detrimental effect from averaging in color channels with inferior signal-to-background ratios. It should also be noted that data from an image is unreliable for quantitative analysis if a significant number of pixels are saturated in a color channel (i.e. an 8-bit value close to 255). Gross saturation is frequently observed as a white-hot glow for an imaged color of luminescence, but pixel data can be adversely affected before this effect is visually apparent.
For a transition between a colorless and colored state under approximate white light, the relevant color coordinate will be determined by the overlap between the absorbance spectrum of the chromophore and the RGB channel responses. The RGB channel that covers the largest fraction of the area of the absorbance spectrum will be most sensitive to the color transitions. Unlike in darkfield luminescence imaging, where, for primary colors, the visual color tends to match the optimum RGB channel, the visual color for brightfield imaging under approximate white light will tend to be complementary to the color of the optimum RGB channel. For example, red luminescence is best quantified in the R channel, whereas a red color in brightfield imaging is often best quantified in the G channel. The S value in HSV space is also an intuitive and suitable parameter for quantifying colorless to colored transitions, with the caveat that there is still potential for some of the data variance to be captured by the H and V coordinates. The data reduction from grayscale conversion has the potential to increase dynamic range from its averaging in of less-responsive RGB color channels, but risks a reduction in sensitivity for vivid colors.
Another common scenario is quantifying the degree of a transition between two color extremes, such as a blue-to-yellow transition or a green-to-red transition. A ratio of values between two RGB channels will often suffice to produce a monotonic trend in both darkfield luminescence and brightfield color imaging. The specific RGB channels will be those that align with the majority of the absorbance or emission that produces the two colors. A ratio between the sum of two channels and the third channel (or the mathematical inverse) also has the potential to be useful in the case of color changes associated with large shifts in broad spectra. Alternatively, the H coordinate of the HSV color space is a good conceptual match to this scenario and often utilized for this purpose. Although sometimes utilized, ML methods are generally unnecessary for quantifying a simple transition between two colors. Rather, the value of ML in this situation is accounting for significant variation in the illumination or in the optical properties of sample matrices (i.e. inconsistent background and noise). ML methods have similar utility when applied to colorless to colored transitions or dark to bright transitions in luminescence.
The last common scenarios for data analysis are color recognition and color pattern recognition, and it is here that ML methods are excellent for signal processing. When illumination is not well controlled, ML will have the dual role of color identification and correction for variation in conditions. Examples of ML for color recognition include support vector machines (SVM) for brightfield220–222 and luminescence85,223 imaging, and neural networks (NNs) for brightfield.165,224,225 NNs, hierarchical cluster analysis (HCA), and linear discriminant analysis (LDA), and principle components analysis (PCA) have been used to discriminate between color patterns from array-based assays.226–232 The data processing usually requires a calibration or training data set that spans a broad scope of possible assay inputs, color outcomes, and imaging conditions. Since most of these ML methods intrinsically perform a data reduction or transformation, there is little or no value to a prior conversion from RGB to another color space.
For research and development, an offboard approach is common for the implementation of data analysis methods. Familiar computer-based tools (e.g. ImageJ/Fiji, Adobe Photoshop, Icy) and programming tools (e.g. MATLAB, Python) are utilized for extraction and processing of data from smartphone-acquired images. For onboard analysis, whether for prototype development or downstream applications and end-users, the norm is development of a custom smartphone app. There are numerous online resources to assist novices in coding smartphone apps, inclusive of leveraging code already generated in, for example, MATLAB and Python.
An opportunity for improvement in the field is for more studies to provide full technical details about the components of their smartphone-based device, which are sometimes lacking in full or in part. Common examples of omissions include the power of light sources and wavelength information beyond a nominal color (e.g. peak and bandwidth), specifications for lenses and other optical components, the name of the app and full imaging settings (e.g. exposure time/shutter speed, ISO value, color temperature), and details around the extraction of quantitative data from images. Nevertheless, the meta-analysis data highlights the prevalence of some of the technical approaches discussed in the preceding sections and the diversity of the assay designs discussed in the following sections.
![]() | ||
Fig. 15 Colorimetric RT-LAMP assay with an indicator dye and smartphone-based color measurement. (A) Assay work flow. (B) Color change induced by mixing a drop of SYBR green I in the lid of the tube after iLAMP reaction with different copy numbers of synthetic viral RNA. (C) Hue measurement of different sample pools after amplification. Samples from healthy individuals are marked in blue; samples for SARS-CoV-2-positive patients are marked in green. Adapted from ref. 241 under a Creative Commons Attribution 4.0 International License. |
In other cases, analytes have reacted with colorless reagents to form a new colored species. Examples include the reactions of 2,4,6-trinitrotoluene with an amine to generate a brown Meisenheimer complex,258 formaldehyde with acetylacetone and ammonium to generate a yellow product,259 furfural vapour from gasoline with aromatic amines to generate a pink product,260 and phenolics (e.g. capsaicinoid analytes261) with Gibbs reagent and with Folin–Ciocalteu assay reagents to generate a blue color.262 Further examples include the detection of creatinine in urine via its reaction with picric acid (Jaffé method; orange color),263 nitrite via its reaction with Griess reagents (pink color),264 a cannabinoid via its reaction with Ehrlich reagent (pink color),265 and gamma-hydroxybutyrate (a recreational drug) via its reaction with hydroxylamine and complexation of aqueous Fe3+ (purple color).266
Clearly, there is no shortage of chromogenic reactions that a smartphone camera is equipped to measure; however, their practicality for portable detection depends on the degree to which reagents must be handled by a user and the associated hazards. Most of the procedures for the detection of the solution-phase analytes noted above were at small scale and used a smartphone for quantitative readout, but were otherwise not substantially different from a standard benchtop laboratory protocol. This aspect is a potential barrier to successful translation to non-laboratory settings.
When an analyte is neither a substrate nor an inhibitor of an enzyme, then HRP-conjugates are frequently adopted to enable chromogenic detection. Examples of blot-style assays include the aptamer-based detection of Mycobacterium tuberculosis with TMB chromogen,274 and the immunodetection of the SARS-CoV-2 spike and nucleocapsid antigens (LOD 2 pM) via a chromogenic HRP-induced silver metallization reaction.275 Competitive enzyme-linked immunosorbent assays (ELISAs) have been ported to paper substrates for the smartphone-based detection of tetracycline (LOD 0.5 ng mL−1) and chloramphenicol (0.05 ng mL−1),276 and ketamine in clinical oral samples (0.3 ng mL−1).277 Color generation in ELISAs has been enhanced by NP scaffolds that carry multiple copies of HRP, as in the cases of AuNPs in an assay for saxitoxin (0.4 ng mL−1; Fig. 16)278 and graphene oxide in an assay for okadaic acid (0.02 ng mL−1).279 To make the ELISA more user friendly for portable detection, capture antibodies were immobilized on microbeads within wells that had a membrane bottom with pores smaller than the microbead diameter. The wells were placed on top of an adsorbent pad to facilitate washing through the pores while retaining the microbeads for detection for SARS-CoV-2 nucleocapsid protein (LOD 7.5 pg mL−1).167 As another example of a strategy for simpler execution of an ELISA, capture antibodies for FXYD3 (a urothelial cancer biomarker) were immobilized on the inner surface of the lid of a glass vial.280 The lid was moved stepwise between vials with the different assay reagents and shook, while also adopting AuNP-HRP conjugates for extra amplification per binding event.
![]() | ||
Fig. 16 Smartphone-based colorimetric analyzer for an AuNP-enhanced ELISA. (A) Device design. (B) Assay method. (C) Smartphone image (right) derived from the multi-well plate (left). (D) Plot of pixel intensity versus glucose concentration from RGB and grayscale image analysis. Abbreviations: STX, saxitoxin; BSA, bovine serum albumin. Also refer to the Abbreviations list. Adapted with permission from ref. 278 Copyright 2019 Springer Nature. |
Although colorimetric detection of nucleic acids is rare, one study leveraged the decrease in pH from polymerase activity during LAMP amplification to detect a SARS-CoV-2 gene (LOD < 50 copies/reaction) using the color change of phenol red pH indicator.281 Another study combined RT-LAMP, CRISPR/Cas9, and a DNAzyme-catalyzed chromogenic reaction for the detection of SARS-CoV-2 in clinical samples.282
Other colorimetric assays with NPs have been special cases where an analyte modulates the catalytic activity of the NP. For example, serum glutathione (LOD 0.3 μM) was detected through its inhibition of the oxidation of TMB by zeolitic imidazolate framework (ZIF-8)/AuNP materials.289 Conversely, aqueous Hg2+ (LOD < 8 ng mL−1)290 and Cr6+ (LOD 0.05 nM)291 were detected via their enhancement of the catalytic activity of AuNPs toward oxidation of TMB and methylene blue, respectively.
For the parallel detection of multiple analytes, each chromogen nominally responds to only one analyte. For example, a wearable patch was developed for detecting pH, urea, and Ca2+ (aq) in human sweat via separate spots with a cocktail of three pH indicator dyes, p-dimethylaminobenzaldehyde (Ehrlich reaction with urea), and o-methyl phenolphthalein indicator (Fig. 17).164 Another wearable patch was reported for the AI-assisted analysis of pH, vitamin C, Ca2+ (aq), and protein levels in tears using a cocktail of indicator dyes and three chromogenic systems.230 A trio of indicator dyes was used on a paper substrate for the detection of gaseous ammonia, formaldehyde, and hydrogen sulfide,294 and chromogenic inks were printed in a QR code pattern for dosimeter-like response to relative humidity, temperature, and gaseous H2S, NH3, and CO2.295 NO3− (aq), Mg2+ (aq), Ca2+ (aq), and NH4+ (aq) were detected as macronutrients of interest through a μPAD with a combination of the Greiss method, three indicator dyes, and the salicylate method.296 A conceptually similar mix of indicator dyes and chromogenic reactions was used to develop a μPAD for the detection of Fe3+, Ni2+, Cr6+, Cu2+, Al3+, and Zn2+ (aq).297 NNs enabled an array of five chromogenic reactions to distinguish between seven illicit drugs,231 and enabled a linear barcode of 20 different compositions of a halochromic dye, chitosan NPs, and cellulose acetate to predict meat freshness from its volatile amines.229
![]() | ||
Fig. 17 Stretchable patch for colorimetric sweat sensing directly from skin. (A) Design of the patch. (B) Photograph of the patch with six reference colors and indicator spots for detecting pH, urea, and Ca2+ (aq). (C) Smartphone imaging of the patch for in situ colorimetric analysis. Adapted with permission from ref. 164 Copyright 2024 American Chemical Society. |
Enzyme-catalyzed chromogenic reactions have also been multiplexed. One example is a plate-based assay for the detection of glucose, uric acid, cholesterol, and triglycerides via oxidase-peroxidase coupled reactions ending in the chromogenic oxidation of 4-aminophenazone, supplemented with a classic biuret reaction and indicator dye for the additional detection of total protein and albumin (Fig. 18).298 A related example is an injectable “ink” for pH measurement (via a cocktail of three indicator dyes), glucose (via the glucose oxidase–peroxidase-TMB chromogenic system), and albumin (via a protein-binding indicator dye).299
![]() | ||
Fig. 18 Colorimetric assay for the simultaneous determination of glucose (GLU), total protein, human serum albumin, uric acid, total cholesterol, and triglycerides in plasma samples. (A) Smartphone image of the multi-well layout of the colorimetric array (each row) and its response to different samples (each column). (B) Comparison of calibration curves for glucose measured by smartphone (left y-axis) and by conventional spectrophotometry (right y-axis). Adapted with permission from ref. 298 Copyright 2024 Springer Nature. |
In aggregative detection mechanisms, an analyte compromises the colloidal stability of the AuNPs. However, loss of colloidal stability is also a potential outcome from changes in temperature, ionic strength, and pH, as well as from non-specific binding interactions with molecules in a complex sample matrix. Although some aggregative mechanisms have been functional with authentic samples, a majority of studies have used lab-prepared solutions of analyte for proof of concept or relied on substantial dilution of authentic samples. Many of these approaches lack a defined and robust mechanism for selectivity and are not discussed in this review. Nevertheless, there have been examples of aggregative detection with a selective component: the nominal trypsin activity in pancreatitis samples was detected via a color change when the bovine serum albumin molecules stabilizing AuNPs were hydrolyzed to cause particle aggregation;300 and a five-material array of AuNPs synthesized with different ligands and reducing agents was able to discriminate between eight different pesticides in washes of fruit samples.301 In the latter case, the color changes were related to aggregation dependent on the level of inhibition of acetylcholine esterase activity by the pesticide.
Assembly-based assays incorporate a component for selective recognition of analyte that induces or disrupts a close proximity between AuNPs. As a simple and elegant example of this approach, AuNP–antibody conjugates bound to the spike protein on SARS-CoV-2 virus with sufficient density to generate a color change from red to blue (LOD 0.3 PFU mL−1; Fig. 19).302 Analogous detection of Listeria monocytogenes was also demonstrated,303 and the concept was extended to the detection of a nucleic acid reporter sequence from a magnetic pull-down immunoassay for creatine kinase-MB (CK-MB; LOD 0.8 pM).304 In the later example, the reporter was amplified by rolling circle amplification (RCA) and the proximity needed for a color change arose from binding of AuNPs (less sensitive) and AuNP-tetrahedra (more sensitive) along the repeating sequence of the linear product.304 In another case, hybridization-mediated assembly between AuNP–oligonucleotide conjugates generated signal in a proteolysis-responsive transcription assay for matrix metalloproteinase-2 activity (LOD 5.7 pM) in serum, which distinguished between healthy persons and cancer patients.305 Conversely, the trans-nuclease activity of CRISPR/Cas12a was used to prevent the assembly of AuNP–oligonucleotide conjugates for the detection of SARS-CoV-2 (LOD 1 copy per μL).306
![]() | ||
Fig. 19 Colorimetric detection of SARS-CoV-2 analysis in saliva samples using a smartphone. (A) Assay concept. (B) Change in color, measured via a B/R ratio, for samples with and without SARS-CoV-2 virus. The inset shows the change in the color of solutions with different amounts of virus (measured in plaque-forming units). Adapted with permission from ref. 302 Copyright 2022 American Chemical Society. |
![]() | ||
Fig. 20 Analysis of plant volatiles using a portable smartphone-based device and colorimetric array. (A) Assay work flow and photograph of the device. (B) Smartphone image of the colorimetric array before and after exposure to headspace gases. (C) RGB difference profiles for the array exposed to different concentrations of (E)-2-hexenal (0.5–25![]() ![]() |
The reactivity of NPs has also been leveraged for the detection of solution-phase analytes. Bromide (LOD 0.5 mg dL−1) and glucose (LOD 1 mg dL−1) were detected via their direct and indirect (H2O2 production by glucose oxidase) etching of silver triangular nanoprisms;225 Hg2+ (LOD 50 μM) was detected in tap water via its color-fading amalgamation with AgNPs;311 and the activity of acid phosphatase (LOD of 0.97 U L−1) in human serum was quantified through a set of coupled reactions that ultimately produced triiodide to etch gold nanorods (AuNRs).312 As another example, cyanide was detected by its ability to etch Au@Au–Ag NPs, where three different sizes of the NPs (and thus starting colors) were used in an array format for greater quantitative reliability.313
A more exotic approach to detection has been the growth of NPs to generate color as the readout of immunoassays. A competitive immunoassay for tyramine utilized an alkaline phosphatase conjugate of the antibody to convert ascorbic acid phosphate to ascorbic acid to enable the formation of gold nanostars from gold salt.314 A similar approach grew silver on AuNR seeds for the detection of acrylamide, albeit requiring chemical derivatization of the analyte as the first step in the immunoassay.315
The principal motivation for smartphone-based imaging of LFIAs is quantitation based on the color intensity of the test line. Whereas qualitative LFIAs are useful for binary scenarios (e.g. pregnant or not, infected with virus or not), quantitative LFIAs enable assays of analytes that are naturally present in a sample to determine if levels are too high or too low. Quantitative smartphone readout of LFIA test lines has been shown to be well correlated with lab-based CL immunoassays.324 When applied with LFIAs with multiple test lines for the same analyte—a configuration that nominally renders the assays pseudo-quantitative by visual inspection—smartphone readout provided a modest improvement in detection limit.325
In general, any strategy that improves LFIA sensitivity by visual inspection also benefits readout by smartphone. Examples of strategies include compression of a zone of the membrane to slow flow at the test line,326 narrowing of the membrane at the test line to increase the density of analyte binding,327 and electrokinetic preconcentration based on ion concentration polarization with a commercial 9 V battery (2.7-fold improvement in LOD).328 Assembly of a cluster-like network of AuNPs, without a change in their plasmon resonance (i.e. red color), decreased the detection limit for an LFIA for enrofloxacin (LOD 10–1 μg L−1) by three orders of magnitude compared to single AuNPs.329
Peripheral hardware for smartphone-based colorimetric LFIAs has been wide ranging. At the extreme of simplicity, hardware is absent and the assay relies on ambient light and manual positioning for image acquisition. In other cases, there are attachments and boxes to position the smartphone and LFIA strip and provide consistent illumination via an internal light source, whether the source is the smartphone flash77,330 or LEDs external to the phone.31,316,331,332 It is also possible to combine a box with ambient lighting for readout.317 At the technical extreme, a multi-step LFIA was semi-automated by means of a device with a motorized rotor (Fig. 21).333 The rotor had four diametric pairs of sample pads (for adding chromogenic signal development reagents) and absorbent pads (for driving fluid flow) that moved in sequence to bracket a central test zone membrane. A less technical approach for two-step development of signal in an LFIA was a two-tiered LFA with a slow-dissolving polymer barrier to delay the arrival of reagents for amplification (by NP growth) until after the initial binding of analyte and AuNP-antibody conjugates at the test line.332
![]() | ||
Fig. 21 Rotary device for an enzyme-linked LFIA with a colorimetric detection. (A) A photograph and illustration of the rotary device containing the nitrocellulose (NC) membrane, the sample pads and absorbent pads. The top layer is rotated via a motor controlled by the smartphone via Bluetooth. (B) Assay steps (a–e). Each step takes 5–10 min. (C) Smartphone images showing (top) the signal generation from the chromogenic turnover of 3,3′-diaminobenzidine (DAB) with increasing concentrations of the target E. coli bacteria, and (bottom) the selectivity for E. coli over other bacteria species. Figure adapted from ref. 333 under a Creative Commons CC BY 4.0 license. |
Image processing for LFIAs have been as straightforward as color analysis of regions of interest in the RGB, HSV, and CIE spaces discussed earlier, as well as grayscale, but has also incorporated computer vision and ML for the recognition of test cartridge and line positions, and for image calibration.334,335 Examples include the application of statistical image analysis,336 support vector machines,337,338 convolutional NNs,339,340 and other deep NNs.341
Smartphone cameras have also benefited multiplexing with LFIAs. Some approaches, like bifurcated membranes, derive only the aforementioned quantitation advantage.342 Other multicolor approaches leverage the RGB information available. In one case, a single competitive LFIA was able to distinguish between food contamination with one of two different types of mycotoxin (aflatoxin B1 and type-B fumonisins; LODs of 1 and 50 ng mL−1) through a pair of AuNP–antibody conjugates that roughly corresponded to red (30 nm diameter) and blue (75 nm) colors.343 In another case, a sandwich LFIA featured a combination of two test lines, each with two co-immobilized capture antibodies, plus two different reporter antibody conjugates of each of blue and red latex microparticles, to detect and discriminate between serogroups of Salmonella (Fig. 22).344 The position (first or second line) and color (blue or red) of test-line binding indicated the specific serogroup. In both cases, the camera provided a non-subjective means of color recognition. Another approach utilized an LFIA with three test lines for three mycotoxins and red, green, and blue colors of reporter antibody–latex microsphere conjugates.345 Here, the color and line location provided a level of redundancy.
![]() | ||
Fig. 22 Two-line two-color LFIA for serotyping Salmonella. (A) Assay design (left), smartphone images of LFIA results for four different serotypes (O:2, O:3, O:7, O:9, top-right), and position of the blue and red latex microspheres (LMs) on an HSB color space projection. (B) Smartphone images of LFIA test strip response to different concentrations of O:2 standard strain and O:3 standard strain. Adapted from ref. 344 with permission. Copyright 2023 Elsevier. |
The vast majority of LFIAs have, to date, utilized AuNPs to generate contrast at test and control lines, and smartphone-based approaches are no exception. As noted above, dyed latex microparticles—another classic contrast label for LFIAs—have also been utilized with smartphone readout.331,344 Nevertheless, numerous papers have evaluated alternative materials: blue-colored iridium (VI) oxide NPs,346 which provided approximately double the contrast compared to AuNPs; rhodamine B-labeled polymersomes;347 polydopamine NPs;334 composite materials derived from hyperbranched AuNPs and polydopamine;348 carbon black NPs;349 and NPs derived from cuttlefish ink.350 A caveat in comparing the contrast from different NP materials is that extinction coefficients tend to increase with increasing size. It is therefore necessary to consider both the type and size of a material when choosing a colorimetric label. Size is also a potential consideration in so far as it affects NP transport on the LFIA membrane, non-specific binding, and blocking of membrane and pads.
Other LFIAs have adopted nanozymes and other NPs that catalyze chromogenic reactions for signal amplification with LFIAs. Examples of such materials include PtPd NPs with DTNB chromogen;58 Au@Pt NPs,351 CuCo NPs,352 Rh NPs (50-fold improvement in LOD versus standard AuNP usage),353 Au@PtPd NPs with TMB and peroxide;31 and cerium oxide NPs with TMB (no peroxide; two-fold improvement in sensitivity versus AuNPs).354 The gain in signal comes at the cost of an extra processing step and additional reagents.
Although not very common, the lateral flow assay format with smartphone readout has been adapted to the detection of nucleic acids. A simple adaptation utilized a test line with streptavidin, a control line with an oligonucleotide probe, and AuNP–oligonucleotide conjugates to detect biotinylated amplicons from recombinase polymerase amplification (RPA) of a Salmonella gene (LOD 19 CFU mL−1).355 Biotinylated and fluorescein-labeled LAMP amplicons for SARS-CoV-2 detection (LOD 4000 copies per mL) were likewise detected with a streptavidin test line and AuNP–anti-fluorescein–antibody conjugates.356 Tilapia lake virus RNA was detected through RT-RPA amplification followed by CRISPR/Cas12a amplification with a biotin–oligonucleotide–fluorescein reporter and AuNP–anti-fluorescein conjugates (LOD 200 copies/reaction).357 A similar approach was adopted to screen for six genes of Bacillus cereus in milk and rice samples (LOD 10−4 ng mL−1),358 and the CaMV35S promoter sequence relevant to genetically modified organisms was detected (LOD 10 aM) with substitution of RCA for RPA.359 A lateral flow assay for detection of a Salmonella gene (LOD 1 CFU mL−1) in food samples used a combination of RPA, CRISPR/Cas12a, and chromogenic oxidation of TMB.360 Assays of this nature have notably compromised simplicity and portability for enhancement of detection in an LFIA format.
Other approaches for smartphone-based cell counting rely on the direct imaging of cells. As a unique example of bulk imaging, L929 cells were counted with the assistance of a trained convolutional NN through brightfield imaging of a centrifuged pellet of cells in a plastic tube.365 However, most approaches resolve individual cells to generate counts. Stains have sometimes been used to enhance image contrast or to help identify target cells, as in the cases of counting red blood cells in a Leishman-stained blood sample,366 and counting Cryptosporidium and Giardia (oo)cysts in vegetable wash water and river water samples with Lugol's iodine-staining.367
Some cell-counting approaches have also bypassed staining. A method of counting CD4+ T cells for HIV monitoring relied on immunocapture of the target cells (from whole blood) within a microfluidic chip.368 A battery-powered clip-on device utilized a broadband LED for illumination and a pair of lenses from a DVD drive to supplement the smartphone camera for brightfield imaging. Individual cells counted in the field of view were converted to a sample cell count. A similar technical approach was used to count sickled cells (i.e. monitor sickle cell disease) from whole blood samples.369 The main difference was that immunocapture was not necessary since the image analysis algorithm distinguished round (healthy) cells from misshapen (sickle) cells.
Whereas most cell counting approaches have utilized a sample preparation with static cells, a smartphone-based brightfield imaging flow cytometer has been reported. The device used a high-power LED illumination source, a simple PDMS-on-glass microfluidic chip, and objective and eyepiece lenses borrowed from a conventional microscope.370 The prototype sacrificed some portability for performance, requiring an outlet-connected power supply for the LED source, but was able to image cells with <700 nm spatial resolution at real-time rates up to 100 cells per second and post-processing rates of 67000 cells per second. The high-power LED was necessary to produce sufficient illumination intensity for imaging the fast-flowing cells at a high frame rate to avoid motion blur. A convolutional NN analyzed cell size and morphological features to distinguish Jurkat and EL4 cells.
Tissue specimens have also been analyzed by smartphone microscopy. The assessment of nonalcoholic fatty liver disease lesions from hematoxylin-and-eosin-stained liver allograft biopsies,371 and the evaluation of allograft kidney biopsy specimens,372 are two examples of applications. A growing trend in smartphone microscopy is the use of deep learning (i.e. NNs) for the analysis of acquired images. Benefits of this approach include automation, elimination of the need for a trained expert for image interpretation, mitigation of potential limitations in image quality, and additional informing power that avoids the need for further analysis (e.g. immunohistochemistry). Examples of deep-learning-supported imaging have included screening for sickle cell disease from patient blood smears (Fig. 23),89 screening for cervical cancer from liquid cytology samples,373,374 classification of skin lesions as malignant or benign,375 identification of five species of an invasive insect (genus Liriomyza),376 early detection of mold on bread,377 and prediction of the presence of asbestos in building materials.378
![]() | ||
Fig. 23 Smartphone-based brightfield microscope for sickle cell identification. (A) Photograph (left) and design (right) of the microscope device. (B) Close-up of the optical path. (C) Workflow from image acquisition to identification of sickle cells. Adapted from ref. 89 under a Creative Commons Attribution 4.0 International License. |
In general, the above methods utilized clip-on attachments for a smartphone to enable brightfield microscopy with suitable magnification, or had 3D printed a small smartphone-based microscope device for the benchtop. One noteworthy clip-on attachment was only 0.15 cm3 in volume, 0.5 g in weight, and $10 in cost, with a reported order of magnitude improvement in depth of field compared to a conventional microscope. It was combined with deep learning for classifying skin moisture levels.379 At the other extreme of device design, microscopy has been approached by mounting a smartphone on a scientific benchtop microscope that would otherwise not be equipped with a digital camera. This approach has been implemented with deep learning for determining the risk of malignancy for thyroid fine-needle aspiration biopsy samples,380 for subtyping of cancer cells and detecting lymph node metastasis from hematoxylin-and-eosin-stained pathology tissue slices,381 and for evaluating the morphology of embryos for in vitro fertilization.382 A third viable platform for smartphone microscopy has been the low-cost, commercially-available “foldscope” paper microscope, which was adopted to screen antifungal agents for their effect on the C. albicans pathogen,383 and for imaging prepared slides of mammalian endocrine glands in a classroom setting.384
As a brightfield microscopic approach to molecular detection, polystyrene microspheres were combined with magnetic NPs to enable a digital competitive immunoassay for aflatoxin B1.385 To report on a plate-based immunoassay, the secondary antibody for detection was conjugated with alkaline phosphatase to produce ascorbic acid, which then initiated an azide-alkyne click reaction that coupled magnetic nanoparticles to microspheres in the assay supernatant. The analyte was quantified through magnetic capture and AI-assisted counting of the microspheres. In principle, this strategy is adaptable to a variety of immunoassays and coupling or ligation reactions.
As described, all of the assays noted above would have been possible with conventional RGB imaging with a smartphone camera. Equivalent analytical performance would also be anticipated for conventional imaging, particularly when aided by modern ML methods. A smartphone spectrometer will be most useful when there is a need for detailed or continuous spectral data over color information, such as when two signals to be unmixed do not make significantly different contributions to two different RGB channels. This scenario is rare and thus the spectral resolution will often not be worth the technical costs.
In addition to metal NPs, materials such as metal–organic frameworks and cobalt oxyhydroxide nanoflakes have been used as scattering reporters. Scattering assays without synthetic reporters are also possible in certain cases: bacteria were detected in suspension through the loss of light scattering as a bacteriophage lysed the cells (and provides selectivity);397 and SARS-CoV-2 genes (LOD 1 copy per μL) were detected using a water-in-oil emulsion implementation of LAMP, where the production of amplicons decreased the interfacial tension, decreasing the droplet size and scattering intensity as the amplification progressed.398
Smartphone imaging formats have also been developed around light scattering. In one example, a smartphone-based device with built-in polarizers and a green laser imaged backscattered light from bacterial colonies in a petri dish (Fig. 24).399 Images features were algorithmically extracted, and the type of bacteria was identified through a support vector machine learning analysis of the colony morphology. A related example is the application of ML to count “DNA colonies” that were formed by LAMP reactions confined within a polyacrylamide hydrogel (Fig. 25).400 The production of pyrophosphates during the amplification led to the formation of magnesium pyrophosphate precipitates, which scattered light and were highly visible by reflection imaging (LOD 1 copy/reaction). A darkfield configuration based on total internal reflection of white-light was used to image light scattered from metal precipitates to identify Pb2+ and Hg2+ in drinking water, where the color of the precipitate provided information about the identity of the metal.401
![]() | ||
Fig. 24 Smartphone imaging and identification of bacterial colonies via elastic light scattering and machine learning. (A) Design of the smartphone-based device. (B) Examples of backscatter patterns from colonies of several species of bacteria. Abbreviations: BS, beam splitter; PCX, Plano-convex. Figure reproduced from ref. 399 under a Creative Commons CC BY 4.0 licence. |
![]() | ||
Fig. 25 Label-free detection of DNA via light scattering. (A) Assay methodology (PAM = polyacrylamide monomers). (B) Smartphone images of “DNA colonies” (precipitates of magnesium pyrophosphate) in a hydrogel. The colonies are ultimately counted by a machine learning algorithm. Adapted with permission from ref. 400 Copyright 2024 American Chemical Society. |
Fluorescent dyes have also been developed for interaction or reaction with an analyte, including dyes applied to the smartphone-based detection of malononitrile403 (a cyanogen) and biogenic amines404 (for assessing food freshness) through changes in emission color, and the detection of gamma-hydroxybutyric acid (the date rape drug) in carbonated and alcoholic drinks through an increase in emission intensity.405 A thiol-responsive AIEgen (a dye that undergoes aggregation induced emission) was developed for the detection of an organophosphorous pesticide in hydrolyzed leaf extracts.406 Dipicolinic acid (an anthrax biomarker) was detected through a competitive coordination interaction that activated the fluorescence from Tb3+ ion.407 Volatile amines have also been identified through a combined analysis of the absorbance color and fluorescence color of a specially synthesized BODIPY dye.408
Examples of smartphone-based PL assays with enzyme-catalyzed fluorogenic reactions include measurement of the activity of β-glucosidase using a fluorogenic substrate,409 and the detection of glucose in wound exudate through the coupled reactions of glucose oxidase and HRP to convert dichlorofluorescein-diacetate to its fluorescent form.410
Arrays of fluorophores have also been used to detect and identify analytes. A paper-based array of poly(arylene ethynylene) fluorophores identified 10 different polyaromatic hydrocarbons through changes in the RGB emission color of the polymers combined with principal component analysis and discriminant analysis.226 Similarly, an array of six different fluorescent dyes distinguished between five types of amyloid fibrils, including with diluted plasma and artificial cerebrospinal fluid samples, through ML analysis of changes in fluorescence intensity and RGB color.232
The reactivity of NP materials has also been exploited for the detection of analytes. Examples include the quenching effects of Cu2+ (aq) on carbon dots,414 Hg2+ (aq) and S2− (aq) on CdZnTe QDs,415 Hg2+ (aq) on gold nanoclusters,416 and water in ethanol on perovskite QDs.417 Quenching of luminescent metal organic frameworks have also been utilized for detection of chlortetracycline in seafood homogenate.418
Various photoluminescent NPs have been adopted for smartphone-based readout of LFIAs. QDs are one of the more popular materials and have been utilized for the detection of Influenza A nucleoprotein in simulated nasal matrix (LOD ≤ 3 fmol),421 ciliary neurotrophic factor (biomarker for glaucoma; LOD 6 pg mL−1),425 and antibodies toward the Taenia solium rT24H antigen with samples from patients with neurocysticercosis.426 Other LFIAs have amplified test-line signals by using silica or polymer particles doped with many QDs. Examples include the detection of PSA in human serum samples (LOD 0.14 ng mL−1);427 interleukin-6,428 ciprofloxacin (LOD 0.05 ng mL−1),429 and Zika virus non-structural protein 1 in serum (LOD 0.15 ng mL−1).430
In addition to their high brightness, the spectrally narrow emission of QDs has enabled a novel detection approach for LFIAs: signaling of analyte through a change in the color of the test line rather than a change in its single-color fluorescence intensity. The analyte-induced transition is from green to red QD PL at the test line, with intermediate hues of yellow and orange. This color-changing approach is less dependent on illumination conditions and has better interpretability to the naked eye. It has been adopted for competitive assays of aflatoxin M1 (LOD 1 pg mL−1)423 and benzothiostrobin (LOD < 1 ng mL−1),431 and for sandwich assays for heart-type fatty acid binding protein (LOD 0.21 ng mL−1; Fig. 26)432 and the SARS-CoV-2 nucleocapsid protein (LOD 0.1 ng mL−1).433 Beyond QDs, there is also an example of this strategy with red-fluorescent ruthenium(II)-complex doped NPs and green-fluorescent gold nanoclusters.434
![]() | ||
Fig. 26 A ratiometric fluorescence LFIA (RFLFIA). (A) Assay design and comparison to a conventional non-ratiometric fluorescence LFIA (FLFIA). Abbreviations: H-FABP, heart-type fatty acid binding protein; SAQ, silica nanosphere loaded with AuNPs and red-light emitting CdSe/CdS/ZnS QDs; mAb, monoclonal antibody. (B) Smartphone-based device for imaging the RFLFIA. (C) Examples of smartphone images of the RFLFIAs with increasing concentration of the heart-type fatty acid binding protein analyte. Adapted from ref. 432 with permission. Copyright 2021 John Wiley and Sons. |
The PL colors of QDs also have potential for multiplexed LFIAs. One strategy has been to use LFIAs with two test lines, either on the same strip (Fig. 27)78 or on separate arms of a bifurcated membrane,435 where immunoconjugates of green and red QDs (or QD assemblies) bind to separate lines for capture of each analyte. Because of the spatial separation of the two test lines, two different immunoconjugates of a single color of QDs would still be useful for these assays, albeit that the potential benefit from two colors is redundancy to guard against non-specific binding to the wrong test line. A format where the two analytes are captured on the same test line requires the two distinct colors of QD and a color-based analysis, as was the case for an LFIA of free and complexed forms of PSA.436
![]() | ||
Fig. 27 Two-color, two-line multiplexed competitive LFIA with fluorescence detection. (A) Assay design and smartphone images of assay outcomes. (B) Design of the smartphone-based device used to image the LFIAs. (C) Smartphone images of LFIAs and (D) the corresponding calibration curves for each analyte, aflatoxin B1 (AFB1) and zearalenone (ZEN). The y-axis in panel D is the ratio of signal between the test and control lines. Adapted from ref. 78 with permission from Elsevier. |
Many other luminescent NPs have been adopted in LFIAs. Polymer microspheres and nanoparticles doped with Eu(III) complexes were used as labels to detect thyroid stimulating hormone in diluted serum (LOD 0.02 μIU mL−1);422 lung-cancer relevant plasma extracellular vesicles (LOD 105 mL−1);437 ochratoxin A in wheat samples (LOD 0.32 μg kg−1);438 Hepatitis B virus in serum samples;439 and five different classes of mycotoxin, spanning 20 individual compounds, with a five-line LFIA.440 Latex NPs conjugated with phycocyanobilin have also been utilized for LFIAs,80 and lanthanide-doped UCNPs were labels to detect ochratoxin A, Hg2+ (aq), Salmonella, hepatitis B virus nucleic acids, and protein ST-2,441 as well as C-reactive protein (LOD 0.05 ng mL−1).442 Two-color two-test-line LFIAs have also been demonstrated with Er3+ (green) and Tm3+ (blue) emitters for PSA and ephrin type-A receptor 2 (EphA2),443 and for brain natriuretic peptide and suppression of tumorigenicity 2 antigen in serum.444 PLNPs have been adopted for LFIAs of hCG (LOD 45 pg mL−1),35 17β-estradiol in milk,445 and T-2 toxins (0.025 ng mL−1) in food samples,446 plus two-test-line LFIA with green and blue colors for PSA and hCG.447 Other examples of materials include a red-emitting gold nanocluster-doped zeolitic imidazolate framework as a label in an LFIA of olaquindox (LOD 2.5 μg L−1),448 and AIEgen-doped MOF as a label in an LFIA of aflatoxin B1.449
Any comparisons of analytical performance between different luminescent NPs will need to account for differences in excitation intensity and detection efficiencies between different smartphone-based devices. The most reliable comparisons will be head-to-head with the same device, and there are few instances of such studies in the literature.
To date, the majority of published studies on smartphone-based detection of nucleic acids have focused on amplification of the target sequence and detection and quantification of the amplified targets. As such, sample preparation has tended to follow standard laboratory protocols using commercial kits for nucleic acid extraction, and mixing of sample with the reagent cocktails required for reverse transcription (for RNA targets) and the amplification method of choice. Only a few studies have streamlined the sample processing steps alongside smartphone-based detection. One unique approach used a patch-like microneedle array (made from polyvinyl alcohol) to extract RNA by pressing it onto a plant leaf and releasing the RNA by simple rinsing of the array with buffer.450 The extracted RNA was ultimately used to detect plant infections, including Phytophthora infestans and tomato wilt virus (LOD of 1 pg; Fig. 28). With similar simplicity, hepatitis C viral DNA (LOD 5 pmol) was detected in clinical samples without an amplification step using a folded paper test square with immobilized peptide nucleic acid probes and an absorbent pad underneath.451 Sample was added, washed, and fluorescently stained in successive steps that consisted of dropping microliters of solution onto the test square. These examples highlight how user actions can be simplified and minimized, to various degrees, despite the frequent requirement for numerous reagents and multiple steps in a nucleic acid analysis that goes from sample to answer.
![]() | ||
Fig. 28 Microneedle extraction of nucleic acid and on-chip LAMP with smartphone-based detection. (A) Photograph of a microneedle (MN) patch and work flow for the nucleic acid extraction. (B) Schematic of the LAMP sample cassette and cross-sectional view of smartphone-based reader device. (C) Representative smartphone fluorescence images of the parallel LAMP assay chip (top) for different nucleic acid sequences (I–IV) and photographs of healthy and infected leaf samples (bottom). (D) Real time amplification curves for P. infestans DNA obtained via the smartphone-based LAMP platform. (E) Comparison between the smartphone device and a conventional laboratory instrument. Adapted with permission from ref. 450 Copyright 2021 Elsevier B.V. |
With respect to amplification, polymerase chain reaction (PCR) coupled with a fluorescence detection method is the gold standard for nucleic acid diagnostics. This amplification method requires that thermocycling be implemented in a portable device. One approach to both conventional and digital PCR with smartphone-based fluorescence detection is reproduction of the classic temperature programming of PCR via a Peltier (i.e. thermoelectric) module, as done for the detection of the CD147 gene and cancer biomarker.94 Convective thermocycling PCR, whether separate435,452 or interfaced453 with the detection device, has been an alternative approach that enables a heating element to be maintained at a constant temperature. It has been utilized with smartphone-based devices to detect lambda DNA (LOD 3000 copies),452 genes diagnostic of methicillin-sensitive and methicillin-resistant Staphylococcus aureus (LOD 5000 copies),435 and influenza A (H1N1) virus (LOD of 1 tissue culture infectious dose per mL).453
Another implementation that utilizes a heater at fixed temperature is continuous flow PCR, where, for example, one face of a trigonal helix of sample-carrying tubing was in contact with a constant-temperature heater to produce alternating hot and warm temperature zones that functioned for thermocycling.454 Another example doped the PDMS of a microfluidic chip with gold nanorods for photothermal heating under illumination from an 808 nm laser.91 Thermocycling arose from a circular geometry from a serpentine channel that moved in and out of the hot zone produced from the radial intensity profile of the laser spot. In these two examples, the analytes were H7N9 avian influenza DNA (LOD 104 copies per μL) and hepatitis B virus DNA (LOD 12 copies per μL, 40 min assay time).91 From the standpoint of device engineering, the difference between temperature programming and oscillating sample along a temperature gradient is minimal. Both formats regulate temperature using feedback from an integrated temperature sensor. Temperature programming devices more frequently add a cooling fan, but more readily accommodate array-based multiplexing since samples can be compartmentalized in a small area.
As an alternative to the thermocycling of PCR, loop-mediated isothermal amplification (LAMP) methods are frequently paired with smartphone-based detection. Some reported smartphone-based devices have had integrated heaters to obtain the 60–65 °C typical of the method,450,455 another device had a distinct compartment dedicated to the heating step of the assay,456,457 and some assays have relied upon benchtop heating instruments.456–458 Analytes were lambda DNA (LOD 1 copy per μL),458 SARS-CoV-2 RNA (LOD 10 copies per μL, 60 min assay time),456 and human papillomavirus (HPV; 30 min assay time).457 Another common isothermal method (normally 37–42 °C, less efficient at room temperature) is recombinase polymerase amplification (RPA). Examples of targets amplified by RPA have included HIV-1 RNA (LOD 67 copies), where a consumer coffee warming device was used as the heater,459 and HIV and hepatitis B genes (LOD 1000 copies per mL).81 The latter example was a small-scale suspension array that used the smartphone camera to recognize QD-doped bead colors corresponding to specific nucleic acid targets. Many other targets have also been measured through pairing of RPA with CRISPR/Cas signal amplification (vide infra).
Nearly all smartphone-based PL assays for nucleic acid detection have used fluorescent dyes for signal generation. Fluorescein is widely used as a dye label on oligonucleotide primers and reporters, likely due to is combination of low cost and high brightness relative to other dyes, optimal excitation by widely available blue LEDs, and green emission that overlaps well with the G channel response of smartphone cameras. Alexa Fluor 647 has also been utilized for its compatibility with orthogonal interrogation with QD-based microbead barcodes for optically multiplexed detection of DNA associated with infectious diseases such as human immunodeficiency virus (HIV) and hepatitis B and C (Fig. 29).81 Alternatively, intercalators and DNA-binding dyes (e.g. TB green, EvaGreen, SYBR Green) that switch from dark to bright PL upon interaction with double-stranded DNA have been utilized for readout from both PCR and LAMP amplifications.450,454,455,460,461
![]() | ||
Fig. 29 Portable device for amplification and suspension-array-based detection of nucleic acid sequences. (A) Barcode detection of target DNA from patient samples by quantum dots. (B) Typical microwell chip containing different barcodes in each well. (C) Smartphone camera captures the image of four different quantum dot barcodes arrayed on the surface of the chip. (D) Schematic and real images of the smartphone device. (E) Visual representation of the envisioned final device, with the different compartments. (F) Yellow, green, and red barcodes are deposited on the chip and imaged using the device. (G) Sensitivity curves for genetic biomarkers for the blood-borne viruses human immunodeficiency virus (HIV), hepatitis B virus (HBV), and hepatitis C virus (HCV). (H) Comparison between the average combined statistics of all subjects of the HIV-negative group (3 subjects) and HIV-positive group (10 patients). Adapted with permission from ref. 81 Copyright 2015 American Chemical Society. |
The smartphone-implemented fluorescence detection methods paired with nucleic acid amplification methods have included commercial TaqMan probes,94,453 molecular beacons,462 magnetic pull-down binding assays (PCR, fluorescein, phycoerythtrin),452,463 and lateral flow binding assays (QDs with PCR;435 QDs with RCA amp;41 QDs with RTF-EXPAR, 10 aM, for multiple QDs per target;464 UCNPs with PCR amplicons465). A smartphone-based microchip capillary electrophoresis unit has even been proposed for the detection of fluorescently labeled PCR amplicons.124
In several other studies, the target nucleic acid sequence triggers the trans cleavage activity of CRISPR/Cas12a or CRISPR/Cas13a to hydrolyze the reporter with loss of FRET and recovery of the dye fluorescence. Fluorescein is by far the most common dye in such fluorophore-quencher reporter systems, although carboxyrhodamine (ROX), carboxytetramethylrhodamine (TAMRA), and cyanine 5 (Cy5) have also been adopted. Examples of assays have included the detection of genes diagnostic of African Swine fever virus (LODs of 8 copies per μL),466,467 Frog virus 3 (LOD 10 aM),468 and SARS-CoV-2 (LOD 100 copies per μL).469 Although these examples utilized a standard lab-based nucleic acid extraction, another study reported a small and low-cost device for simple isolation of RNA from saliva samples in one step and detection in a second step (Fig. 30).470 The first step isolated RNA on a polyethersulfone (PES) membrane disc with pre-loaded lysis reagents and provided 95 °C heat for inactivation of nucleases. The second step transferred the membranes to a reaction chamber that was pre-loaded with freeze-dried assay reagents and provided 37 °C heat for RPA and Cas-mediated detection (LOD 1000 cp per mL; 60 min assay time).470 Alternatively, multiple CRISPR/Cas methods reported for the detection of SARS-CoV-2 have returned results without extraction from patient samples, with assay detection limits in range of 100–1000 copies per mL with assay times of 15–50 min.82,471,472 One such method used a laser-based smartphone device for readout of fluorescence from fluorophore-quencher reporter oligonucleotides (Fig. 31).82
![]() | ||
Fig. 30 Sample-to-answer device for CRISPR-based detection SARS-CoV-2 and variant nucleic acids. (A) Design of the device, including sample processing (left) and assay (right) modules. (B) Photographs of the device, which is capable of two-plex detection. (C) Smartphone-acquired fluorescence images of samples. Figure reproduced from ref. 470 under a Creative Commons CC BY 4.0 license. |
![]() | ||
Fig. 31 CRISPR/Cas method for detection of viral RNA from SARS-CoV-2. (A) Workflow of the assay. (B) Design of a smartphone-based fluorescence reader. (C) Smartphone-acquired image of fluorescence from a multi-well chip preloaded with assay reagents. (D) Calibration curve for measured fluorescence intensity versus the copy number of viral RNA. (E) Comparison of results between the smartphone-based device and RT-qPCR as a standard laboratory method. Figure reproduced from ref. 82 under a Creative Commons CC BY 4.0 license. |
Whereas the foregoing studies combined CRISPR/Cas12a with RPA, another approach has relied only on the signal amplification intrinsic to the multiple turnover capability of Cas12a for the detection of genes diagnostic of hepatitis B virus and HPV (LODs of 200 pM for a conventional assay and 5 fM as a digital assay).473 Other signal amplification approaches for smartphone-based assays have included the hybridization chain reaction for detection of cancer relevant miRNA-224 from plasma,474 Exo-III-assisted amplification for detection of miRNA-155 (LOD 42 aM), 16S rRNA of S. aureus (LOD 18 CFU mL−1), and a gene from COVID-19 pseudovirus RNA (LOD 87 copies per μL).475
The predominant use of fluorescent dyes for detection likely arises from four considerations: the widespread commercial availability of dye-labeled oligonucleotides; status as the gold-standard class of material for fluorescent labeling in lab-based nucleic acid assays; tolerance of dye labels by the enzymes leveraged for nucleic acid amplification and hydrolysis; and, in some cases, intrinsic sensitivity of dye fluorescence to nucleic acid structure. Likewise, these considerations almost certainly underlie the almost uniform adoption of homogeneous solution-phase assay formats. Alternative fluorescent materials such as QDs have a higher ceiling for sensitive detection, but their productive combination with relevant enzymes—though possible, including in the context of smartphone-based nucleic acid detection476 (amplification-free LOD of 50–100 pM)—is not as turnkey as it is for dyes. Nucleic acid assays with QDs are therefore more likely to be in the form of post-amplification binding assays that require wash steps, albeit avoidable with a lateral flow format, as demonstrated for the detection of DNA from methicillin-resistant S. aureus (LOD 4700 copies post-convective PCR).435 Perhaps the best aspiration for ultra-bright fluorescent NPs is the amplification-free detection of clinically-relevant amounts of target nucleic acid with a smartphone device. A study has already demonstrated that plasmonic DNA nanostructures with silver NPs—in conjunction with a high numerical aperture objective and an atypically powerful (180 mW) laser diode—enable single-molecule fluorescence detection in DNA hybridization assays with a smartphone camera (Fig. 32).83 Fluorescent NPs have the opportunity to lower the technical requirements for such performance.
![]() | ||
Fig. 32 Single-molecule fluorescence detection on a smartphone using plasmonic nanostructures for metal-enhanced fluorescence. (A) Schematic of the DNA–silver NP nano antennas with cleared hot spots (NACHOS). (B) Diagram (top) and confocal fluorescence images (bottom) images of the NACHOS with three capture strands in the hotspot and a green-fluorescent reference dye for labeling of the DNA origami. (C) Diagram of the portable smartphone-based microscope (left) and a photograph of the display during imaging (right). (D) Top: Fluorescence enhancement histogram of the sandwich assay in buffer solution (light blue) and in serum (dark blue). Bottom: Binding yield obtained for the full sandwich assay with and without added DNA target. Figure reproduced from ref. 83 under a Creative Commons CC BY 4.0 license. |
Fluorescence detection has also been used for the imaging and counting of individual cells. Unlike brightfield microscopy, cell staining is a requirement for these measurements. Nuclear (i.e. DNA) stains are one of the most common methods for generating fluorescence contrast from cells. Examples include the use of SYTO16 for imaging (with174 and without479 ML analysis) of leukocytes extracted from human blood, and acridine staining for both total and differential white blood cell counts from blood samples (where the differential count used an R/G ratio in image analysis to distinguish between granulocytes and agranulocytes).480 Other fluorescent stains have included Calcofluor White M2R and Solophenyl Flavine 7GFE 500 for the selective staining of Nosema spores in honey bee midgut samples (LOD 5 × 105 spores per bee),481 Calcofluor White or Blankophor for proof-of-concept imaging of cultured dermatophytes,482 and a newly-synthesized dye for staining microplastic particles.97
Fluorescent immunolabeling is also a viable approach to cell detection with smartphone-based microscopy. A compact clip-on device was designed for smartphone microscopy via ultraviolet surface excitation, demonstrating two-color imaging of brain tissue slices using an Alexa Fluor 488-labeled antibody (green fluorescence) and propidium iodide nuclear stain (red fluorescence), and was also suitable for imaging a combination of DAPI (blue) and Rhodamine B (orange) staining of tissue (Fig. 33).483 A much larger 3D-printed benchtop microscope was used for imaging T. cruzi parasites stained with fluorescein-conjugated antibodies.484
![]() | ||
Fig. 33 Compact smartphone mounted microscope. (A) Design of the microscope attachment, which uses ultraviolet surface excitation. (B) Fluorescence image of a mouse kidney section stained with rhodamine B and DAPI dyes. Figure adapted from ref. 483 under a Creative Commons CC BY 4.0 license. |
As much as QDs have been superior labels versus dyes for smartphone imaging, nanoscale assemblies of many QDs have outperformed individual QDs. For example, immunoconjugates of both supra- and super-particle assemblies of QDs have been developed for cell detection and imaging with smartphone-based devices. In one study, assemblies of magnetic particles and QDs were used for immunomagnetic isolation and fluorescent labeling of a target breast cancer cell line, which was then imaged and counted in a simple plastic chamber slide (Fig. 34).84 Supra-QD assemblies with a silica NP scaffold have also been used for cell immunolabeling and imaging, providing an order of magnitude signal enhancement over conventional QDs with smartphone-based devices (Fig. 35A–D).485 All these materials also utilized tetrameric antibody complexes, which enabled spontaneous immunoconjugation with speed and efficiency suitable for chemistry-free on-demand preparation. The supra-QD materials were further adopted for immunofluorescent flow cytometry (Fig. 36).85 The high brightness of the materials provided the sensitivity necessary for the detection of cell-surface antigens with video rate imaging. A subsequent study showed that designer colors of supra-QD were able to be prepared from mixtures of R-, G-, and B-emitting QDs, with the potential for machine-learning-assisted detection of up to 14 colors with a smartphone camera (Fig. 35E).223 The next generation of labels are super-particle assemblies, which may provide even larger signal enhancements than supra-QDs (Fig. 35F).486
![]() | ||
Fig. 34 Magnetic NP-QD assemblies for cellular isolation, imaging and enumeration with a smartphone-based device. (A) Cartoon and TEM of cluster-like assemblies of iron oxide magnetic NPs and QDs (MNP@QD). (B) Exterior and interior photographs of the smartphone-based device used for cell imaging. The laser diode is powered by the smartphone battery. (C) Workflow for cell isolation. (D) Processed smartphone PL image of isolated target cells for counting. Figure adapted with permission from ref. 84 Copyright 2019 American Chemical Society. |
![]() | ||
Fig. 35 QD-based assemblies for cellular imaging and enumeration with smartphone-based devices. (A) Illustrations of supra-QD assemblies prepared with QDs that emitted primary colors of PL (RGB). Supra-QDs with composite colors of PL are prepared with mixtures of primary-color emitting QDs on the same silica NP scaffold. (B) TEM image of supra-QDs. (C) Rendering (left) of a smartphone-based device that uses blue light filtered from the smartphone flashlight to excite PL. With this device, the supra-QDs provide an order of magnitude increase in detection limit (right). (D) Smartphone-based device with laser-diode excitation of PL from labeled cells in a plastic chamber slide (left). Diagram of TAC-based immunolabeling of the cells (middle). Cells labeled by supra-QDs are far brighter in smartphone images than the cells labeled with QDs. (E) Smartphone images of cell-sized objects labeled with primary and composite colors of supra-QD (left). Each color maps out a trajectory in the RGB color space (right). (F) TEM image and diagram of super-QDs, which are recently developed as potentially brighter successor material to supra-QDs. The internal volume of super-QDs is made up of many individual QDs. Panels A and E are adapted with permission from ref. 223 Copyright 2023 American Chemical Society. Panels B–D are adapted with permission from ref. 485 Copyright 2020 American Chemical Society. Panel F is adapted with permission from ref. 486 Copyright 2023 American Chemical Society. |
![]() | ||
Fig. 36 Smartphone-based flow cytometry with immunofluorescent detection via supra-QDs. (A) Design and (B) photographs of the device. (C) Non-selective labeling of all cells (including non-target MDA-MB-231) with DAPI nuclear stain and immunolabeling of target cells (SK-BR3) with supra-QDs. An example of a zoomed smartphone image (left) is shown alongside validation of cell counting data (right). (D) Two-color immunolabeling of two cell lines (SK-BR3 and MDA-MB-231) using two different colors of supra-QD immunoconjugates. A zoomed smartphone image (left) is shown alongside flow cytometry data (right) for samples with a constant quantity of SK-BR3 cells, without and with MDA-MB-231 cells. Figure adapted from ref. 85 under a Creative Commons CC BY 4.0 license. |
Many of the devices used for cytometry and microscopy have been custom designs made via 3D printing with simple lens sets or conventional microscope objectives for magnification. Alternatively, there are several examples of smartphone imaging with commercially available microscope attachments for a smartphone. In each case, commercial dye-doped polymer nanoparticles were used for imaging assays of analytes such as cellular CD56 antigen expression,487 bacteria (non-selective),488 norovirus,172,489 ROR1-antigen-positive cancer cells,490 SARS-CoV-2,491 α-amanitin mushroom toxin,492 tetrahydrocannabinol,493 and B. burgdorferi antigen (the marker for Lyme disease).494 The assay format and details of the measurement and analysis varied between analytes, but generally involved a simple wax-patterned paper substrate and direct or indirect counting of cells labeled with the polymer nanoparticles, analyte-induced aggregates of the polymer nanoparticles, or particles bound in a test zone.
Time-gated imaging leverages luminophores with long PL lifetimes to insert a time delay between an excitation pulse and imaging. It differs from persistent luminescence in that the timescale is only microseconds to milliseconds, but has the same effect of eliminating background from excitation light and autofluorescence. Time-gated imaging has been implemented with smartphones using motor-driven choppers. One design used a single chopper, an optical switch component, and other electronics to enable excitation pulses and time-gated imaging, including proof-of-concept imaging of a Eu(III) chelate on a mouse tissue section (using the smartphone in tandem with an FPGA),495 and for detection of tetracycline directly in 50% milk samples (using an analog circuit).496 As a fully mechanical alternative, two coaxial and out-of-phase choppers, with timing controlled by the rotation speed, were used for time-gated imaging of cells non-specifically stained with a Tb(III) complex, and for proof-of-concept of a time-gated FRET sensor for a target DNA oligonucleotide (Fig. 37).150 The same study demonstrated that nanomolar and picomolar levels of detection of Tb(III) complexes and Eu(III)-doped NPs were possible in serum, and that quantitative two-color multiplexing of Tb(III) and Eu(III) complexes was possible using both the RGB color channels of the smartphone and two different chopper rotation speeds that exploited the difference in PL lifetime between the two complexes.
![]() | ||
Fig. 37 Smartphone-based time-gated imaging with a dual chopper system. (A) Design of the dual chopper and features that control (B) the timing of excitation pulses, the gate delay, and PL signal acquisition. (C and D) diagrams and photograph of the device abbreviations: exc = excitation; em = emission; LOS = line of sight. (E) Comparison of prompt and time-gated smartphone images of samples with short PL lifetimes (1, 2) and long PL lifetimes (4, 5), and without (3–6) and with (7–9) autofluorescent sample matrices. (F) Prompt and time-gated images of cells stained with a Tb(III) complex with an autofluorescent tissue phantom matrix. Figure adapted with permission from ref. 150 Copyright 2023 American Chemical Society. |
Non-mechanical approaches to time-gating with smartphones have been developed as well. One platform used an Arduino MCU to control the timing of excitation pulses and image acquisition with a smartphone camera.497 An extra layer of background suppression was implemented through the use of upconversion PL excited by a NIR laser. A mixture of UCNP-antibody conjugates (anti-EpCAM, anti-CD44, and anti-Trop2) were used to stratify clinical cervical cell samples into high-risk, low-risk, and benign categories. In another study, a virtual chopper design (i.e. no physical chopper) for time-gated imaging with a smartphone was reported.498 An LED was pulsed while a video was recorded by the phone, after which a convolutional NN reconstructed the video frames into an order that represented the PL decay of Eu(III) phosphors.
Smartphone fluorescence spectrometers are most likely to be useful in situations where spectral information is valuable, such as analyzing tissue autofluorescence, separating background autofluorescence from analytical signal, and multiplexing with more than three spectrally narrow emitters. Cuvette-based assays with a single dye, such as proof-of-concept detection of a miR-21 target as a potential biomarker for cardiovascular disease, are interesting but do not practically need a spectrometer.501 In contrast, a smartphone-based endoscope for analyzing the auto-fluorescence of cervical tissue did require spectral resolution. The endoscope design was capable of both reflectance-based absorption spectrometry and fluorescence spectrometry, incorporating beam splitters so that two light sources (a white LED and 405 nm laser diode) were able to utilize the same light paths to the sample and camera. Deep learning algorithms with spectral data were used to classify different grades of cervical cancer.506 A similar design measured diffuse reflectance spectra alongside fluorescence imaging of oral tissues (Fig. 38).215
![]() | ||
Fig. 38 Smartphone-based spectroscopic endoscope. (A) Diagram and photograph of the endoscope, which is capable of both diffuse reflectance spectroscopy and high-resolution fluorescence imaging. (B) Smartphone images of lamps for wavelength calibration. (C) Reflectance spectra from an in vivo study of healthy oral tissue (left) and corresponding fluorescence images (right). Abbreviations: BP, bandpass filter; CL, condenser lens; DBS, dichroic beam-splitter; EP, eyepiece; OBJ, objective lens. Figure adapted from ref. 215 under a Creative Commons CC BY 4.0 license. |
Many published reports represent proof of concept for smartphone-based CL detection, but have not yet simplified the CL assay procedure to a level that is optimal for non-laboratory settings, still requiring users to execute multiple wet chemical or wash steps. One approach to reducing steps has been the adoption of the LFIA format, which ideally reduces the assays to two steps: addition of sample to the sample pad and subsequent addition of a CL or BL reagent to the test line zone. Such LFIAs have been developed for the detection of SARS-CoV-2 with bis(2,4,6-trichlorophenyl) oxalate “glowstick” chemistry with dye-doped NPs,534 and luminol with a peroxidase enzyme535 or mimic.514 A CRISPR/Cas13a-coupled lateral flow nucleic acid assay has also been reported with a luminol system and chemiluminescence resonance energy transfer (CRET) to an AuNP.521
BL assays with smartphone detection have, to some degree, followed the same trends as CL assays. The most commonly utilized enzyme is the NanoLuc luciferase, which generates blue emission, usually from either furimazine or coelenterazine as the substrate. As with CL, smartphone-based devices are potentially as simple as a dark box. Analytes have included microRNA,536–538 thrombin (Fig. 39) and other protein biomarkers,539–542 pesticides,543 disinfectant,544 drugs,545,546 other small molecules,547,548 Hg2+ (aq) (Fig. 40) and other metal ions.549,550 Immuno-complexation and nucleic acid hybridization remain common mechanisms for selective detection, and there have been several instances of detection that leverage bioluminescence resonance energy transfer (BRET)536,539–541,547 and cells or bacteria encoded with reporter genes to express analyte-sensitive bioluminescent proteins.545,549,551,552 An LFIA for imidaclothiz (an insecticide) has also been reported with NanoLuc as a BL system.543
![]() | ||
Fig. 39 BRET-based detection via smartphone. (A) Binding of aptameric probes to thrombin triggers, via two kinetically trapped DNA hairpins (BH1, BH2), the assembly of a DNA-templated BRET construct with luciferase (nLZ-2) and green fluorescent protein (MGA-1). (B) Linear relationship between the G and B smartphone image channels and the thrombin concentration. (C) Smartphone image of the bioluminescent response to various concentrations of human thrombin. Adapted with permission from ref. 540 Copyright 2018 American Chemical Society. |
![]() | ||
Fig. 40 Smartphone-based device for a dual colorimetric and bioluminescent detection of Hg2+ (aq). Photographs of (A) the device and (B) the three-leaf test strip system. The test used a chromogenic reaction catalyzed by β-galactosidase and two bioluminescent bacterial strain reporters (E. coli and A. fisheri). (C) Brightfield (COL) and BL images of the test strip responses to Hg2+, Cd2+ and low pH. Adapted with permission from ref. 549 Copyright 2021 Elsevier B.V. |
Both BRET and engineered cells are strategies that avoid wash steps in assays and thus minimize user actions. Signaling in the BRET assay is generally a color change of the emission from blue to green, where tracking of the change in the B or G signal, or the G/B ratio, is useful for quantitation. Signaling with reporter-encoded cells is based on analyte-induced luciferase expression and more intense BL from higher analyte levels. Some of these systems use NanoLuc, whereas others use luciferases that generate green or red emission from their substrate. There are two consequences to the functional requirement for the cells to be alive: the assays must incorporate analyte-insensitive bioluminescent cells as viability controls, and the scope of possible field applications is more limited.
Similar to CL assays, efforts have been made to simplify assay procedures by drying reagents onto paper. For example, a chip was developed to contain spheroids encoded with green- and red-emitting luciferases.551 The green emission was a viability control and the red emission increased with the concentration of tumor necrosis factor (TNFα; LOD 0.2 ng mL−1). The assay had simple but separate steps for the addition of luciferase substrate. Another study developed a bioluminescent reporter-encoded E. coli system to detect mercuric ion (parts per billion LOD).549 The bacteria were pre-loaded on a paper layer on which sample was added, and luciferase substrate was pre-lyophilized on a second paper layer that was applied to the first layer at a defined time after sample addition. Similarly, for a BRET-based microRNA assay (LOD of 2 fM), dried reagents for rolling circle nucleic acid amplification and BRET sensing were split between two paper discs that were added sequentially with sample in a microplate well.536 In another case, a paper stack was designed to have two twisted-together threads sewn into one of the layers (Fig. 41).541 One thread contained dried-on luciferase substrate and the other thread contained dried-on BRET sensor, where the latter was a fusion of NanoLuc and mNeonGreen fluorescent protein with an epitope-containing linker to detect target antibody biomarkers (LODs from 2–15 nM). The addition of sample and hydration of the threads reconstituted and mixed the sensors and luciferase substrate.
![]() | ||
Fig. 41 Thread-based BRET detection of target antibodies to avoid user steps after the addition of sample. (A) Design of the threaded paper stack, with luciferase and its substrate dried on separate threads. (B) Assay workflow. (C) Plot of smartphone-measured luminescence hue versus analyte concentration. (D) Smartphone-acquired BL images for different concentrations of the anti-HIV antibody analyte. (E) Photographs of the smartphone-based imaging device. Figure adapted with permission from ref. 541 Copyright 2020 American Chemical Society. |
Although CL and BL methods are logical for the detection of analytes that are reactants or inhibitors of these mechanisms, the selection of CL or BL for many other assays is less intuitive. To date, we have not encountered a study with a head-to-head comparison of either CL or BL with PL. It is thus an open question as to whether the anticipated lower backgrounds of CL and BL methods ultimately provide better signal-to-background ratio than the anticipated greater signal of PL methods. The outcome of such a comparison will likely be very dependent on the nature of the sample and the fluorophore selection.
Examples of ECL detection with smartphones include proof-of-concept assays for glucose via a glucose oxidase-mediated ECL reaction with luminol and peroxide,553,554 an analogous assay for choline via choline oxidase,553 and an immunoassay for E. coli using the classic tris(2,2′-bipyridyl)ruthenium(II) and tripropylamine ECL reaction.555 These and other smartphone-based devices have utilized different strategies to apply potential without a bulky potentiostat: 1.5 V AA batteries,554 drawing energy from NFC,556 and drawing energy from the USB port of the phone.553,555
![]() | ||
Fig. 42 Wearable fluorescent sensor for the detection of Zn2+, Cl−, and Na+ (aq) in sweat. (A) Smartphone device and optics module for visualizing the microfluidic patch. Visualization of the patch under (B) ambient illumination and (C) blue light illumination. (D) The blue light is filtered from the phone flashlight (left) and the green emission is linear with respect to analyte concentration (right). Adapted with permission from ref. 40 Copyright (2018) Royal Society of Chemistry. |
Another motivation for adopting a microfluidic chip is facilitating isolation of an analyte. For example, a spiral microfluidic channel with a herringbone structure was adopted to improve influenza virus capture efficiency by antibodies immobilized on the channel walls.560 Subsequent steps completed a silver-enhanced colorimetric sandwich assay with AuNPs. In some cases, such as the detection of Schistosoma haematobium eggs in urine samples,561 channel dimensions can be tapered to trap large-sized analytes with dimensions greater than about 20 μm. A benefit of this approach is concentration of analyte in the defined imaging zone, but it does not provide molecular specificity. The immunocapture of cells (plus a wash step) within a microfluidic chip provides this specificity. For example, a microfluidic channel with antibody-conjugated pillars was used to assess CD64 expression on neutrophils (Fig. 43).173 With the effect of flow, cells with higher expression levels were captured earlier in the pillar channel, enabling both counting of the cells (via a fluorescent nuclear stain) and an estimate of the distribution of relative CD64 levels.
![]() | ||
Fig. 43 Isolation of neutrophils based on CD64 expression. (A) Schematic of the microfluidic chip and summary of the workflow for the analysis (top), and schematic and photograph of the chip (bottom). (B) Design and photograph of the smartphone-based imaging device. (C) Examples of smartphone fluorescence images of captured cells. High-expression results in cells being captured earlier in the chip (bottom image). The scale bars are 1 mm. (D) Correlation between flow cytometry measurements and smartphone measurements. Adapted from ref. 173 Copyright (2019) Royal Society of Chemistry. |
The above examples of single-channel microfluidic immunoassays are multi-step and therefore require multiple volumes (e.g. sample followed by washes and reagents or immunoconjugates) to be introduced to the chip by the user. Other assays have pseudo-automated multiple steps through multi-channel microfluidic chips and multiple syringe pumps. Examples include a colorimetric enzyme-linked assay for miRNA pre-extracted from serum,562 and an AuNP-based colorimetric assay for Salmonella.563 Alternatively, solutions for a colorimetric sandwich ELISA have been added in sequence, via micropipette, to microfluidic channels and discharged via centrifugal flow with a portable device.564 A low-tech approach reported for a multistep fluorogenic ELISA of Dengue fever NS1 antigen was self-priming siphon fluidics (Fig. 44).565 Capture antibodies were immobilized within capillaries, and separate reservoirs for the sequences of reagents and washes were needed for the assay. Each of these approaches still requires multiple user actions, which is sub-optimal, but gains precision versus the manual introduction of solutions.
![]() | ||
Fig. 44 Gravity-driven self-priming siphon microfluidics for fluorogenic ELISA-based detection of dengue fever NS1 antigen and quantification of anti-SARS-CoV-2 IgG in serum spiked samples. (A) Workflow for the assay. (B) Photograph of the siphon device with a microcapillary film (MCF) strip (top) and example of a smartphone-captured fluorescence image (bottom). (C) Detection of IgG anti-viral antibodies in positive and negative samples at various dilution factors. Figure adapted from ref. 565 Copyright 2021 American Chemical Society. This publication is licensed under CC-BY 4.0. |
Other microfluidic approaches have housed reagents on-chip. Examples of varying complexity include a PDMS chip with two reagent reservoirs, a mixing channel, and micromechanical actuation for chromogenic detection of gaseous formaldehyde;566 a five-stage and valved microfluidic chip with pre-loaded reagents for an immunomagnetic bead-based colorimetric ELISA;567 and colorimetric ELISA using an AI-controlled chip with a micropump and valve, and process monitoring via the smartphone camera to initiate conditional actions, such as bubble removal and starting and stopping filling of the assay chamber (Fig. 45).90
![]() | ||
Fig. 45 Automated colorimetric ELISA executed by an AI-controlled microfluidic chip with monitoring using the smartphone camera. (A) Rendering of the smartphone-based platform and app. (B) Diagrammatic representations of the fill states (left) and photographs of the device (right). Adapted with permission from ref. 90 Copyright 2022 American Chemical Society. |
Another technique that smartphone-based assays have borrowed from benchtop assays and general lab-on-a-chip development is magnetic capture. A few examples highlighted Sections 7.2, 7.4, and 7.6 have referred to immunomagnetic methods, which frequently use a fixed or actuated permanent magnet to hold analyte-linked magnetic particles in place for washing steps. One example not mentioned so far is an on-chip colorimetric ELISA for Zika virus antigen with a Arduino-controlled, motor-actuated magnet system.93 A more exotic particle trapping method that has been reported is contour-mode acoustic streaming tweezers, which enabled multiple sequential steps within a single channel for a microparticle-supported sandwich immunoassay with CL detection of PSA (LOD of 0.2 ng mL−1).513
Despite the greater number of proof-of-concept studies, there is good potential for simplification and utility of these assays beyond a lab. For example, an LFIA was developed for ochratoxin A in wine and coffee (LODs of 0.1–0.3 ng mL−1), where sample was injected into an analytical cartridge with the LFIA-ready membrane and a fluidic component that dispensed the required reagents via “button pushing” with in-cartridge reagent pouches and “switch flipping” with on-cartridge flow control valves (Fig. 46).528
![]() | ||
Fig. 46 LFIA-ready membrane in a cartridge with finger-actuated reagent pouches for the CL-based detection of ochratoxin A (OTA) in wine and coffee samples. (A) Schematic overview of LFIA analysis. Sample is loaded, transferred, and mixed with various reagents on-chip before being injected onto the LFIA strip. (B) Photographs of the physical device and chip. (C) Example of a smartphone-acquired CL image of the LFIA and a calibration plot for OTA obtained in wine and instant coffee. Adapted with permission from ref. 528 Copyright 2021 Elsevier B.V. |
![]() | ||
Fig. 47 Smartphone display-actuated optoelectrowetting droplet microfluidics for on-chip sample preparation and water quality detection. (A) Schematic overview of the digital microfluidic operations and (B) video frames showing these operations. (C) Smartphone-acquired fluorescent image of marine water sample showing target algae cells. The scale bar is 100 μm. Adapted from ref. 568 Copyright 2018 Royal Society of Chemistry. |
A subset of microfluidic approaches have only addressed nucleic acid amplification and detection. Examples include a chamber-based microfluidic chip for digital PCR with a portable device for thermocycling;94 digital droplet LAMP, using both channel-based droplet generation462,569 and a pump-free open droplet array;458 and a non-digital silicon microfluidic chip with multiple channels in which LAMP primers and a dsDNA-sensitive dye were pre-loaded.570 The silicon chip was paired with a portable smartphone-based device for heating and fluorescence detection of up to five different equine respiratory viruses (one genetic sequence per channel) from pre-processed horse nasal swab samples.570
A subsequent study bridged the gap between sample and detection by devising a microfluidic cartridge for processing whole blood for Zika virus detection (LOD of 270 copies per μL; Fig. 48).460 Reagent solutions for chemical lysis of the virus particles to release RNA, and for reverse transcription and isothermal amplification, were transported in multiple stages to different regions of the chip to execute the processing steps. The user manually rotated a built-in threaded screw syringe and actuated two “keys” to move sliding valves into the proper positions. The processed sample was ultimately transferred to a multichannel silicon microfluidic chip for LAMP and detection with a smartphone-based device.460 Another example was a PMDS microfluidic chip with integrated chitosan-modified capillaries to pre-concentrate RNA for PCR amplification and detection.461 The device had a Peltier chip and valves operated by an air-pump and a vacuum generator. In combination with negative pressure manually applied by a syringe draw, the valves enabled on-chip lysis, nucleic acid isolation, and PCR amplification. The device was relatively large and plugged into a mains socket. A third example of a user-driven two-stage approach combined a basket with a DNA extraction disc at the bottom, a block module with a wash chamber for DNA purification, a reaction chamber with a rotary valve for target DNA amplification via RPA, and a microfluidic channel with immobilized oligonucleotide probes for capture of amplified targets (Fig. 49).571 AuNPs and silver enhancement were used for labeling and colorimetric signal enhancement for detection of genes isolated from bacteria in milk samples and urine, human genes isolated from blood samples, and more. This example was also notable because it used heat generated by the smartphone to reach the 37 °C needed for amplification.
![]() | ||
Fig. 48 Point-of-care blood testing for Zika virus with smartphone-based detection. (A) Assay workflow with a multi-stage manually actuated microfluidic chip for sample processing and transfer to a detection cartridge for smartphone-based fluorescence imaging. (B) Smartphone images for in-cartridge detection of virus spiked into whole blood. Adapted from ref. 460 Copyright 2022 The Royal Society of Chemistry. |
![]() | ||
Fig. 49 Smartphone-based colorimetric detection of target DNA sequences using a pocket-sized basket-and-microfluidic system for sample preparation and assay execution with a foldable box. (A) Design of the device. (B) Assay workflow. (C) Photographs of the smartphone-based foldable-box device. (D) Illustration of how the smartphone is used to provide heat for DNA amplification. Figure adapted from ref. 571 under a Creative Commons CC BY 4.0 license. |
A single chip design for both isolation and amplification is also possible. One such example was a finger-actuated microfluidic chip with four buttons, each of which was pushed repeatedly by the user to dispense and flow buffers and reagents through microfluidic channels.572 In this manner, and with assistance from an external magnet, the chip executed an immunomagnetic isolation of a pathogenic bacterium, a nucleic acid extraction and purification with a second type of magnetic nanoparticle, and on-chip amplification for detection with a smartphone.
![]() | ||
Fig. 50 Wearable μPAD for the analysis of sweat biomarkers: uric acid, glucose, lactate and pH. (A) Design of the μPAD. The NP detection region is highlighted. (B) After sweat exposure, a color change is visualized. (C) Calibration curves (based on HSV color saturation (S) or a B/G channel ratio) for the analytes from smartphone imaging of the μPAD. Adapted with permission from ref. 573 Copyright 2023 Wiley-VCH GmbH. |
Other μPADs have sought to derive function beyond sample distribution. For example, a paper-based pump-free rapid mixer design was applied to the colorimetric detection of organo-phosphate pesticide.574 Multiple assays have also extended the paper channel beyond the test zone to enable on-PAD washing steps: the fluorimetric detection of aqueous metal ions (Cd2+, As3+, Pb2+, Hg2+) via DNA-based probes (e.g. aptamers, DNAzyme, thymine-rich oligonucleotide);575 the detection of a pesticide via a fluorescence recovery mechanism with dye-labeled aptamer;576 and magnetic-based ELISA for a malaria biomarker, Plasmodium falciparum lactate dehydrogenase.577 More sophisticated multi-step assay capability has been achieved through a μPAD that incorporates a mechanically actuated paper-based rotary valve system to execute a colorimetric ELISA for the β-amyloid peptide 1–42 biomarker of Alzheimer's disease (Fig. 51).96 Reagents were pre-loaded on the μPAD, such that the user added the sample to the test zone and buffer to the inlet zone, and the rotary motion separated binding, washing, and color development steps. Manual actuation has been utilized for a multi-step assay, such as in the case of determining serum phosphate levels from a single drop of whole blood using malachite green as a colorimetric indicator.578 Serum was isolated from blood cells via flow through a suitable membrane, and a mechanical mechanism dipped a serum-impregnated collection pad into reagent solution to develop a colorimetric signal.
![]() | ||
Fig. 51 Automated platform for detection of Alzheimer's disease biomarkers. (A) Design of μPAD platform (left) and the smartphone-based device (right). (B) Workflow of the colorimetric ELISA assay. (C) Calibration curve in terms of grayscale intensity versus Aβ 1–42 concentration (top) and comparison of the result to a traditional analytical method for artificial plasma samples (bottom). Figure adapted with permission from ref. 96 Copyright 2024 Elsevier B.V. All rights reserved. |
Foldable μPADs have also been a means of executing multiple assay steps in a user-friendly format. In one example, sputum samples that were either positive or negative for infection by Pseudomonas aeruginosa were liquified with a bacterial catalase and hydrogen peroxide, and the liquid sample was transferred to the μPAD.579 The μPAD was folded to bring pre-loaded AuNP-antibody conjugates into contact with the sample, the sample spot was washed, and the residual color of bound AuNPs provided a signal for the detected bacteria. A method for the detection of viral RNA was based on the release of Ag+ (aq) ions from an oligonucleotide probe upon hybridization with target RNA, where the Ag+ inhibited urease and prevented a pH and color change from turnover of its substrate in the presence a phenol red indicator dye (Fig. 52).580 Sample was added to the μPAD, which was folded in sequence to separate the steps of binding with probe and the chromogenic reaction. Different regions on the device were used for multiplexed screening for MERS-CoV, SARS-CoV, and SARS-CoV-2. Similarly, another study pre-dried reagents for CL-based glucose detection (LOD 10 μM) onto a foldable μPAD. This format kept the reagents separated until needed for the assay, which reduced the required user steps to only pipetting to add sample and standard solution, a fold, and adding transport buffer.531
![]() | ||
Fig. 52 Origami-based μPAD for assaying and multiplexed screening of SARS-CoV-2 variants with single-nucleotide resolution. (A and B) Design and workflow for the assay. (C) Design of the smartphone-based imaging device. (D) Examples of smartphone-acquired images and green-area-ratio values as the metric for analysis. Each dot on the device corresponds to a different targeted gene and mutation. Figure adapted with permission from ref. 580 Copyright 2022, the author(s), under exclusive license to Springer Nature Limited. |
An interesting capability that has emerged with smartphone-based detection using paper test strips is quantitation by distance measurements. One report took advantage of the change in surface tension from immunoagglutination to detect SARS-CoV-2 (LOD 1–10 fg mL−1) nucleocapsid via a change in the capillary flow velocity in a patterned paper channel, where flow was tracked using dye-doped polystyrene NPs.581 Another report measured IL2-positive and total natural killer cell concentrations in buffy coat blood samples via their migration distance along a paper channel. The binding of fluorescent polymer NP-antibody conjugates slowed the cell migration to a degree proportional to their CD56 level, such that the fluorescence intensity profile along the channel reflected the relative distribution of CD56 expression levels in the sample.487 Other distance-based assays have been based on analyte depletion rather than velocity. In one case, an indicator dye was deposited in a paper channel in the pattern of a repeating QR code. The number of QR codes that appeared in a fully readable form along the length of the channel determined whether the analyte (Cu2+) concentration was low, medium, or high within the dynamic range of the assay (0.4–3.2 mM).582 In another case, a rapid blood grouping analysis was done through depletion of the relevant red blood cell type through immunocapture within a spoke pattern of paper channels with colorimetric contrast augmented by bromocresol green (Fig. 53).161 The layout of the μPAD was such that result was readable as a QR code via the smartphone camera. Distance measurements are not unique to paper devices, as demonstrated by smartphone readout of the radial travel of DNA motor system immobilized on 5 μm beads across a DNA modified gold chip.583 This format was able to detect SARS-CoV-2 spiked in artificial saliva and exhaled breath condensate with a sensitivity of 1000 copies per mL within 15 minutes.
![]() | ||
Fig. 53 Antibody-based blood typing on a μPAD via QR code patterns. (A) Design and workflow of the assay. (B) Different assay formats for application to different blood-typing requirements. Reference color blocks and position detection boxes ensure consistency in interpretation. (C) Bromocresol green dyes provides optical contrast for smartphone imaging. (D) Smartphone images of cards (left) and 3D plots from RGB analysis (right) for two samples of two different blood types. Adapted with permission from ref. 161 Copyright 2021 American Chemical Society. |
The above considerations provide many opportunities for innovation in stripping down laboratory assay methods to their bare minimum and enabling shortcuts through advanced optical materials, selective recognition agents, and clever optical designs. Examples include the development of chromogenic and fluorogenic reagents that have sufficient selectivity and efficiency to react with analyte in crude samples, and the development of FRET probes with fluorescent acceptors. The nanometer-scale distance dependence of FRET enables mix-and-measure protocols and ratiometric detection that will minimize the impact of inconsistent dilution and excitation intensity.588 FRET probes based on NP materials that have high brightness,589 exhibit upconversion PL,590 and support time-gated measurements591 will also mitigate challenges from sample autofluorescence. Although smartphone cameras do not support near-IR detection, the red RGB camera channel can be leveraged with similar effectiveness, and chips with integrated waveguides and short optical path lengths will facilitate optical interrogation of non-transparent samples. For crude samples that start opaque, sample chips that integrate membranes and other porous materials will ideally provide the cleanup needed for optical detection. There is also great potential in building reference markers into test strips and chips to enable compensation of variation in sample optical properties and transfer complexity from hardware to software.
Conventionally, the reuse of chips has been eschewed in point-of-need testing due to the less favorable business economics and obstacles such as sample carryover, replenishment of pre-loaded reagents, and deteriorating performance with each cycle of use. Two factors may encourage reconsideration of this aversion: the inability of disposable paper-based microfluidic devices to support the full scope of technical capabilities that will be needed to translate many assays from the bench to the field; and a future focus on sustainability and the different economics of equitable access, particularly in the case of technologies that offer high-value capability that is built on non-abundant, expensive, and non-green materials. In this scenario, the reuse of chips will require fast and reliable cleaning and decontamination using reagents that pose a minimal hazard to people and the environment. It is a prime opportunity for open chip configurations of (opto)electrowetting for digital microfluidics, both in terms of the disparate capabilities versus paper microfluidics and the potential to be wiped clean and sterile.
One possible strategy is to shift the onus of calibration to the production process. Such factory calibration will require reproducible manufacturing and persistence over long storage periods. It also requires excellent consistency between the readout devices used by the factory and user, and a means of compensating for variation in sample optical properties will be useful for some authentic applications. Detection based on ratio between two colors of luminescence, or on ratio of luminescence intensity between test and reference zones, is expected to provide the best tolerance of variation in sample optical properties and between readout devices. Detection based on changes from one brightfield color to another should also have more tolerance of device variability than detection that is solely based on an absolute intensity of luminescence or the tint of a color.
Digital assays,592–594 which are an emerging trend in commercial diagnostics and in the general analytical literature, are an exciting alternative strategy. These assays count analyte molecules and are thus quantitative without requiring user calibration. Most digital assays are based on fluorescence and utilize either enzymatic amplification with fluorogenic reactions or the sophisticated and expensive hardware necessary for single-molecule detection. Enzymatic amplification adds reagents to assays with the potential challenges of cold storage, limited shelf life, special digitization chips, extra assay steps, and the associated additional costs. The typical hardware for single-molecule detection is the opposite of what is needed for a portable low-cost device. Here, there are opportunities for innovation in developing ultrabright fluorescent materials and optical configurations that will enable enzyme-free single-molecule detection with a smartphone-based device. Studies have demonstrated that such capability is a viable possibility for single fluorescent NPs and QDs,86 multi-dye DNA origami,29 and single dyes.83 Remaining needs are simplification of hardware and methodology, and approaches to sampling and counting that produces results with suitable accuracy and precision.
Single-molecule detection is also not a strict necessity for quantitation by counting. Assay formats that have highly efficient mass transport of analyte to an interface with capture probes (e.g. microfluidic channels, microporous materials) are capable of depleting analyte from a flowing sample solution. A series of discrete clusters of capture probes along the direction of flow are then able to report on the quantity of analyte via the number of these clusters that have detectable luminescence or exhibit a color change. There are a myriad of unrealized opportunities for adapting binding assays to this quantitative format.
The cost of the test substrate, chips, cartridges, and reagents must also be affordable. For some contexts, an affordable cost will be on the order of dollars per test; for other contexts, it will be on the order of cents per test. The simplification of test platforms is one opportunity for minimizing cost per test. A complete set of reagents freeze-dried or tableted595,596 into a simple disposable tube or a single-chamber chip will be more economical than multiple reagents loaded at different sites in a multichannel or multi-chamber chip. Affinity and capture agents that can self-conjugate with optical materials and interfaces, with plug-and-play substitution of different agents for different analytes, will minimize preparatory steps and enable multiple test kits to be produced using the same workflow, both reducing costs. Tetrameric antibody complexes (TACs) with fluorescent NPs such as QDs,597 Pdots,598 and QD assemblies485,486 are an example that approaches this ideal.
A reality of the need for low cost and simple operation is that some assays and applications will simply not be practically adaptable to a smartphone-integrated device for the foreseeable future. It is here that adaption of laboratory methods to portable detection is not sufficient, and that completely new methods of analysis must be developed for some analytes and samples.
Another frequent concern is data security and privacy. Of course, challenges with the security of health data already exist with computer systems and are managed. The main difference with the smartphone is that its small size makes it easier to steal or lose. Fortunately, smartphones already support security features (e.g. data encryption, device tracking, remote memory wiping). At present, security patches and OS upgrades for devices are at the discretion of the manufacturer: Apple guarantees a minimum of five years, and support for Android phones varies between 2–7 years depending on the manufacturer. Given the trend of increasing consumer concern about privacy, we speculate that the industry (and legislation) will continually take steps to enhance data security. Ultimately, regulatory approval is far more likely to be a barrier to the adoption of smartphone-based devices than security and privacy concerns.
For brevity, to address the question of regulatory approval, the discussion will be limited to the context of in vitro diagnostic tests for health applications. We also note that the regulatory hurdle is only an unknown for devices that integrate smartphones. Linked and dongle devices bypass this challenge because the smartphone does not generate the analytical data: there is a single design of a bespoke device to be approved.
So, for a smartphone-integrated device, what are some of the possible pathways to approval?
One pathway starts from the premise that the users for smartphone-integrated diagnostic devices will be professionals and not an arbitrary consumer. For example, a primary care physician or nurse in a rural community will adopt a smartphone-based device to enable local diagnostic capability that would otherwise only be available in a clinical lab in a city hundreds of kilometers away. The professional will also use a smartphone dedicated to diagnostic use and not their personal smartphone. In this scenario, the device can be distributed with one (or a few) specific model(s) of smartphone, providing consistency that will facilitate approval. The caveat is that the approval process may need to be repeated at multi-year intervals to enable upgrades of smartphone technology.
Other potential pathways to approval are predicated on recognition of the positive societal and global impacts of more accessible diagnostics and equitable quality of health care. For example, regulatory agencies might grant limited approval that would enable smartphone-based diagnostic testing in rural and remote communities without a clinical lab, but require that more rigorous clinical lab testing is done prior to medical interventions in the event of a disease indication. Even this limited approval would enhance health care in such communities. Likewise, with the trend of multiple camera modules per smartphone and growing interest in ethical and socially responsible smartphone technology (e.g. Fairphone), manufacturers might become inclined (or legislated) to include one diagnostic camera module per smartphone, which would have invariant specifications and data processing between manufacturers and models. This step would provide the consistency to facilitate regulatory approval, and the engineering challenge of accommodating different dimensions of phones is surmountable. Another scenario is that a new pandemic motivates an emergency adoption of smartphone-based methods as a rapidly deployable means of global surveillance, which then opens the door to developing a framework for approval of non-emergency use of the technology. Certainly, the two proactive scenarios are more appealing than this reactive scenario.
Another possible pathway to regulatory approval—and one over which researchers have the most control—is the development of smart tests and smart apps that identify and correct for sources of variability to yield consistent quantitative results (or declare an invalid test) regardless of smartphone model, device platform, and sample source.
Among the next challenges and opportunities in developing smartphones as analytical tools are the elimination of sample processing for end users, achieving quantitative capability without the need for user-driven calibration, building multitasking devices, and engineering tolerance for operational variability between authentic samples, users, and devices without loss of accuracy and precision. If the field is able to address these challenges, then smartphone-based molecular analyses will be more than a passing fad in research and development and will instead evolve to be a bona fide tool in society and industry. Collectively, the design of digital assays and ultrabright materials, embedding smart features in test platforms and device modules, and quality-ensuring ML- and AI-powered software are a prospective route to regulatory approvals and the realization of smartphones as devices that democratize chemical and biological analysis with global benefits.
3D | Three-dimensional |
A-GPS | Assisted (or augmented) global positioning system |
ABS | Acrylonitrile butadiene styrene |
AFB1 | Aflatoxin B1 |
AgNP | Silver nanoparticle |
AI | Artificial intelligence |
ALS | Ambient light sensor |
API | Application programming interface |
AuNP | Gold nanoparticle |
AuNR | Gold nanorod |
B | Blue |
BCG | Bromocresol green |
BL | Bioluminescence |
BODIPY | 4,4-Difluoro-4-bora-3a,4a-diaza-s-indacene |
BPA | Bisphenol A |
BRET | Bioluminescence resonance energy transfer |
Cas | CRISPR-associated protein |
CD | Compact disk |
CFA | Color filter array |
CFU | Colony-forming unit |
CIE | International Commission on Illumination |
CK-MB | Creatine kinase-MB |
CL | Chemiluminescence |
CMOS | Complimentary metal-oxide-semiconductor |
CRET | Chemiluminescence resonance energy transfer |
CRISPR | Clustered regularly interspaced short palindromic repeats |
Cy5 | Cyanine 5 |
DAB | 3,3′-Diaminobenzidine |
DAPI | 4′,6-Diamidino-2-phenylindole |
DC | Direct current |
DLP | Digital light processing |
DNA | Deoxyribonucleic acid |
DNG | Digital negative |
dsDNA | Double-stranded deoxyribonucleic acid |
DTNB | 5,5′-Dithiobis(2-nitrobenzoic acid) |
DVD | Digital versatile disk |
ECL | Electrochemiluminescence |
ELISA | Enzyme-linked immunosorbent assay |
EphA2 | Ephrin type-A receptor 2 |
FDM | Fused deposition modelling |
FFF | Fused filament fabrication |
FLFIA | Fluorescence lateral flow immunoassay |
FPGA | Field programmable gate array |
FPS | Frames per second |
FRET | Förster resonance energy transfer |
FWHM | Full width at half maximum |
G | Green |
GDP | Gross domestic product |
GPIO | General-purpose input/output |
GPS | Global positioning system |
GUD | Beta-D-glucuronidase |
H | Hue |
HBV | Hepatitis B virus |
HCA | Hierarchical cluster analysis |
HCV | Hepatitis C virus |
HEIC | High efficiency image container |
HiLo | Hybrid illumination |
HIV | Human immunodeficiency virus |
HPTS | 8-Hydroxypyrene-1,3,6-trisulfonic acid |
HPV | Human papillomavirus |
HRP | Horseradish peroxidase |
HSB | Hue-saturation-brightness |
HSV | Hue-saturation-value |
IDE | Integrated development environment |
IR | Infrared |
ISO | International Organization for Standardization |
JPEG | Joint Photographic Experts Group |
LAMP | Loop-mediated isothermal amplification |
LCD | Liquid crystal display |
LDA | Linear discriminant analysis |
LED | Light-emitting diode |
LFA | Lateral flow assay |
LFIA | Lateral flow immunosorbent assay |
LiDAR | Light detection and ranging |
LLC | Luminescent lanthanide complex |
LM | Latex microsphere |
LOC | Lab on a chip |
LOD | Limit of detection |
LTE | Long term evolution |
MCU | Microcontroller unit |
MERS-CoV | Middle East respiratory syndrome coronavirus |
miRNA | Micro ribonucleic acid |
ML | Machine learning |
MOF | Metal–organic framework |
MSLA | Masked stereolithography |
NADH | Nicotinamide adenine dinucleotide |
NC | Nitrocellulose |
NFC | Near-field communication |
NIR | Near-infrared |
NN | Neural network |
NP | Nanoparticle |
NR | Nanorod |
OLED | Organic light-emitting diode |
OS | Operating system |
PCA | Principal component analysis |
PCR | Polymerase chain reaction |
PDMS | Polydimethylsiloxane |
Pdots | Semiconducting polymer dots |
PES | Polyethersulfone |
PL | Photoluminescence |
PLA | Polylactic acid |
PLNP | Persistent-luminescent nanoparticle |
PMMA | Polymethyl methacrylate |
PSA | Prostate-specific antigen |
PTSA | 1,3,6,8-Pyrenetetrasulfonic acid |
QD | Quantum dot |
qPCR | Quantitative polymerase chain reaction |
QR | Quick response |
R | Red |
RAM | Random-access memory |
RCA | Rolling circle amplification |
RFLFIA | Ratiometric fluorescence lateral flow immunoassay |
RGB | Red, green, blue |
RNA | Ribonucleic acid |
ROI | Region of interest |
ROX | Carboxyrhodamine |
RPA | Recombinase polymerase amplification |
rRNA | Ribosomal ribonucleic acid |
RT | Reverse transcription |
RTF-EXPAR | Reverse transcription-free exponential amplification reaction |
S | Saturation |
SARS-CoV-2 | Severe acute respiratory syndrome coronavirus 2 |
SBC | Single-board computer |
SDK | Software development kit |
SLA | Stereolithography |
SPR | Surface plasmon resonance |
SVM | Support vector machine |
TAC | Tetrameric antibody complex |
TAMRA | Carboxytetramethylrhodamine |
TMB | 3,3′,5,5′-Tetramethylbenzidine |
TNFα | Tumor necrosis factor |
ToF | Time-of-flight |
TRRS | Tip-ring ring-sleeve |
TTA | Triplet–triplet annihilation |
UCNP | Upconversion nanoparticle |
USB | Universal serial bus |
USB-C | Universal serial bus type-C |
USD | United states dollar |
UV | Ultraviolet |
UVB | Ultraviolet B |
UVC | Ultraviolet C |
V | Value |
W | White |
Y | Yellow |
ZIF | Zeolitic imidazolate framework |
μPAD | Micro paper analytical device |
Footnotes |
† Electronic supplementary information (ESI) available. See DOI: https://doi.org/10.1039/d4lc00966e |
‡ These authors contributed equally. |
This journal is © The Royal Society of Chemistry 2025 |