This protocol describes the implementation of an asymmetric-detection time-stretch optical microscopy system for single-cell imaging in ultrafast microfluidic flow and its applications in imaging flow cytometry.
Scaling the number of measurable parameters, which allows for multidimensional data analysis and thus higher-confidence statistical results, has been the main trend in the advanced development of flow cytometry. Notably, adding high-resolution imaging capabilities allows for the complex morphological analysis of cellular/sub-cellular structures. This is not possible with standard flow cytometers. However, it is valuable for advancing our knowledge of cellular functions and can benefit life science research, clinical diagnostics, and environmental monitoring. Incorporating imaging capabilities into flow cytometry compromises the assay throughput, primarily due to the limitations on speed and sensitivity in the camera technologies. To overcome this speed or throughput challenge facing imaging flow cytometry while preserving the image quality, asymmetric-detection time-stretch optical microscopy (ATOM) has been demonstrated to enable high-contrast, single-cell imaging with sub-cellular resolution, at an imaging throughput as high as 100,000 cells/s. Based on the imaging concept of conventional time-stretch imaging, which relies on all-optical image encoding and retrieval through the use of ultrafast broadband laser pulses, ATOM further advances imaging performance by enhancing the image contrast of unlabeled/unstained cells. This is achieved by accessing the phase-gradient information of the cells, which is spectrally encoded into single-shot broadband pulses. Hence, ATOM is particularly advantageous in high-throughput measurements of single-cell morphology and texture – information indicative of cell types, states, and even functions. Ultimately, this could become a powerful imaging flow cytometry platform for the biophysical phenotyping of cells, complementing the current state-of-the-art biochemical-marker-based cellular assay. This work describes a protocol to establish the key modules of an ATOM system (from optical frontend to data processing and visualization backend), as well as the workflow of imaging flow cytometry based on ATOM, using human cells and micro-algae as the examples.
Optical imaging presents a powerful tool and cell-based assay to (almost) non-invasively visualize the detailed spatial distribution of many cellular/subcellular components, thus uncovering a multitude of morphological, biophysical, and biomolecular signatures of cells. However, this ability to extract high-content information from single cells has generally been compromised when an enormous and heterogeneous population of cells had to be investigated. This marks a common trade-off in cell-based assays between measurement throughput and content. A notable example is that adding imaging capability to flow cytometry has resulted in a down-scaling of throughput by at least 1-2 orders of magnitude compared to that of the classical non-imaging flow cytometers. Although it could offer complex morphological single-cell analysis that is not possible with standard flow cytometers1, imaging flow cytometry generally lacks sufficient throughput to identify cellular heterogeneity with high statistical confidence. This is necessary for new discoveries in biology and for gaining an understanding of the pathogenesis of diseases. The key technical challenge lies in the inherent speed limit imposed by the common optical imaging strategies: laser-beam scanning, (e.g., by galvanometric mirrors), and/or image sensors (e.g., charge-coupled device (CCD) and complementary metal-oxide semiconductor (CMOS)). The laser scanning speed is intrinsically restricted by the mechanical inertia of the scanning mirrors, whereas the frame rate of CCD or CMOS is limited by the fundamental trade-off between imaging speed and sensitivity (i.e., increasing the frame rate leads to reduced signal detection sensitivity, and vice versa).
Based on an all-optical, ultrafast image-encoding mechanism, optical time-stretch imaging has been demonstrated as an attractive platform for high-throughput imaging flow cytometers, without need of the conventional image sensors or mechanical laser scanning2,3. Detailed descriptions of the working principle of time-stretch imaging can be found in references4,5,6,7. In brief, it consists of two interchangeable mapping steps: (i) spectral encoding (wavelength-space mapping), in which the spatial coordinates of the imaged specimen are mapped to different wavelengths across the spectrum of the light-pulsed beam8,9, and (ii) a dispersive Fourier transformation (wavelength-time mapping)9, in which the wavelength components of individual laser pulses are transformed (stretched) via group velocity dispersion (GVD) into temporal (wavelength-swept) waveforms (Figure 1). An important feature of time-stretch imaging is optical amplification, which plays a critical role in combatting the loss of sensitivity due to ultrafast photodetection and GVD loss, thus enhancing the image signal-to-noise ratio (SNR) without being contaminated by the photodetector noise9. Since each laser pulse encodes a line-scan of the imaged specimen, which is orthogonal to the unidirectional flow of the cells, an effective line-scan rate is determined by the laser repetition rate, which is typically beyond 10 MHz. This ultrafast operation enables blur-free, single-cell image capture at a throughput of 10,000-100,000 cells/s (i.e., 10-100 times higher than conventional imaging flow cytometry). As a result, time-stretch imaging could find unique applications in high-throughput, single-cell, image-based screening, especially when there is a need for identifying unknown heterogeneity or rare/aberrant cells within a sizable population (thousands to millions of cells), such as rare cancer cell screening10 or micro-algae classification11.
Time-stretch imaging predominantly relies on bright-field (BF) image capture, from which the image contrast is generated through light scattering and absorption from the cells2,3,9,10,11. Such label-free, single-cell imaging capabilities could bypass the detrimental effects associated with the fluorescent labels, such as cytotoxicity and photobleaching, and yet provide valuable information for single-cell analysis based on the cellular and sub-cellular texture and morphology. These label-free parameters are proven to be effective for the deep image classification of cells, especially when an enormous cell population is available11,12. However, in many occasions, BF imaging fails to provide sufficient contrast to reveal the detailed morphology of the label-free transparent cells. Different label-free, phase-contrast, time-stretch imaging modalities have been developed for enhancing the imaging contrast at ultrafast frame rates13,14,15. Among these techniques, asymmetric-detection time-stretch optical microscopy (ATOM) was developed to reveal the phase-gradient (differential-interference-contrast-(DIC)-like) contrast based on a concept similar to Schlieren photography, enabling the label-free, high-contrast imaging of single cells at an ultrahigh microfluidic speed (up to 10 m/s)16. This effect can be readily generated through oblique detection or illumination by partially blocking the image-encoded beam path or tilting the beam before photodetection. Another advantage of ATOM is its ability to simultaneously acquire two phase-gradient contrasts along opposite orientations. Intensity subtraction and summation of two opposite-contrast images yield the differential phase-gradient contrast and the absorption contrast, respectively, from the same line-scan. This work presents a detailed protocol describing the implementation of ATOM, including the establishment of the optical setup, the sample preparation, and the data acquisition and visualization. Specifically, this work demonstrates the ATOM operation with single-cell imaging of human blood cells, cancer cells, and phytoplankton (microalgae). This highlights the applicability of ATOM to imaging flow cytometry, not only in the biomedical arena, but also in marine and biofuel research17,18.
1. Sample Preparation
2. ATOM System Setup
Figure 1: Schematic of an ATOM System. A broadband pulsed laser is employed to deliver ultrafast pulses to (a) a time-stretch module and (b) an in-line optical amplifier module. The time-stretch module generates a train of temporal waveforms, each of which is the replica of the wavelength spectrum of the laser source, (i.e., wavelength-to-time mapping). The amplifier module is used to for pulse-stretching (dispersive) loss compensation. The stretched pulse is then (c) spatially dispersed by a diffraction grating, forming a 1D spectral shower illumination in which individual wavelength components are relayed by a relay lens pair and focused by the objective lens onto different positions on the flowing cell inside the (d) microfluidic chip. This is the process of spectral-encoding. The spectrally encoded light will again pass the cell through another objective lens and a mirror, returning to the diffraction grating and recombining as a spatially undispersed pulsed beam. This image-encoded pulsed beam is then (e) split into two paths, such that both beams are partially blocked with (f) the knife edge, but from opposite directions, before being coupled into the fibers. These two beams represent the two (opposite) encoded phase-gradient contrasts of the final image. For the simultaneous detection of both signal contrasts, one of the signals undergoes (g) a time-delay line, such that the two signals are multiplexed (interleaved) in time. A high-speed photodetector and real-time oscilloscope are used for data acquisition. Please click here to view a larger version of this figure.
3. Experimental Procedures
4. Data Acquisition
5. Backend Processing
Figure 2: Reconstruction of ATOM Images from the Line-scan Time Trace. To reconstruct the ATOM images with the absorption contrast and differential (enhanced) phase-gradient contrast, two sets of time-stretched pulses (see the purple and green pulses) are extracted from (a) the time-multiplexed temporal waveform trace and are then digitally segmented and stacked to form (b) two 2D images showing the two opposite phase-gradient contrasts. Note that a shearing operation is needed to form (c) the distortion-free images by compensating for the sub-index shift due to the round-off error in the laser repetition rate estimation. By subtracting the (d) raw line-scan from the spectral intensity envelope of the laser source, the background of the images can be removed. (g) An absorption contrast image can be obtained by a pixel-by-pixel intensity summation of images (e) and (f), whereas (h) a differential phase-gradient contrast image can be obtained from the subtraction of images (e) and (f). Please click here to view a larger version of this figure.
This work illustrates two single-cell imaging demonstrations by ATOM: one with mammalian cells (human peripheral blood mononuclear cells (PBMC) and breast cancer cells (MCF-7)) and another with phytoplanktons (Scenedesmus and Chlamydomonas). The first experiment was motivated by the growing interest in liquid biopsy for the detection, enumeration, and characterization of circulating tumor cells (CTCs) in the blood23. The ability to measure CTCs disseminated from primary tumor sites to the blood stream allows for the examination of metastatic cancer progression24,25. However, challenges exist in CTC analysis: (i) the CTC count is significantly lower than the exorbitant amount of blood cells in whole blood. Current methods of identifying and recovering the CTCs mostly involve cell enrichment and separation steps26,27,28. However, the contaminating background from blood cells and/or the viability of the enriched CTCs remain a concern for subsequent molecular analysis (e.g., RNA sequencing)29. (ii) CTCs are highly heterogeneous in terms of both biophysical and biomolecular signatures, limiting the efficiency of the CTC enrichment and detection. To this end, label-free imaging flow cytometry with a high imaging throughput is an appealing tool that allows for the direct imaging and identification of CTCs within an enormous population of blood cells, minimizing or even bypassing the enrichment steps.
The second experiment is particularly relevant to large-scale phytoplankton characterization, which can impact advances in environmental sciences (e.g., the detection of harmful algal bloom (HAB) species29 and the identification of microalgal species as renewable biodiesel sources)17. Enabled by ATOM, the capability of high-throughput and high-contrast single-cell imaging of phytoplankton could be valuable to reveal the complex heterogeneity in size, texture, and morphology across different genus and species.
Figure 3 shows images of mammalian cells, MCF-7 and PBMC (flowing at a speed of ~10 m/s), as well as microalgae, Scenedesmus and Chlamydomonas (flowing at a speed of ~2 m/s), captured by ATOM. In all four cases, the two opposite phase-gradient contrasts were obtained by the two time-multiplexed, asymmetrically detected signals (described in step 2.3). They both exhibit a pseudo-three-dimensional appearance, resembling the DIC images, each of which shows two opposite shadowing orientations (columns 1 and 2 in Figure 3a-d). Evaluating the pixel-wise intensity sum and difference of these two opposite-contrast ATOM images, it was possible to simultaneously obtain two additional ATOM contrasts (i.e., the absorption-only and enhanced differential phase-gradient contrasts; columns 3 and 4 in Figure 3a-d). Note that not only can label-free ATOM reveal the blur-free single-cell images, but also characterize cellular structures with high contrast. Notably, the vacuoles, pyrenoid, and flagella in the micro-algae can be clearly visualized in Figure 3. This imaging attribute critically enables the extraction of a rich set of identifiers derived from the intrinsic cellular and subcellular textures/morphologies for automated image-based classification.
This work demonstrates that biophysical properties, such as cell circularity and cell size, can be used for the classification of MCF-7 and PBMC. Note that two clusters are observed in the MCF-7 specimen. The availability of high-contrast images for all data points allow us to scrutinize that one of the clusters corresponds to fragments/debris (Figure 4a). A similar classification between two species of phytoplankton based on ATOM images was also performed. Here, the classification results are presented in a form of a 2D scatter plot visualized by the customized user interface (Figure 4). Each annotated data point in the scatter plot, corresponding to each cell, can be further explored with different parameters derived from ATOM. The corresponding ATOM image can also be interactively displayed directly on the plot. Manual gating is also supported in this visualization interface to facilitate further classification and analysis.
Figure 3: ATOM Image Galley of Micro-algae and Mammalian Cells at an Ultrafast Flowing Speed (~2-10 m/s). (a) Scenedesmus; (b) Chlamydomonas; (c) breast cancer cells, MCF-7; and (d) human PBMC. The Scenedesmus and Chlamydomonas are flowed at ~2 m/s, whereas MCF-7 and PBMC are flowed at 10 m/s. The left two columns (columns 1 and 2) for each cell type represent two opposite phase-gradient contrasts. Columns 3 and 4 represent the absorption contrast and differential (enhanced) phase-gradient contrast, respectively. Scale bars = 20 µm (in red). Please click here to view a larger version of this figure.
Figure 4: A Graphical User Interface for Cytometric Analysis Based on ATOM Images. In this interface, the user can perform cell-type classification and analysis by defining different cell parameters (e.g., cell size, circularity, absorption density, etc.) derived from the ATOM images. The result can be represented in a scatter plot displayed in the center panel. Access and control of various display options, which include changing parameters and scaling for the x- and y-axis (X- and Y-axis parameter buttons) and switching between data sets (Dataset button), is possible. Detailed cell information (Cell information tab) can be read by hovering on a specific data point. To enable rapid navigation, the user can change to another viewing mode and simultaneously display all images on the scatterplot in the center panel (Viewing modes button). Manual gating can also be performed for further analysis. Yellow data points represent the MCF-7 cell specimen (in (a)) and Scenedesmus (SCE) (in (b)), whereas the red data points represent the human PBMC specimen (in (a)) and Chlamydomonas (CHA) (in (b)). Please click here to view a larger version of this figure.
There are several technical details that require special attention during the ATOM system setup. First, it is essential to note that asymmetric/oblique spectrally-encoded illumination could introduce residual phase-gradient components (i.e., the shadowing effect) in the absorption contrast and influence the enhancement of phase-gradient contrast in ATOM. Therefore, this effect of oblique illumination should be minimized. Second, it should be emphasized that the time-multiplexing or time-interleaving schemeinvolving two replicas results in no significant compromise on the imaging speed (i.e., the line-scan rate of >MHz can still be maintained), given that the total temporal width of two beam-replicas does not exceed one line-scan period. Third, the optimal configuration of the integrated module of dispersive fiber and amplifiers depends upon the targeted gain as the specification of the available amplifiers. Optical amplification is essential to the process of time-stretch to combat the optical loss associated with GVD22. In principle, it can be implemented by any type of optical amplifier, preferably in the fiber format, such that it is compatible with the fiber-based, time-stretch process (Figure 1b). Practical examples of optical fiber-based optical amplifiers include erbium-doped fiber amplifiers (EDFA; for operation wavelengths of ~1,500-1,600 nm), ytterbium-doped fiber amplifiers (YDFA; for operation wavelengths of ~1,060 nm), fiber Raman amplifiers, and fiber optical parametric amplifiers (FOPA; for any operation wavelength, in principle, as long as a pump laser source is available). Amplifier noise must also be carefully considered in the module design. Detailed theory can be seen in Reference 8. A common configuration could involve multiple/cascaded fiber amplifiers inserted between multiple dispersive fiber segments (each has a length of a few km). For ATOM and time-stretch imaging in general, the typical on-off optical power gain should be around 20-30 dB. It should be noted that the operation wavelength range is typically restricted to ~800-1,550 nm, mainly due to the exceedingly high optical fiber loss at shorter wavelengths (i.e., visible wavelengths). Therefore, similarly to the majority of the time-stretch imaging demonstrations, fiber-based ATOM will not be immediately applicable to fluorescence imaging where visible-light operations are still commonplace. Nevertheless, note that a free-space pulse-stretching concept resembling time-stretch, called free-space angular-chirp-enhanced delay (FACED), has recently been used for ultrafast laser-scanning imaging in ATOM, as well as for fluorescence imaging at visible wavelengths30.
Another important parameter requiring subtle design consideration is image resolution. Unlike classical light microscopy, the image resolution of ATOM and general time-stretch imaging along the spectral shower axis is governed by three limiting regimes22: (i) the spatial-dispersion-limited resolution, which is related to the spectral resolution of the diffraction grating, denoted as δxspatial; (ii) the stationary-phase approximation limit, which is defined as the ambiguity of the wavelength-time mapping process δxSPA, which inversely scales with the square root of GVD22; and (iii) the photodetector-limited resolution δxdet, which describes the finite bandwidth of the photodetector that could also influence the final spatial resolution. In general, the largest value among these three parameters is defined as the image resolution of ATOM, δx (i.e., δx = max {δxspatial, δxSPA, δxdet }). It is always desirable to ensure that the final resolution is spatial-dispersion-limited (i.e., δx = δxspatial> δxSPA > δxdet). Therefore, both the GVD (step 2.2.1.1) and the bandwidth (step 2.3.5) of the photodetector must be sufficiently high to satisfy this condition. On the other hand, the image resolution along the flow direction is evaluated by the diffraction limit. This is only true when the Nyquist's sampling condition is satisfied (i.e., the repetition rate of the laser (R, in Hz) and the flow rate of the cells (F, in m/s) should be set such that the pixel size in the flow direction is F/R <2δy, where δy is the diffraction-limited resolution along the flow direction). Note that the specifications of the grating (e.g., groove density) and objective lens (e.g., the numerical aperture (NA)) should be carefully designed to match the targeted resolution.
While the current ATOM demonstration and protocol show that the data acquisition is done by oscilloscope and the data processing is followed offline, it is more favorable to achieve real-time, continuous data acquisition, processing, and even analytics, especially leveraging the ability to achieve the ultrafast and high-contrast image capture abilities brought by ATOM. To this end, a high-performance and high-throughput signal processing unit should be adopted, such as a graphical processing unit (GPU) and/or a field-programmable gate array (FPGA), which have been demonstrated to have the capability to achieve a data processing throughput as high as ~1-10 GB/s. This is compatible with the ultrafast sampling ability of ATOM (i.e., ~10 GSa/s). The integration of ATOM and a high-throughput data processing accelerator enables a new paradigm in data-driven biological studies, especially in unraveling the unknown heterogeneity between different single cells within an enormous population. Such technology could also empower a new generation of clinical research, in which rare, aberrant cells during the disease process can be quantified in a label-free manner.
The authors have nothing to disclose.
We thank Mr. P. Yeung for preparing the MCF-7 for us. This work was partially supported by grants from the Research Grant Council of the Hong Kong Special Administration Region, China (Project no. 17259316, 17207715, 17207714, 17205215, and HKU 720112E), the Innovation and Technology Support Programme (ITS/090/14), and the University Development Fund of HKU.
Nikon Plan Fluorite Physiology Objectives 40X | Nikon | MRF07420 | Objective lens (Obj2) |
Olympus Plan Fluorite Objective, 0.75 NA, 0.51 mm WD, 40X | Olympus | RMS40X-PF | Objective lens (Obj1) |
N-BK7 Plano-Convex Lenses | Thorlabs | LA1145-C | For relaying spectral shower |
FC/APC Fiber Collimation Package | Thorlabs | F220APC-1064 | For outputing and collecting laser pulses |
Pellicle beamsplitter | Thorlabs | BP145B3 | For making beam replica |
Protected silver mirror | Thorlabs | PF10-03-P01 | For reflecting light |
800-1650nm 12GHz single mode DC-coupled NIR Photoreceiver | Newport | 1544-B | For converting light into electrical signal |
Infiniium High-Performance Oscilloscope | Agilent | DSOX91604A | To save the light-converted electrical signals |
HI1060 optical fiber | Corning | HI1060 | Optical fiber for time-stretch |
YTTERBIUM DOPED FIBER AMPLIFIER | Keopsys | KPS-STD-BT-YFA-37-BO-SM-111-FA-FA | Optical in-line amplifier |
Holographic grating | Wasatch Photonics | 020305-6 | Grating |
Infuse/Withdraw Syringe Pumps | Harvard Apparatus | PHD 2000 | Syringe pump for sample loading in micro-fluidic channels |