A multimodal, rapid hyperspectral imaging framework was developed to obtain broadband vibrational sum-frequency generation (VSFG) images, along with brightfield, second harmonic generation (SHG) imaging modalities. Due to the infrared frequency being resonant with molecular vibrations, microscopic structural and mesoscopic morphology knowledge is revealed of symmetry-allowed samples.
Vibrational sum-frequency generation (VSFG), a second-order nonlinear optical signal, has traditionally been used to study molecules at interfaces as a spectroscopy technique with a spatial resolution of ~100 µm. However, the spectroscopy is not sensitive to the heterogeneity of a sample. To study mesoscopically heterogeneous samples, we, along with others, pushed the resolution limit of VSFG spectroscopy down to ~1 µm level and constructed the VSFG microscope. This imaging technique not only can resolve sample morphologies through imaging, but also record a broadband VSFG spectrum at every pixel of the images. Being a second-order nonlinear optical technique, its selection rule enables the visualization of non-centrosymmetric or chiral self-assembled structures commonly found in biology, materials science, and bioengineering, among others. In this article, the audience will be guided through an inverted transmission design that allows for imaging unfixed samples. This work also showcases that VSFG microscopy can resolve chemical-specific geometric information of individual self-assembled sheets by combining it with a neural network function solver. Lastly, the images obtained under brightfield, SHG, and VSFG configurations of various samples briefly discuss the unique information revealed by VSFG imaging.
Vibrational sum-frequency generation (VSFG), a second-order nonlinear optical technique1,2, has been used extensively as a spectroscopy tool to chemically profile symmetry-allowed samples3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22. Traditionally, VSFG has been applied to interfacial systems8,9,10,11 (i.e., gas-liquid, liquid-liquid, gas-solid, solid-liquid), which lack inversion symmetry – a requirement for VSFG activity. This application of VSFG has provided a wealth of molecular details of buried interfaces12,13, configurations of water molecules at interfaces14,15,16,17,18, and chemical species at interfaces19,20,21,22.
Although VSFG has been powerful in determining molecular species and configurations at interfaces, its potential in measuring molecular structures of materials lacking inversion centers has not been fulfilled. This is partly because the materials could be heterogeneous in their chemical environment, compositions, and geometric arrangement, and a traditional VSFG spectrometer has a large illumination area on the order of 100 µm2. Thus, traditional VSFG spectroscopy reports on ensemble-averaged information of the sample over a typical 100 µm2 illumination area. This ensemble averaging may lead to signal cancellations between well-ordered domains with opposite orientations and mischaracterization of local heterogeneities15,20,23,24.
With advances in high numerical aperture (NA), reflective-based microscope objectives (Schwarzschild and Cassegrain geometries), which are nearly free of chromatic aberrations, the focus size of the two beams in VSFG experiments can be decreased from 100 µm2 to 1-2 µm2 and in some cases submicron25. Including this technological advancement, our group and others have developed VSFG into a microscopy platform20,23,26,27,28,29,30,31,32,33,34,35,36. Recently, we have implemented an inverted optical layout and broadband detection scheme37, which enables a seamless collection of multimodal images (VSFG, second harmonic generation (SHG), and brightfield optical). The multi-modality imaging allows quick inspection of samples using optical imaging, correlating various types of images together, and locating signal positions on the sample images. With the achromatic illumination optics and choice of pulsed laser illumination source, this optical platform allows for future seamless integration of additional techniques such as Fluorescence microscopy38 and Raman microscopy, among others.
In this new arrangement, samples such as hierarchical organizations and a class of molecular self-assemblies (MSAs) have been studied. These materials include collagen and biomimetics, where both the chemical composition and geometric organization are important to the ultimate function of the material. Because VSFG is a second-order nonlinear optical signal, it is specifically sensitive to intermolecular arrangements39,40, such as intermolecular distance or twisting angles, making it an ideal tool for revealing both chemical compositions and molecular arrangements. This work describes the VSFG, SHG, and brightfield modalities of the core instrument consisting of a ytterbium-doped cavity solid-state laser that pumps an optical parametric amplifier (OPA), a home-built multimodal inverted microscope and monochromator frequency analyzer coupled to a two-dimensional charged coupled device (CCD) detector27. A step-by-step construction and alignment procedures, and a complete part list of the setup, are provided. An in-depth analysis of an MSA, whose fundamental molecular subunit is comprised of one molecule of sodium-dodecyl sulfate (SDS), a common surfactant, and two molecules of β-cyclodextrin (β-CD), known as SDS@2β-CD herein, are also provided as an example to show how VSFG can reveal molecule-specific geometric details of organized matter. It has also been demonstrated that chemical-specific geometric details of the MSA can be determined with a neural network function solver approach.
1. Hyperspectral line-scanning VSFG microscope
Figure 1: Multimodal hyperspectral VSFG microscope. (A) Top view of the core setup. A 1025 nm pump laser was sent to an OPA to generate a tunable mid-IR pulse. The residual 1025 nm was frequently narrowed by an etalon (E) and spatially filtered into a Gaussian beam by a spatial filter (SFG). Mid-IR and 1025 nm beams are spatially overlapped at a customized dichroic mirror (DM) and guided through the inverted microscope (boxed region in A). (B) The two beams are sent to a 325 Hz resonant beam scanner mounted to an integrated 2-position slider (I2PS), enabling seamless switching between brightfield and nonlinear optical modalities. The microscope platform is equipped with a reflective-based infinity-corrected Schwarzschild objective (SO) acting as a condenser and a refractive-based infinity-corrected imaging objective (RO) mounted to a vertical nanopositioning (VNP) z-axis stage. The SO focuses the line of incoming beams that the resonant beam scanner reflects onto the sample while the RO collects the VSFG line section of signals. It is important to fine-control the z-axis position of the RO at 1 µm precision to ensure the sample is at the best focal condition for high-quality imaging. The collimated line of the VSFG signal is then directed to a tube lens system composed of 2 tub lenses (TL1 and TL2), forming a magnified image at the entrance slit of the monochromator (MC). The frequency-resolved line of spectra is then hyperspectrally imaged on a charge-coupled device (CCD). After collecting each hyperspectral line, the sample is scanned in the axis perpendicular to the resonant beam scanner scanning axis using the NP. To collect bright field images of the sample, the I2PS is moved to the brightfield position, and a mirror intercepting the white light source (WLS) is installed. Light is then focused by the RO and imaged by the SO. An image is then formed at the sensor plane of the brightfield camera (BC) at the top of the inverted microscope. (C) Detailed view of the optical path through the tube-lens area into the MC and CCD. (D) Detailed view of the sample area between the SO and RO. Please click here to view a larger version of this figure.
2. Hyperspectral microscope alignment and vertical CCD axis spatial calibration
Figure 2: Representative image quality for rough alignment of brightfield imaging modality of a ZnO pattern. Please click here to view a larger version of this figure.
Figure 3: Vertical axis calibration workflow. This figure illustrates how to convert the CCD pixels to vertical spatial dimensions in the unit of µm. (A) An image is collected and reconstructed of the ZnO patterned coverslip. Then, the pixel distance from one to the other edges of the pattern (small vertical bar in A). Because the ZnO pattern cross is designed to have a 25 µm width, one can use the ratio of physical width to pixel width here to calculate the physical/pixel dimension ratio. A representative, vertical axis calibrated image is shown in (B). (C) Lastly, a vertical slice is taken as indicated by the red line. (D) The derivative of the vertical slice is taken to obtain the spatial resolution. The derivative of the vertical slice is used to obtain the spatial resolution. Please click here to view a larger version of this figure.
3. Hyperspectral data collection
4. Hyperspectral data analysis
5. Geometric analysis of the sample
Figure 4: Illustration of Euler transformation. (A) Illustration of the Euler transformation between the laboratory coordinates (XYZ) second-order susceptibility χ(2) and the molecular coordinates (xyz) hyperpolarizability βijk. z-y'-z'' Euler rotation is performed on the molecular coordinates, with φ as the in-plane rotation angle, θ as the tilt angle, and ψ as the twist angle. ψ is integrated out for arbitrary twist angles about the molecular axis. φ is not integrated out because all molecules rotate to a specific angle relative to the lab frame to form the self-assembled sheets. N is the relative surface coverage of the two sheets. (B) Visualization of the tilted subunits forming a sheet determined by the neural network results. This figure has been modified from Wagner et al.27. Please click here to view a larger version of this figure.
Figure 5: Molecular structure, morphology and potential orientation of SDS@β-CD. (A) Top-view and (B) side-view chemical structure of SDS@β-CD. (C) Representative heterogeneous sample distribution of the mesoscale sheets on the sample plane. The molecular subunit could have different orientations and alignment on the substrate, which is unknown.This figure has been modified from Wagner et al.27. Please click here to view a larger version of this figure.
The ability of the microscope to discriminate between uniquely organized molecular structures and isotropic bulk is demonstrated with the SDS@2β-CD sample23,34 (Figure 5). In this study, the sample was prepared by adding β-CD and SDS to deionized water (DI) water at 2:1 ratio until the two solutes reached a 10% m/m concentration. The suspension was then heated to clarity and cool to room temperature overnight. CuCl2 was added at a concentration of 1:10 CuCl2:SDS to tune the electrostatic interactions and the mixture was allowed to sit for 3-5 days for SDS@2β-CD meso-sheets to form fully. Lastly, isolated meso-sheets were produced by drop casting 5 µL of the sheet suspension onto a 15 mm x 15 mm x 0.170 mm ± 0.005 mm coverslip affixed to a spin coater operating at 10,000 rpm.
The mesoscale sheets formed from their self-assembly with a specific C7 symmetry. Yet, it is unclear about the molecular orientation of the single molecular unit in this self-assembly, a fundamental knowledge that can influence the material functions. (Figure 5C). VSFG images of the self-assembled sheets dispersed on a coverslip were captured (Figure 6A). Through spectral identification (step 4 Hyperspectral data analysis) using the Matlab hyperspectral imaging function, it was found that all sheets can be categorized into two types, one with higher VSFG intensity (blue spectra in Figure 6B, and sheets labeled in blue in Figure 6A), and the other one with lower intensity. By inspecting and comparing with the optical image (Figure 6C,D), the large sheet at the center of the images appeared to have stacked double sheets, thereby attributing the smaller VSFG intensity due to destructive interference between the two different orientation sheets. The single sheet was focused to extract the single molecular unit orientation (blue ones in Figure 6A). Two of the sheets (highlighted in red and blue squares in Figure 6A) were measured by various VSFG polarizations, and the spectra were fitted using the Voigt functions. Note the VSFG polarization is described in the order signal, up-conversion and MIR. For example, SSP means P polarization of IR, S polarization of up-conversion and S polarization of signals.
Figure 6: Polarization resolved VSFG image overlay with brightfield modality. (A) Polarization resolved (SSS) hyperspectral VSFG image of SDS@2β-CD. Purple and pink colors represent areas where different spectra reside, and the corresponding spectra are plotted in (B), which are representative spectra for single pixels with signal-to-noise ratio for blue and magenta spectra ~56 and ~26, respectively. The sheets in the red and blue boxes are analyzed explicitly below to extract the supramolecule tilt angles. (C) Brightfield image of the same area as that in (A). (D) VSFG hyperspectral image overlayed with an optical image of an identical area. (E) From left to right: PPS, PPP, SSP, and SSS polarization resolved spectra summed over 180 and 480 pixels within the two single sheets highlighted in red and blue boxes in (A). All spectra had a dominant feature centered at approximately 2910 cm-1 and a signal-to-noise ratio in the order of 1000. The spectra were fitted with multiple Voigt functions, which were represented by the shaded areas, and used for further orientation analysis. This figure has been modified from Wagner et al.27. Please click here to view a larger version of this figure.
Then, to extract the molecular orientations, the symmetry-allowed hyperpolarizability, was first determined, allowed by the symmetry selection rule, using the previously published procedure43. Then the relationship between the lab frame and the molecular frame is derived from Euler rotation27. The tilt angle θ is then extracted using the neural network method outlined above, and the tilt angle was found to be ~23° (Figure 6).
Lastly, the ability of multimodal imaging in this platform37is shown (Figure 7). Here three different samples, namely, SDS@2β-CD, collagen, and L-phenylalanyl-L-phenylalanine (FF), are studied with the microscope with brightfield, SHG, and VSFG imaging modalities. First of all, all samples showed similar morphologies across different imaging modalities. Both SHG and VSFG showed intensity variations spatially, which is missing from optical images. Because SHG and VSFG both require ordered non-centrosymmetric structures, the variation in signal intensity could come from variations in local molecular ordering or molecular orientations. Unlike SHG, one can tune the MIR beam of VSFG to be resonant with different vibrational modes. In the case shown here, CHx vibrational modes were studied at 3.5 µm and Amid-I mode at 6 µm. For FF, VSFG images with strong and uniform signals were obtained, suggesting a well-ordered self-assembled structure for all vibrational groups – agreeing with its crystalline nature. In contrast, the collagen sample displayed a stronger VSFG signal in the CHx region over the Amide region, indicating the samples are flexible and their vibrational groups have different degrees of order.
Figure 7: Multimodal images of three different samples. (Ai–Aiii) SDS@2β-CD brightfield, SHG (PP polarization) and, VSFG (PPP polarization) of 3.5 µm region images, respectively. Nonlinear images are overlaid with brightfield images. Chemical structures of SDS and 2β-CD are shown in the inset of ai. (Bi–Biv) Lyophilized collagen brightfield, SHG (PP polarization), VSFG(PPP polarization) of 3.5 µm and 6 µm regions respectively. The chemical structure of the primary protein trimer residue of collagen, composed of glycine, proline, and hydroxyproline, is shown in the inset of Bi. (Ci-Civ) FF brightfield, SHG (PP polarization), and VSFG(PPP polarization) of 3.5 µm and 6 µm regions respectively. The chemical structure for the FF molecular subunits is shown in the inset of ci. All 6 µm images are taken under a purged nitrogen instrument environment to remove attenuation from ambient air moisture. SDS@2β-CD does not have a VSFG image at 6 µm because it does not have Amid groups. Please click here to view a larger version of this figure.
Supplementary File 1: Matlab code for hyperspectral data analysis Please click here to download this File.
The most critical steps are from 1.42 to 1.44. It is critical to align the objective lens well for an optical spatial resolution. It is also important to collect the emitted signal, relay, and project the scanning beam as a line at the entrance slits. Proper alignments would guarantee the best resolution and signal-to-noise ratio. For a typical sample, like SDS@2β-CD 100 µm by 100 µm sheets, a good resolution image (~1 µm resolution) with a high signal-to-noise ratio would take 20 min. This is already faster than the previous version of the instrument24,26. Further enhancement of data acquisition speed can be realized by a higher repetition rate laser.
The current limitation is spatial resolution, which could be further improved with even higher NA objective optics and potential nonlinear optics-based super-resolution techniques45. Heterodyne detection has been applied in VSFG spectroscopy to resolve its phase and extract the molecular orientations5,46,47,48. This is technically doable in our experiment. However, VSFG imaging naturally relies on signal scattering off the sample, which scrabbles its phase and thereby complicates the relationships between molecular orientation and the phase of the VSFG signal.
Imaging the morphology of materials with chemical specificity is challenging because many imaging techniques lack molecular sensitivities. Rapid hyperspectral VSFG microscopy fills this void by probing molecular vibrational signatures and revealing molecular alignments of mesoscale organized matter that are important in materials science, chemistry, and biology. In the future, the reflective nature of the illumination optics will enable other techniques to be integrated into the core instrument, further increasing its capabilities and enabling multimodal images of chemical, biological, and material samples.
The authors have nothing to disclose.
The instrument development is supported by Grant NSF CHE-1828666. ZW, JCW and WX are supported by the National Institutes of Health, National Institute of General Medical Sciences, Grant 1R35GM138092-01. BY is supported by the Youth Innovation Promotion Association, Chinese Academy of Sciences (CAS, 2021183).
1x Camera Por | Thorlabs | WFA4100 | connect a camera to a microscope or optical system |
25.0 mm Right-Angle Prism Mirror, Protected Gold | Thorlabs | MRA25-M01 | reflect light and produce retroreflection, redirecting light back along its original path |
3” Universal Post Holder-5 Pack | Thorlabs | UPH3-P5 | hold and support posts of various sizes and configurations |
30 mm to 60 mm Cage Plate, 4 mm Thick | Thorlabs | LCP4S | convert between a 30 mm cage system and a 60 mm cage system |
500 mm Tall Cerna Body with Epi Arm | Thorlabs | CEA1500 | provide the function of enabling top illumination techniques in microscopy |
60 mm Cage Mounted Ø50.0 mm Iris | Thorlabs | LCP50S | control the amount of light passing through an optical system |
60 mm Cage Mounting Bracket | Thorlabs | LCP01B | mount and position a 60 mm cage system in optical setups |
Air spaced Etalon | SLS Optics Ltd. | Customized | generate narrow-band 1030 nm light |
Cage Plate Mounting Bracket | Thorlabs | KCB2 | hold and adjust mirrors at a precise angle |
CCD | Andor Technologies | Newton | 2D CCD for frequency and spatial resolution |
Collinear Optical Parametric Amplifier | Light Conversion | Orpheus-One-HP | Tunable MID light generator |
Copper Chloride | Thermo Fischer Scientific | A16064.30 | Self-assembly component |
Customized Dichroic Mirror | Newport | Customized | selectively reflects or transmits light based on its wavelength or polarization |
Ext to M32 Int Adapter | Thorlabs | SM1A34 | provide compatibility and facilitating the connection between components with different thread types |
Infinity Corrected Refractive Objective | Zeiss | 420150-9900-000 | Refractive Objective |
Infinity Corrected Schwarzschild Objective | Pike Technologies Inc. | 891-0007 | Reflective objective |
Laser | Carbide, Light-Conversion | C18212 | Laser source |
M32x0.75 External to Internal RMS | Thorlabs | M32RMSS | adapt or convert the threading size or type of microscope objectives |
M32x0.75 External to M27x0.75 Internal Engraving | Thorlabs | M32M27S | adapt or convert the threading size or type of microscope objectives |
Manual Mid-Height Condenser Focus Module | Thorlabs | ZFM1030 | adjust the focus of an optical element |
Monochromator | Andor Technologies | Shamrock 500i | Provides frequency resolution for each line scan |
Motorized module with 1" Travel for Edge-Mounted Arms | Thorlabs | ZFM2020 | control the vertical positon of the imaging objective |
Nanopositioner | Mad City Labs Inc. | MMP3 | 3D sample stage |
Resonant Scanner | EOPC | SC-25 | 325Hz resonant beam scanner |
RGB Color CCD Camera | Thorlabs | DCU224C | Brightfield camera, discontinued but other cameras will work just as well |
RGB tube lens | Thorlabs | ITL200 | white light collection |
Right Angle Kinematic Breadboard | Thorlabs | OPX2400 | incorporate a sliding mechanism with two fixed positions |
Right Angle Kinematic Mirror Mount, 30 mm | Thorlabs | KCB1 | hold and adjust mirrors at a precise angle |
Right Angle Kinematic Mirror Mount, 60 mm | Thorlabs | KCB2 | hold and adjust mirrors at a precise angle |
SM2, 60 mm Cage Arm for Cerna Focusing Stage | Thorlabs | CSA2100 | securely mount and position condensers |
Snap on Cage Cover for 60 mm Cage, 24 in Long, | Thorlabs | C60L24 | enclose and protect the components inside the cage |
Sodium dodecyl sulfate | Thermo Fischer Scientific | J63394.AK | Self-assembly component |
Three-Chnnale Controller and Knob Box for 1" Cerna Travel Stages | Thorlabs | MCM3001 | control ZFM2020 |
Tube lens | Thorlabs | LA1380-AB – N-BK7 | SFG signal collection |
Visible LED Set | Thorlabs | WFA1010 | provide illumination in imaging setup |
Whitelight Source | Thorlabs | WFA1010 | Whitelight illumination source for brightfield imaging |
WPH05M-1030 – Ø1/2" Zero-Order Half-Wave Plate, Ø1" Mount, 1030 nm | Thorlabs | WPH05M-1030 | alter the polarization state of light passing through it |
WPLQ05M-3500 – Ø1/2" Mounted Low-Order Quarter-Wave Plate, 3.5 µm | Thorlabs | WPLQ05M-3500 | alter the polarization state of light passing through it |
X axis Long Travel Steel Extended Contact Slide Stages | Optosigma | TSD-65122CUU | positioning stages that offer extended travel in the horizontal (X) direction |
XT95 4in Rail Carrier | Thorlabs | XT95RC4 | mount and position optical components |
X-Y Axis Translation Stage w/ 360 deg. Rotation | Thorlabs | XYR1 | precise movement and positioning of objects in two dimensions, along with the ability to rotate the platform |
XY(1/2") Linear Translator with Central SM1 Thru Hole | Thorlabs | XYT1 | provide precise movement and positioning in two dimensions |
Yb doped Solid State Laser | Light Conversion | CB3-40W | Seed laser |
β-Cyclodextrin | Thermo Fischer Scientific | J63161.22 | Self-assembly component |