Published September 7, 2023 | Version v1
Journal article Open

Demonstration of an AI-driven workflow for autonomous high-resolution scanning microscopy

Description

Modern scanning microscopes can image materials with up to sub-atomic spatial and sub-picosecond time resolutions, but these capabilities come with large volumes of data, which can be difficult to store and analyze. We report the Fast Autonomous Scanning Toolkit (FAST) that addresses this challenge by combining a neural network, route optimization, and efficient hardware controls to enable a self-driving experiment that actively identifies and measures a sparse but representative data subset in lieu of the full dataset. FAST requires no prior information about the sample, is computationally efficient, and uses generic hardware controls with minimal experiment-specific wrapping. We test FAST in simulations and a dark-field X-ray microscopy experiment of a WSe2 film. Our studies show that a FAST scan of <25% is sufficient to accurately image and analyze the sample. FAST is easy to adapt for any scanning microscope; its broad adoption will empower general multi-level studies of materials evolution with respect to time, temperature, or other parameters.

Data availability

The numerical data used for this work are publicly available at https://github.com/saugatkandel/fast_smart_scanning. The raw experimental data is publicly available at https://doi.org/10.5281/zenodo.7939730. The numerical simulation data used in this work were generated using images publicly available from the MIT Libraries, USC-SIPI Image Database45, and the Scikit-image software package. Source data are provided with this paper.

The FAST software and the code for the numerical simulations are publicly available at https://github.com/saugatkandel/fast_smart_scanning. The code used to analyze the experimental data is available at https://doi.org/10.5281/zenodo.7942774.

Files

Demonstration-of-an-AI-driven-workflow-for-autonomous-high-resolution-scanning-microscopy.pdf

Files (30.2 MB)

Name Size Download all
Source data
md5:18fb44e057e7e9aeb6af26ae2d2da8d5
171.3 kB Download
Article
md5:7bac6b5303f00513f3de18c8e8990953
3.5 MB Preview Download
Supporting information files
md5:523ecaff8eea10f26a6ba01d30c40a9b
26.5 MB Preview Download

Additional details

Identifiers

DOI
10.1038/s41467-023-40339-1
Other
oai:uchicago.tind.io:7958

Funding

Argonne
AutoPtycho: Autonomous, Sparse-sampled Ptychographic Imaging
National Science Foundation
CBET Program
U.S. Department of Energy
DOE Scientific User Facilities program

UChicago Information

Division(s)
Pritzker School of Molecular Engineering