References

Pachitariu, M., Rariden, M. & Stringer, C. Cellpose-SAM: Superhuman generalization for cellular segmentation. bioRxiv (2025) doi:10.1101/2025.04.28.651001.

Ben Allal, L. et al. SmolLM2. (2024).

Jimenez, C. E. et al. SWE-bench: Can language models resolve real-world GitHub issues? in Proceedings of the twelfth international conference on learning representations (ICLR) (2024).

Haase, R., Tischer, C., Hériché, J.-K. & Scherf, N. Benchmarking large language models for bio-image analysis code generation. bioRxiv (2024) doi:10.1101/2024.04.19.590278.

Mandal, I. et al. Evaluating large language model agents for automation of atomic force microscopy. Nature Communications 16, 9104 (2025).

Meirovitch, Y. et al. SmartEM: Machine learning-guided electron microscopy. Nature Methods 23, 193–204 (2026).

Bilodeau, A. et al. Development of AI-assisted microscopy frameworks through realistic simulation with pySTED. Nature Machine Intelligence 6, 1197–1215 (2024).

Stringer, C. & Pachitariu, M. Cellpose3: One-click image restoration for improved cellular segmentation. Nature Methods 22, 592–599 (2025).

Royer, L. A. Omega – harnessing the power of large language models for bioimage analysis. Nature Methods 21, 1371–1373 (2024).

10.

Lei, W., Fuster-Barceló, C., Reder, G., Muñoz-Barrutia, A. & Ouyang, W. BioImage.IO chatbot: A community-driven AI assistant for integrative computational bioimaging. Nature Methods 21, 1368–1370 (2024).

11.

Marks, M. et al. CellSAM: A foundation model for cell segmentation. Nature Methods 22, 2585–2593 (2025).

12.

Archit, A. et al. Segment anything for microscopy. Nature Methods 22, 579–591 (2025).

13.

Balasubramanian, H., Hobson, C. M., Chew, T.-L. & Aaron, J. S. Imagining the future of optical microscopy: Everything, everywhere, all at once. Communications Biology 6, 1096 (2023).

14.

Guo, M. et al. Deep learning-based aberration compensation improves contrast and resolution in fluorescence microscopy. Nature Communications 16, 313 (2025).

15.

Trask, A. et al. Neural arithmetic logic units. in Advances in neural information processing systems vol. 31 8035–8044 (Curran Associates, Inc., 2018).

16.

Ouyang, W., Eliceiri, K. W. & Cimini, B. A. Moving beyond the desktop: Prospects for practical bioimage analysis via the web. Frontiers in Bioinformatics 3, 1233748 (2023).

17.

Wait, E. C., Reiche, M. A. & Chew, T.-L. Hypothesis-driven quantitative fluorescence microscopy – the importance of reverse-thinking in experimental design. Journal of Cell Science 133, jcs250027 (2020).

18.

Lee, R. M., Eisenman, L. R., Khuon, S., Aaron, J. S. & Chew, T.-L. Believing is seeing – the deceptive influence of bias in quantitative microscopy. Journal of Cell Science 137, jcs261567 (2024).

19.

Stringer, C., Wang, T., Michaelos, M. & Pachitariu, M. Cellpose: A generalist algorithm for cellular segmentation. Nature Methods 18, 100–106 (2021).

20.

Chamier, L. von et al. Democratising deep learning for microscopy with ZeroCostDL4Mic. Nature Communications 12, 2276 (2021).

21.

Yao, S. et al. ReAct: Synergizing reasoning and acting in language models. arXiv preprint arXiv:2210.03629 (2022) doi:10.48550/arXiv.2210.03629.

22.

Wu, Y. & Shroff, H. Multiscale fluorescence imaging of living samples. Histochemistry and Cell Biology 158, 301–323 (2022).

23.

Schermelleh, L., Heintzmann, R. & Leonhardt, H. A guide to super-resolution fluorescence microscopy. Journal of Cell Biology 190, 165–175 (2010).

24.

Sahl, S. J., Hell, S. W. & Jakobs, S. Fluorescence nanoscopy in cell biology. Nature Reviews Molecular Cell Biology 18, 685–701 (2017).

25.

Schermelleh, L. et al. Super-resolution microscopy demystified. Nature Cell Biology 21, 72–84 (2019).

26.

Ji, N. Adaptive optical fluorescence microscopy. Nature Methods 14, 374–380 (2017).

27.

Hampson, K. M. et al. Adaptive optics for high-resolution imaging. Nature Reviews Methods Primers 1, 68 (2021).

28.

Shroff, H., Testa, I., Jug, F. & Manley, S. Live-cell imaging powered by computation. Nature Reviews Molecular Cell Biology 25, 443–463 (2024).

29.

Venkatesh, M., Mohan, K. & Seelamantula, C. S. Directional bilateral filters for smoothing fluorescence microscopy images. AIP Advances 5, 084805 (2015).

30.

Danielyan, A., Wu, Y.-W., Shih, P.-Y., Dembitskaya, Y. & Semyanov, A. Denoising of two-photon fluorescence images with block-matching 3D filtering. Methods 68, 308–316 (2014).

31.

Zhang, Y. et al. A poisson-gaussian denoising dataset with real fluorescence microscopy images. in 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR) 11702–11710 (Optica Publishing Group, 2019). doi:10.1109/CVPR.2019.01198.

32.

Li, J., Luisier, F. & Blu, T. Pure-let deconvolution of 3D fluorescence microscopy images. in 2017 IEEE 14th international symposium on biomedical imaging (ISBI 2017) 723–727 (2017). doi:10.1109/ISBI.2017.7950621.

33.

Makitalo, M. & Foi, A. Optimal inversion of the generalized anscombe transformation for poisson-gaussian noise. IEEE Transactions on Image Processing 22, 91–103 (2013).

34.

Luisier, F., Vonesch, C., Blu, T. & Unser, M. Fast interscale wavelet denoising of poisson-corrupted images. Signal Processing 90, 415–427 (2010).

35.

Walt, S. van der et al. Scikit-image: Image processing in python. PeerJ 2, e453 (2014).

36.

Wiener, N. Extrapolation, Interpolation, and Smoothing of Stationary Time Series: With Engineering Applications. (The MIT Press, 1949). doi:10.7551/mitpress/2946.001.0001.

37.

Tikhonov, A. N. Solution of incorrectly formulated problems and the regularization method. Soviet Math. Dokl. 4, 1035–1038 (1963).

38.

Miller, K. Least squares methods for ill-posed problems with a prescribed bound. SIAM Journal on Mathematical Analysis 1, 52–74 (1970).

39.

Beck, A. & Teboulle, M. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences 2, 183–202 (2009).

40.

Lucy, L. B. An iterative technique for the rectification of observed distributions. Astronomical Journal 79, 745 (1974).

41.

Richardson, W. H. Bayesian-based iterative method of image restoration*. J. Opt. Soc. Am. 62, 55–59 (1972).

42.

Sarder, P. & Nehorai, A. Deconvolution methods for 3-d fluorescence microscopy images. IEEE Signal Processing Magazine 23, 32–45 (2006).

43.

Goodwin, P. C. Chapter 10 - quantitative deconvolution microscopy. in Quantitative imaging in cell biology (eds Waters, J. C. & Wittman, T.) vol. 123 177–192 (Academic Press, 2014).

44.

Guo, M. et al. Rapid image deconvolution and multiview fusion for optical microscopy. Nature Biotechnology 38, 1337–1346 (2020).

45.

Schindelin, J. et al. Fiji: An open-source platform for biological-image analysis. Nature Methods 9, 676–682 (2012).

46.

Sage, D. et al. DeconvolutionLab2: An open-source software for deconvolution microscopy. Methods 115, 28–41 (2017).

47.

Bazin, P.-L. et al. Volumetric neuroimage analysis extensions for the MIPAV software package. Journal of Neuroscience Methods 165, 111–121 (2007).

48.

Booth, M. J. Adaptive optics in microscopy. Philosophical Transactions: Mathematical, Physical and Engineering Sciences 365, 2829–2843 (2007).

49.

Hell, S. W. Far-field optical nanoscopy. Science 316, 1153–1158 (2007).

50.

Vicidomini, G., Bianchini, P. & Diaspro, A. STED super-resolved microscopy. Nature Methods 15, 173–182 (2018).

51.

Wu, Y. & Shroff, H. Faster, sharper, and deeper: Structured illumination microscopy for biological imaging. Nature Methods 15, 1011–1019 (2018).

52.

Chen, F., Tillberg, P. W. & Boyden, E. S. Expansion microscopy. Science 347, 543–548 (2015).

53.

Wassie, A. T., Zhao, Y. & Boyden, E. S. Expansion microscopy: Principles and uses in biological research. Nature Methods vol. 16 33–41 (2019).

54.

Valli, J. et al. Seeing beyond the limit: A guide to choosing the right super-resolution microscopy technique. Journal of Biological Chemistry 297, 100791 (2021).

55.

Chen, H. et al. Advancements and practical considerations for biophysical research: Navigating the challenges and future of super-resolution microscopy. Chemical & Biomedical Imaging 2, 331–344 (2024).

56.

Hagen, G. M. et al. Fluorescence microscopy datasets for training deep neural networks. GigaScience 10, giab032 (2021).

57.

Weigert, M. et al. Content-aware image restoration: Pushing the limits of fluorescence microscopy. Nature Methods 15, 1090–1097 (2018).

58.

Chen, J. et al. Three-dimensional residual channel attention networks denoise and sharpen fluorescence microscopy image volumes. Nature Methods 18, 678–687 (2021).

59.

Qiao, C. et al. Evaluation and development of deep neural networks for image super-resolution in optical microscopy. Nature Methods 18, 194–202 (2021).

60.

Hou, X. et al. HD2Net: A deep learning framework for simultaneous denoising and deaberration in fluorescence microscopy. Opt. Express 33, 27317–27333 (2025).

61.

Zhang, K., Zuo, W., Chen, Y., Meng, D. & Zhang, L. Beyond a gaussian denoiser: Residual learning of deep CNN for image denoising. IEEE Transactions on Image Processing 26, 3142–3155 (2017).

62.

Dabov, K., Foi, A., Katkovnik, V. & Egiazarian, K. Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Transactions on Image Processing 16, 2080–2095 (2007).

63.

Krull, A., Buchholz, T.-O. & Jug, F. Noise2Void - learning denoising from single noisy images. in 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR) 2124–2132 (2019). doi:10.1109/CVPR.2019.00223.

64.

Batson, J. & Royer, L. Noise2Self: Blind denoising by self-supervision. in Proceedings of the 36th international conference on machine learning (eds Chaudhuri, K. & Salakhutdinov, R.) vol. 97 524–533 (PMLR, 2019).

65.

Lehtinen, J. et al. Noise2Noise: Learning image restoration without clean data. in Proceedings of the 35th international conference on machine learning (eds Dy, J. & Krause, A.) vol. 80 2965–2974 (PMLR, 2018).

66.

Li, Y. et al. Incorporating the image formation process into deep learning improves network performance. Nature Methods 19, 1427–1437 (2022).

67.

Yanny, K., Monakhova, K., Shuai, R. W. & Waller, L. Deep learning for fast spatially varying deconvolution. Optica 9, 96–99 (2022).

68.

Saha, D. et al. Practical sensorless aberration estimation for 3D microscopy with deep learning. Opt. Express 28, 29044–29053 (2020).

69.

Kang, I., Zhang, Q., Yu, S. X. & Ji, N. Coordinate-based neural representations for computational adaptive optics in widefield microscopy. Nature Machine Intelligence 6, 714–725 (2024).

70.

Kang, I. et al. Adaptive optical correction in in vivo two-photon fluorescence microscopy with neural fields. bioRxiv (2024) doi:10.1101/2024.10.20.619284.

71.

Fersini, F. et al. Wavefront estimation through structured detection in laser scanning microscopy. Biomed. Opt. Express 16, 2135–2155 (2025).

72.

Zhou, Y., Jin, Z., Zhao, Q., Xiong, B. & Cao, X. Aberration modeling in deep learning for volumetric reconstruction of light-field microscopy. Laser & Photonics Reviews 17, 2300154 (2023).

73.

Qiao, C. et al. Deep learning-based optical aberration estimation enables offline digital adaptive optics and super-resolution imaging. Photon. Res. 12, 474–484 (2024).

74.

Hu, L., Hu, S., Gong, W. & Si, K. Image enhancement for fluorescence microscopy based on deep learning with prior knowledge of aberration. Opt. Lett. 46, 2055–2058 (2021).

75.

Wang, H. et al. Deep learning enables cross-modality super-resolution in fluorescence microscopy. Nature Methods 16, 103–110 (2019).

76.

Park, H. et al. Deep learning enables reference-free isotropic super-resolution for volumetric fluorescence microscopy. Nature Communications 13, 3297 (2022).

77.

Ning, K. et al. Deep self-learning enables fast, high-fidelity isotropic resolution restoration for volumetric fluorescence microscopy. Light: Science & Applications 12, 204 (2023).

78.

Ronneberger, O., Fischer, P. & Brox, T. U-Net: Convolutional networks for biomedical image segmentation. in Medical image computing and computer-assisted intervention – MICCAI 2015 (eds Navab, N., Hornegger, J., Wells, W. M. & Frangi, A. F.) 234–241 (Springer International Publishing, Cham, 2015). doi:10.1007/978-3-319-24574-4_28.

79.

Ji, Z., Li, J. D. & Telgarsky, M. Early-stopped neural networks are consistent. in Advances in neural information processing systems 34 - 35th conference on neural information processing systems, NeurIPS 2021 (eds Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, {Percy. S. }. & Vaughan}, J. {Wortman) 1805–1817 (Neural information processing systems foundation, 2021).

80.

Santos, C. F. G. D. & Papa, J. P. Avoiding overfitting: A survey on regularization methods for convolutional neural networks. ACM Comput. Surv. 54, (2022).

81.

Miseta, T., Fodor, A. & Vathy-Fogarassy, Á. Surpassing early stopping: A novel correlation-based stopping criterion for neural networks. Neurocomputing 567, 127028 (2024).

82.

Shah, Z. H. et al. Image restoration in frequency space using complex-valued CNNs. Frontiers in Artificial Intelligence Volume 7 - 2024, (2024).

83.

Liu, J., Gao, F., Zhang, L. & Yang, H. A saturation artifacts inpainting method based on two-stage GAN for fluorescence microscope images. Micromachines 15, (2024).

84.

Bouchard, C. et al. Resolution enhancement with a task-assisted GAN to guide optical nanoscopy image analysis and acquisition. Nature Machine Intelligence 5, 830–844 (2023).

85.

Qiao, C. et al. Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes. Nature Biotechnology 41, 367–377 (2023).

86.

Zhong, L., Liu, G. & Yang, G. Blind denoising of fluorescence microscopy images using GAN-based global noise modeling. in ISBI 863–867 (2021).

87.

Park, E. et al. Unsupervised inter-domain transformation for virtually stained high-resolution mid-infrared photoacoustic microscopy using explainable deep learning. Nature Communications 15, 10892 (2024).

88.

Osuna-Vargas, P. et al. Denoising diffusion models for high-resolution microscopy image restoration. in 2025 IEEE/CVF winter conference on applications of computer vision (WACV) 4320–4330 (2025). doi:10.1109/WACV61041.2025.00424.

89.

Zhang, Y. et al. Image super-resolution using very deep residual channel attention networks. (2018).

90.

Wang, Z., Bovik, A. C., Sheikh, H. R. & Simoncelli, E. P. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13, 600–612 (2004).

91.

Gonzalez, R. C. & Woods, R. E. Digital Image Processing. (Prentice Hall, 2008).

92.

Haase, R., Tischer, C., Bankhead, P., Miura, K. & Cimini, B. A call for FAIR and open-access training materials to advance BioImage analysis. (2024).

93.

Ljosa, V., Sokolnicki, K. L. & Carpenter, A. E. Annotated high-throughput microscopy image sets for validation. Nat. Methods 9, 637 (2012).

94.

Cimini, B. A. When to say ’good enough’. (2019).

95.

Jamali, N., Dobson, E. T. A., Eliceiri, K. W., Carpenter, A. E. & Cimini, B. A. 2020 BioImage analysis survey: Community experiences and needs for the future. Biological Imaging 1, e4 (2021).

96.

Sivagurunathan, S. et al. Bridging imaging users to imaging analysis - a community survey. J. Microsc. (2023).

97.

Schindelin, J., Rueden, C. T., Hiner, M. C. & Eliceiri, K. W. The ImageJ ecosystem: An open platform for biomedical image analysis. Mol. Reprod. Dev. 82, 518–529 (2015).

98.

Napari: A multi-dimensional image viewer for python. doi:10.5281/zenodo.3555620.

99.

Stirling, D. R. et al. CellProfiler 4: Improvements in speed, utility and usability. BMC Bioinformatics 22, 433 (2021).

100.

Bankhead, P. et al. QuPath: Open source software for digital pathology image analysis. Sci. Rep. 7, 16878 (2017).

101.

Chaumont, F. de et al. Icy: An open bioimage informatics platform for extended reproducible research. Nat. Methods 9, 690–696 (2012).

102.

Berg, S. et al. Ilastik: Interactive machine learning for (bio)image analysis. Nat. Methods 16, 1226–1232 (2019).

103.

Arzt, M. et al. LABKIT: Labeling and segmentation toolkit for big image data. Front. Comput. Sci. 4, (2022).

104.

Schmidt, U., Weigert, M., Broaddus, C. & Myers, G. Cell detection with star-convex polygons. in Medical image computing and computer assisted intervention - MICCAI 2018 (eds Frangi, A. F., Schnabel, J. A., Davatzikos, C., Alberola-López, C. & Fichtinger, G.) 265–273 (Springer International Publishing, Cham, 2018). doi:10.1007/978-3-030-00934-2_30.

105.

Goldsborough, T. et al. InstanSeg: An embedding-based instance segmentation algorithm optimized for accurate, efficient and portable cell segmentation. arXiv [cs.CV] (2024).

106.

Pachitariu, M. & Stringer, C. Cellpose 2.0: How to train your own model. Nat. Methods 19, 1634–1641 (2022).

107.

Zhang, C. et al. Bio-image informatics index BIII: A unique database of image analysis tools and workflows for and by the bioimaging community. arXiv [q-bio.QM] (2023).

108.

Ouyang, W. et al. BioImage model zoo: A community-driven resource for accessible deep learning in BioImage analysis. bioRxiv 2022.06.07.495102 (2022) doi:10.1101/2022.06.07.495102.

109.

Rueden, C. T. et al. Scientific community image forum: A discussion forum for scientific image software. PLoS Biol. 17, e3000340 (2019).

110.

Gómez-de-Mariscal, E. et al. DeepImageJ: A user-friendly environment to run deep learning models in ImageJ. Nat. Methods 18, 1192–1195 (2021).

111.

Ouyang, W., Mueller, F., Hjelmare, M., Lundberg, E. & Zimmer, C. ImJoy: An open-source computational platform for the deep learning era. Nat. Methods 16, 1199–1200 (2019).

112.

Shah, R., Gogoberidze, N. & Cimini, B. Bilayers.

113.

Hidalgo-Cenalmor, I. et al. DL4MicEverywhere: Deep learning for microscopy made flexible, shareable and reproducible. Nat. Methods 21, 925–927 (2024).

114.

Kluyver, T. et al. Jupyter notebooks - a publishing format for reproducible computational workflows. in Positioning and power in academic publishing: Players, agents and agendas (eds Loizides, F. & Scmidt, B.) 87–90 (IOS Press, Netherlands, 2016).

115.

Kreshuk, A. & Zhang, C. Machine learning: Advanced image segmentation using ilastik. Methods Mol. Biol. 2040, 449–463 (2019).

116.

Arganda-Carreras, I. et al. Trainable Weka Segmentation: A machine learning tool for microscopy pixel classification. Bioinformatics 33, 2424–2426 (2017).

117.

Fazeli, E. et al. Automated cell tracking using StarDist and TrackMate. F1000Research 9, 1279 (2020).

118.

Krizhevsky, A., Sutskever, I. & Hinton, G. E. ImageNet Classification with Deep Convolutional Neural Networks. in Advances in Neural Information Processing Systems vol. 25 (Curran Associates, Inc., 2012).

119.

Ahlers, J. et al. Napari: A multi-dimensional image viewer for Python. (2023) doi:10.5281/zenodo.8115575.

120.

Russell, C. T. et al. Bia-binder: A web-native cloud compute service for the bioimage analysis community. (2024) doi:10.48550/arXiv.2411.12662.

121.

Follain, G. et al. Fast label-free live imaging reveals key roles of flow dynamics and CD44-HA interaction in cancer cell arrest on endothelial monolayers. (2024) doi:10.1101/2024.09.30.615654.

122.

Moen, E. et al. Deep learning for cellular image analysis. Nature Methods 16, 1233–1246 (2019).

123.

Pylvänäinen, J. W., Gómez-de-Mariscal, E., Henriques, R. & Jacquemet, G. Live-cell imaging in the deep learning era. Current Opinion in Cell Biology 85, 102271 (2023).

124.

Laine, R. F., Arganda-Carreras, I., Henriques, R. & Jacquemet, G. Avoiding a replication crisis in deep-learning-based bioimage analysis. Nature methods 18, 1136–1144 (2021).

125.

Heinrich, L. et al. Whole-cell organelle segmentation in volume electron microscopy. Nature 599, 141–146 (2021).

126.

Liu, B. et al. Self-supervised learning reveals clinically relevant histomorphological patterns for therapeutic strategies in colon cancer. Nature Communications 16, 2328 (2025).

127.

Moshkov, N. et al. Learning representations for image-based profiling of perturbations. Nature Communications 15, 1594 (2024).

128.

Caicedo, J. C., McQuin, C., Goodman, A., Singh, S. & Carpenter, A. E. Weakly Supervised Learning of Single-Cell Feature Embeddings. in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition 9309–9318 (2018). doi:10.1109/CVPR.2018.00970.

129.

Li, Y. & Shen, L. cC-GAN: A Robust Transfer-Learning Framework for HEp-2 Specimen Image Segmentation. IEEE Access 6, 14048–14058 (2018).

130.

Morid, M. A., Borjali, A. & Del Fiol, G. A scoping review of transfer learning research on medical image analysis using ImageNet. Computers in Biology and Medicine 128, 104115 (2021).

131.

Kochetov, B. et al. UNSEG: Unsupervised segmentation of cells and their nuclei in complex tissue samples. Communications Biology 7, 1–14 (2024).

132.

Chen, J. et al. The Allen Cell and Structure Segmenter: A new open source toolkit for segmenting 3D intracellular structures in fluorescence microscopy images. (2020) doi:10.1101/491035.

133.

Conrad, R. & Narayan, K. Instance segmentation of mitochondria in electron microscopy images with a generalist deep learning model trained on a diverse dataset. Cell Systems 14, 58–71.e5 (2023).

134.

Fisch, D. et al. Molecular definition of the endogenous Toll-like receptor signalling pathways. Nature 631, 635–644 (2024).

135.

Bejarano, L. et al. Interrogation of endothelial and mural cells in brain metastasis reveals key immune-regulatory mechanisms. Cancer Cell 42, 378–395.e10 (2024).

136.

Rangel DaCosta, L., Sytwu, K., Groschner, C. K. & Scott, M. C. A robust synthetic data generation framework for machine learning in high-resolution transmission electron microscopy (HRTEM). npj Computational Materials 10, 1–11 (2024).

137.

Lin, B. et al. A deep learned nanowire segmentation model using synthetic data augmentation. npj Computational Materials 8, 1–12 (2022).

138.

Shorten, C. & Khoshgoftaar, T. M. A survey on Image Data Augmentation for Deep Learning. Journal of Big Data 6, 60 (2019).

139.

Lecun, Y., Bottou, L., Bengio, Y. & Haffner, P. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86, 2278–2324 (1998).

140.

Alibrahim, H. & Ludwig, S. A. Hyperparameter optimization: Comparing genetic algorithm against grid search and bayesian optimization. in 2021 IEEE congress on evolutionary computation (CEC) 1551–1559 (2021). doi:10.1109/CEC45853.2021.9504761.

141.

Ilievski, I., Akhtar, T., Feng, J. & Shoemaker, C. Efficient hyperparameter optimization for deep learning algorithms using deterministic RBF surrogates. Proceedings of the AAAI Conference on Artificial Intelligence 31, (2017).

142.

Maška, M. et al. A benchmark for comparison of cell tracking algorithms. Bioinformatics 30, 1609–1617 (2014).

143.

Kaiser, T., Ulman, V. & Rosenhahn, B. Chota: A higher order accuracy metric for cell tracking. in European conference on computer vision 122–138 (Springer, 2024).

144.

Cybenko, G. Approximation by superpositions of a sigmoidal function. Mathematics of control, signals and systems 2, 303–314 (1989).

145.

LeCun, Y., Bengio, Y., et al. Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks 3361, 1995 (1995).

146.

LeCun, Y. The MNIST database of handwritten digits. http://yann. lecun. com/exdb/mnist/ (1998).

147.

Spanhol, F. A., Oliveira, L. S., Petitjean, C. & Heutte, L. Breast cancer histopathological image classification using convolutional neural networks. in 2016 international joint conference on neural networks (IJCNN) 2560–2567 (IEEE, 2016).

148.

Dosovitskiy, A. et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020).

149.

Hinton, G. E. & Salakhutdinov, R. R. Reducing the dimensionality of data with neural networks. science 313, 504–507 (2006).

150.

Israel, U. et al. CellSAM: A foundation model for cell segmentation. BioRxiv 2023–11 (2025).

151.

Kirillov, A. et al. Segment anything. in Proceedings of the IEEE/CVF international conference on computer vision 4015–4026 (2023).

152.

Pachitariu, M., Rariden, M. & Stringer, C. Cellpose-SAM: Superhuman generalization for cellular segmentation. bioRxiv 2025–04 (2025).

153.

Liu, Z. et al. Swin transformer: Hierarchical vision transformer using shifted windows. in Proceedings of the IEEE/CVF international conference on computer vision 10012–10022 (2021).

154.

Zhang, X. et al. SwinCell: A 3D transformer and flow-based framework for improved cell segmentation. Communications Biology 8, 962 (2025).

155.

Achard, C. et al. CellSeg3D, self-supervised 3D cell segmentation for fluorescence microscopy. eLife 13, RP99848 (2025).

156.

Sheridan, A. et al. Local shape descriptors for neuron segmentation. Nature methods 20, 295–303 (2023).

157.

Kingma, D. P. & Ba, J. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).

158.

Loshchilov, I. & Hutter, F. Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983 (2016).

159.

Prechelt, L. Automatic early stopping using cross validation: Quantifying the criteria. Neural networks 11, 761–767 (1998).

160.

Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I. & Salakhutdinov, R. R. Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580 (2012).

161.

Huang, G., Sun, Y., Liu, Z., Sedra, D. & Weinberger, K. Q. Deep networks with stochastic depth. in European conference on computer vision 646–661 (Springer, 2016).

162.

Ioffe, S. & Szegedy, C. Batch normalization: Accelerating deep network training by reducing internal covariate shift. in International conference on machine learning 448–456 (pmlr, 2015).

163.

Ba, J. L., Kiros, J. R. & Hinton, G. E. Layer normalization. arXiv preprint arXiv:1607.06450 (2016).

164.

Lin, T.-Y. et al. Feature pyramid networks for object detection. in Proceedings of the IEEE conference on computer vision and pattern recognition 2117–2125 (2017).

165.

Heinrich, L., Funke, J., Pape, C., Nunez-Iglesias, J. & Saalfeld, S. Synaptic cleft segmentation in non-isotropic volume electron microscopy of the complete drosophila brain. in International conference on medical image computing and computer-assisted intervention 317–325 (Springer, 2018).

166.

Wang, Z. J. et al. CNN explainer: Learning convolutional neural networks with interactive visualization. IEEE Transactions on Visualization and Computer Graphics 27, 1396–1406 (2020).

167.

Chelli, M. et al. Hallucination rates and reference accuracy of ChatGPT and Bard for systematic reviews: Comparative analysis. Journal of Medical Internet Research 26, e53164 (2024).

168.

Huang, G. et al. Embodied intelligence unlocks autonomous microscopy. bioRxiv (2025) doi:10.1101/2025.08.13.670210.

169.

Wang, Z., Danek, B., Yang, Z., Chen, Z. & Sun, J. Making large language models reliable data science programming copilots for biomedical research. Nature Biomedical Engineering (2026) doi:10.1038/s41551-025-01587-2.

170.

Li, B., Saini, A. K., Hernandez, J. G., et al. Agentic AI and the rise of in silico team science in biomedical research. Nature Biotechnology (2026) doi:10.1038/s41587-026-03035-1.

171.

Sakaue-Sawano, A. et al. Visualizing spatiotemporal dynamics of multicellular cell-cycle progression. Cell 132, 487–498 (2008).

172.

Qu, Y. et al. CRISPR-GPT for agentic automation of gene-editing experiments. Nature Biomedical Engineering 10, 245–258 (2026).

173.

Matula, P. et al. Cell tracking accuracy measurement based on comparison of acyclic oriented graphs. PloS one 10, e0144959 (2015).

174.

Moshkov, N., Mathe, B., Kertesz-Farkas, A., Hollandi, R. & Horvath, P. Test-time augmentation for deep learning-based cell segmentation on microscopy images. Scientific reports 10, 5068 (2020).

175.

Wang, G. et al. Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks. Neurocomputing 338, 34–45 (2019).

176.

Gallusser, B. & Weigert, M. Trackastra: Transformer-based cell tracking for live-cell microscopy. in European conference on computer vision 467–484 (Springer, 2024).

177.

Ashesh, A. et al. Micro𝕊plit: : Semantic unmixing of fluorescent microscopy data. Nature Methods 23, 1047–1057 (2026).

178.

Tavakoli, M. R. et al. Light-microscopy-based connectomic reconstruction of mammalian brain tissue. Nature 642, 398–410 (2025).

179.

Yin, W. et al. A petascale automated imaging pipeline for mapping neuronal circuits with high-throughput transmission electron microscopy. Nature Communications 11, (2020).

180.

The MICrONS Consortium et al. Functional connectomics spanning multiple areas of mouse visual cortex. Nature 640, 435–447 (2025).

181.

White, J. G., Southgate, E., Thomson, J. N. & Brenner, S. The structure of the nervous system of the nematode caenorhabditis elegans. Philosophical Transactions of the Royal Society of London. B, Biological Sciences 314, 1–340 (1986).

182.

Celii, B. et al. NEURD offers automated proofreading and feature extraction for connectomics. Nature 640, 487–496 (2025).

183.

Haehn, D., Kaynig, V., Tompkin, J., Lichtman, J. W. & Pfister, H. Guided proofreading of automatic segmentations for connectomics. in 2018 IEEE/CVF conference on computer vision and pattern recognition 9319–9328 (2018). doi:10.1109/CVPR.2018.00971.

184.

Januszewski, M. et al. High-precision automated reconstruction of neurons with flood-filling networks. Nature Methods 15, 605–610 (2018).

185.

Buhmann, J. et al. Automatic detection of synaptic partners in a whole-brain drosophila electron microscopy data set. Nature Methods 18, 771–774 (2021).

186.

Azevedo, A. et al. Connectomic reconstruction of a female drosophila ventral nerve cord. Nature 631, 360–368 (2024).

187.

Eckstein, N. et al. Neurotransmitter classification from electron microscopy images at synaptic sites in drosophila melanogaster. Cell 187, 2574–2594.e23 (2024).

188.

Shapson-Coe, A. et al. A petavoxel fragment of human cerebral cortex reconstructed at nanoscale resolution. Science 384, eadk4858 (2024).

189.

Helmstaedter, M. Synaptic-resolution connectomics: Towards large brains and connectomic screening. Nature Reviews Neuroscience 27, 101–120 (2026).

190.

Januszewski, M. & Jain, V. Next-generation AI for connectomics. Nature Methods 21, 1398–1399 (2024).

191.

Berger, C. et al. Cryo-electron tomography on focused ion beam lamellae transforms structural cell biology. Nature Methods 20, 499–511 (2023).

192.

Chen, M. et al. A complete data processing workflow for cryo-ET and subtomogram averaging. Nature Methods 16, 1161–1168 (2019).

193.

Young, L. N. & Villa, E. Bringing structure to cell biology with cryo-electron tomography. Annual Review of Biophysics 52, 573–595 (2023).

194.

Eisenstein, F., Fukuda, Y. & Danev, R. Smart parallel automated cryo-electron tomography. Nature Methods 21, 1612–1615 (2024).

195.

Rangan, R. et al. CryoDRGN-ET: Deep reconstructing generative networks for visualizing dynamic biomolecules inside cells. Nature Methods 21, 1537–1545 (2024).

196.

Teresa-Trueba, I. de et al. Convolutional networks for supervised mining of molecular patterns within cellular context. Nature Methods 20, 284–294 (2023).

197.

Liu, G. et al. DeepETPicker: Fast and accurate 3D particle picking for cryo-electron tomography using weakly supervised deep learning. Nature Communications 15, (2024).

198.

Rice, G. et al. TomoTwin: Generalized 3D localization of macromolecules in cryo-electron tomograms with structural data mining. Nature Methods 20, 871–880 (2023).

199.

Lamm, L. et al. MemBrain v2: An end-to-end tool for the analysis of membranes in cryo-electron tomography. bioRxiv (2025) doi:10.1101/2024.01.05.574336.

200.

Burn, G. L. et al. Myeloperoxidase transforms chromatin into neutrophil extracellular traps. Nature 647, 747–756 (2025).

201.

Nogales, E. & Mahamid, J. Bridging structural and cell biology with cryo-electron microscopy. Nature 628, 47–56 (2024).

202.

McVeigh, B. M. et al. Visualization of lysosomal membrane proteins by cryo electron tomography. Nature Communications 16, (2025).

203.

Powell, B. M., Brant, T. S., Davis, J. H. & Mosalaganti, S. Rapid structural analysis of bacterial ribosomes in situ. Communications Biology 8, (2025).

204.

Watson, A. J. I. & Bartesaghi, A. Advances in cryo-ET data processing: Meeting the demands of visual proteomics. Current Opinion in Structural Biology 87, 102861 (2024).

205.

Nickell, S., Kofler, C., Leis, A. P. & Baumeister, W. A visual approach to proteomics. Nature Reviews Molecular Cell Biology 7, 225–230 (2006).

206.

Keller, P. J., Schmidt, A. D., Wittbrodt, J. & Stelzer, E. H. K. Reconstruction of zebrafish early embryonic development by scanned light sheet microscopy. Science 322, 1065–1069 (2008).

207.

Krzic, U., Gunther, S., Saunders, T. E., Streichan, S. J. & Hufnagel, L. Multiview light-sheet microscope for rapid in toto imaging. Nature Methods 9, 730–733 (2012).

208.

Yang, B. et al. DaXi—high-resolution, large imaging volume and multi-view single-objective light-sheet microscopy. Nature Methods 19, 461–469 (2022).

209.

Chai, B., Efstathiou, C., Yue, H. & Draviam, V. M. Opportunities and challenges for deep learning in cell dynamics research. Trends in Cell Biology 34, 955–967 (2024).

210.

Malin-Mayor, C. et al. Automated reconstruction of whole-embryo cell lineages by learning from sparse annotations. Nature Biotechnology 41, 44–49 (2023).

211.

Bragantini, J. et al. Ultrack: Pushing the limits of cell tracking across biological scales. Nature Methods 22, 2423–2436 (2025).

212.

Wang, M. et al. High-fidelity long-term whole-embryo lineage and fate reconstruction by iterative tracking with error correction. bioRxiv (2026) doi:10.64898/2026.03.12.711203.

213.

Huijben, T. A. P. M. et al. inTRACKtive: A web-based tool for interactive cell tracking visualization. Nature Methods 22, 2229–2231 (2025).

214.

Lange, M. et al. A multimodal zebrafish developmental atlas reveals the state-transition dynamics of late-vertebrate pluripotent axial progenitors. Cell 187, 6742–6759.e17 (2024).

215.

Amat, F. & Keller, P. J. Towards comprehensive cell lineage reconstructions in complex organisms using light-sheet microscopy. Development, Growth & Differentiation 55, 563–578 (2013).

216.

Belthangady, C. & Royer, L. A. Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction. Nature Methods 16, 1215–1225 (2019).

217.

Qu, L. et al. Self-inspired learning for denoising live-cell super-resolution microscopy. Nature Methods 21, 1895–1908 (2024).

218.

Gritti, N., Power, R. M., Graves, A. & Huisken, J. Image restoration of degraded time-lapse microscopy data mediated by near-infrared imaging. Nature Methods 21, 311–321 (2024).

219.

Ounkomol, C., Seshamani, S., Maleckar, M. M., Collman, F. & Johnson, G. R. Label-free prediction of three-dimensional fluorescence images from transmitted-light microscopy. Nature Methods 15, 917–920 (2018).

220.

Christiansen, E. M. et al. In silico labeling: Predicting fluorescent labels in unlabeled images. Cell 173, 792–803.e19 (2018).

221.

Liu, Z. et al. Robust virtual staining of landmark organelles with cytoland. Nature Machine Intelligence 7, 901–915 (2025).

222.

Elmalam, N. & Zaritsky, A. Cell context-dependent in silico organelle localization in label-free microscopy images. Nature Methods 23, 405–416 (2026).

223.

Huang, L. et al. A robust and scalable framework for hallucination detection in virtual tissue staining and digital pathology. Nature Biomedical Engineering 9, 2196–2214 (2025).

224.

Liu, T., Liu, J., Li, D. & Tan, S. Bayesian deep-learning structured illumination microscopy enables reliable super-resolution imaging with uncertainty quantification. Nature Communications 16, (2025).

225.

Rates, A., Passmore, J. B., Norlin, N. & Kapitein, L. C. Smart microscopy: Adaptive microscope control to improve the way we see life. npj Imaging 4, (2026).

226.

Hinderling, L. et al. Smart microscopy: Current implementations and a roadmap for interoperability. Methods in Microscopy 3, 71–91 (2026).

227.

Oquab, M. et al. DINOv2: Learning robust visual features without supervision. (2024).

228.

Siméoni, O. et al. DINOv3. (2025) doi:10.48550/arXiv.2508.10104.

229.

Pham, C., Caicedo, J. C. & Plummer, B. A. ChA-MAEViT: Unifying channel-aware masked autoencoders and multi-channel vision transformers for improved cross-channel learning. (2025) doi:10.48550/arXiv.2503.19331.

230.

Moutakanni, T. et al. Cell-DINO: Self-supervised image-based embeddings for cell fluorescent microscopy. PLOS Computational Biology 21, e1013828 (2025).

231.

Kenyon-Dean, K. et al. ViTally consistent: Scaling biological representation learning for cell microscopy. in Proceedings of the 42nd international conference on machine learning (eds Singh, A. et al.) vol. 267 29735–29752 (PMLR, 2025).

232.

Qiao, C. et al. A neural network for long-term super-resolution imaging of live cells with reliable confidence quantification. Nature Biotechnology 44, 110–119 (2026).

233.

Zinchenko, V., Hugger, J., Uhlmann, V., Arendt, D. & Kreshuk, A. MorphoFeatures for unsupervised exploration of cell types, tissues, and organs in volume electron microscopy. eLife 12, e80918 (2023).

234.

Gupta, A. et al. SubCell: Proteome-aware vision foundation models for microscopy capture single-cell biology. bioRxiv (2026) doi:10.1101/2024.12.06.627299.

235.

Tao, Y. et al. Inferring cellular contractile forces and work using deep morphology traction microscopy. Biophysical Journal 123, 3217–3230 (2024).

236.

Ichbiah, S., Delbary, F., McDougall, A., Dumollard, R. & Turlier, H. Embryo mechanics cartography: Inference of 3D force atlases from fluorescence microscopy. Nature Methods 20, 1989–1999 (2023).

237.

Boyer, T., Nery, E. del, Spassky, N. & Genovesio, A. Static2Dynamic: Reconstructing videos of unobservable cellular, developmental, and disease processes. bioRxiv (2026) doi:10.64898/2026.05.18.725860.

238.

Padhi, A. et al. Deep learning reveals how cells pull, buckle, and navigate fibrous environments. Proceedings of the National Academy of Sciences 122, e2424047122 (2025).

239.

Weisbart, E. et al. Cell painting gallery: An open resource for image-based profiling. Nature Methods 21, 1775–1777 (2024).

240.

Chandrasekaran, S. N. et al. Three million images and morphological profiles of cells treated with matched chemical and genetic perturbations. Nature Methods 21, 1114–1121 (2024).

241.

Way, G. P. et al. Morphology and gene expression profiling provide complementary information for mapping cell state. Cell Systems 13, 911–923.e9 (2022).

242.

Saunders, R. A. et al. Perturb-multimodal: A platform for pooled genetic screens with imaging and sequencing in intact mammalian tissue. Cell 188, 4790–4809.e22 (2025).

243.

Gu, J. et al. Mapping multimodal phenotypes to perturbations in cells and tissue with CRISPRmap. Nature Biotechnology 43, 1101–1115 (2024).

244.

Wang, X. et al. Prediction of cellular morphology changes under perturbations with a transcriptome-guided diffusion model. Nature Communications 16, 8210 (2025).

245.

Bendidi, I. et al. A cross modal knowledge distillation & data augmentation recipe for improving transcriptomics representations through morphological features. in Proceedings of the 42nd international conference on machine learning (eds Singh, A. et al.) vol. 267 3712–3730 (PMLR, 2025).

246.

Sanchez-Fernandez, A., Rumetshofer, E., Hochreiter, S. & Klambauer, G. CLOOME: Contrastive learning unlocks bioimaging databases for queries with chemical structures. Nature Communications 14, 7339 (2023).

247.

Zhang, P., Gao, C., Hua, K., Zhang, Z. & Li, S. Systematically decoding pathological morphologies and molecular profiles with unified multimodal embedding. Nature Methods 23, 903–908 (2026).

248.

Bunne, C. et al. How to build the virtual cell with artificial intelligence: Priorities and opportunities. Cell 187, 7045–7063 (2024).

249.

Adduri, A. K. et al. Predicting cellular responses to perturbation across diverse contexts with State. bioRxiv (2025) doi:10.1101/2025.06.26.661135.

250.

He, S. et al. Squidiff: Predicting cellular development and responses to perturbations using a diffusion model. Nature Methods 23, 65–77 (2026).

251.

Dong, M. et al. Stack: In-context learning of single-cell biology. bioRxiv (2026) doi:10.64898/2026.01.09.698608.

252.

Nature Biotechnology. Minimal life by computer. Nature Biotechnology 44, 493–494 (2026).

253.

Daetwyler, S. & Fiolka, R. P. Light-sheets and smart microscopy, an exciting future is dawning. Communications Biology 6, (2023).

254.

Shaked, N. T., Boppart, S. A., Wang, L. V. & Popp, J. Label-free biomedical optical imaging. Nature Photonics 17, 1031–1041 (2023).

255.

Meijering, E. Cell segmentation: 50 years down the road [life sciences]. IEEE Signal Processing Magazine 29, 140–145 (2012).

256.

Carpenter, A. E. et al. CellProfiler: Image analysis software for identifying and quantifying cell phenotypes. Genome Biology 7, (2006).

257.

Neha, F., Bhati, D., Shukla, D. K. & Amiruzzaman, M. From classical techniques to convolution-based models: A review of object detection algorithms. (2024).

258.

Huang, K. & Murphy, R. F. From quantitative microscopy to automated image understanding. Journal of Biomedical Optics 9, 893 (2004).

259.

Rohban, M. H. et al. Systematic morphological profiling of human gene and allele function via cell painting. eLife 6, (2017).

260.

Boland, M. V. & Murphy, R. F. A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells. Bioinformatics 17, 1213–1223 (2001).

261.

Murphy, R. F., Velliste, M. & Porreca, G. Robust classification of subcellular location patterns in fluorescence microscope images. in Proceedings of the 12th IEEE workshop on neural networks for signal processing 67–76 (2022). doi:10.1109/nnsp.2002.1030018.

262.

Chen, X., Velliste, M. & Murphy, R. F. Automated interpretation of subcellular patterns in fluorescence microscope images for location proteomics. Cytometry Part A 69A, 631–640 (2006).

263.

Rosenblatt, F. The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review 65, 386–408 (1958).

264.

Cortes, C. & Vapnik, V. Support-vector networks. Machine Learning 20, 273–297 (1995).

265.

Yuan, G.-X., Ho, C.-H. & Lin, C.-J. Recent advances of large-scale linear classification. Proceedings of the IEEE 100, 2584–2603 (2012).

266.

Bishop, C. Pattern Recognition and Machine Learning. (Springer, 2006).

267.

Jones, T. R. et al. CellProfiler analyst: Data exploration and analysis software for complex image-based screens. BMC Bioinformatics 9, (2008).

268.

Shariff, A., Kangas, J., Coelho, L. P., Quinn, S. & Murphy, R. F. Automated image analysis for high-content screening and analysis. SLAS Discovery 15, 726–734 (2010).

269.

Dao, D. et al. CellProfiler analyst: Interactive data exploration, analysis and classification of large biological image sets. Bioinformatics 32, 3210–3212 (2016).

270.

Mahecic, D. et al. Event-driven acquisition for content-enriched microscopy. Nature Methods 19, 1262–1267 (2022).

271.

Alvelid, J., Damenti, M., Sgattoni, C. & Testa, I. Event-triggered STED imaging. Nature Methods 19, 1268–1275 (2022).

272.

Morgado, L., Gómez-de-Mariscal, E., Heil, H. S. & Henriques, R. The rise of data-driven microscopy powered by machine learning. Journal of Microscopy 295, 85–92 (2024).

273.

Conrad, C. et al. Micropilot: Automation of fluorescence microscopy–based imaging for systems biology. Nature Methods 8, 246–249 (2011).

274.

Girshick, R., Donahue, J., Darrell, T. & Malik, J. Rich feature hierarchies for accurate object detection and semantic segmentation. in 2014 IEEE conference on computer vision and pattern recognition 580–587 (2014). doi:10.1109/cvpr.2014.81.

275.

Jones, T. R. et al. Scoring diverse cellular morphologies in image-based screens with iterative feedback and machine learning. Proceedings of the National Academy of Sciences 106, 1826–1831 (2009).

276.

Deng, J. et al. ImageNet: A large-scale hierarchical image database. in 2009 IEEE conference on computer vision and pattern recognition 248–255 (2009). doi:10.1109/cvpr.2009.5206848.

277.

Russakovsky, O. et al. ImageNet large scale visual recognition challenge. International Journal of Computer Vision 115, 211–252 (2015).

278.

Redmon, J., Divvala, S., Girshick, R. & Farhadi, A. You only look once: Unified, real-time object detection. in 2016 IEEE conference on computer vision and pattern recognition (CVPR) 779–788 (2016). doi:10.1109/cvpr.2016.91.

279.

He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. in 2016 IEEE conference on computer vision and pattern recognition (CVPR) 770–778 (2016). doi:10.1109/cvpr.2016.90.

280.

Sung, K.-K. & Poggio, T. Example-based learning for view-based human face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 39–51 (1998).

281.

Rowley, H. A., Baluja, S. & Kanade, T. Neural network-based face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 23–38 (1998).

282.

Viola, P. & Jones, M. Rapid object detection using a boosted cascade of simple features. in Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001 vol. 1 I-511-I-518.

283.

Cireşan, D. C., Giusti, A., Gambardella, L. M. & Schmidhuber, J. Mitosis detection in breast cancer histology images with deep neural networks. in Lecture notes in computer science 411–418 (Springer Berlin Heidelberg, Berlin, Heidelberg, 2013). doi:10.1007/978-3-642-40763-5_51.

284.

Girshick, R. Fast R-CNN. in 2015 IEEE international conference on computer vision (ICCV) 1440–1448 (2015). doi:10.1109/iccv.2015.169.

285.

Ren, S., He, K., Girshick, R. & Sun, J. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 39, 1137–1149 (2017).

286.

Redmon, J. & Farhadi, A. YOLOv3: An incremental improvement. (2018).

287.

Bochkovskiy, A., Wang, C.-Y. & Liao, H.-Y. M. YOLOv4: Optimal speed and accuracy of object detection. (2020).

288.

Tian, Y., Ye, Q. & Doermann, D. YOLOv12: Attention-centric real-time object detectors. (2025).

289.

Jocher, G. et al. Ultralytics YOLO26: Unified real-time end-to-end vision models. (2026).

290.

Wang, A. et al. YOLOv10: Real-time end-to-end object detection. in Advances in neural information processing systems 37 107984–108011 (2024). doi:10.52202/079017-3429.

291.

Vaswani, A. et al. Attention is All you Need. in Advances in Neural Information Processing Systems vol. 30 (Curran Associates, Inc., 2017).

292.

Alexey Dosovitskiy et al. An image is worth 16x16 words: Transformers for image recognition at scale. in International conference on learning representations (ICLR) (2021).

293.

Carion, N. et al. End-to-end object detection with transformers. in Lecture notes in computer science 213–229 (Springer International Publishing, Cham, 2020). doi:10.1007/978-3-030-58452-8_13.

294.

Zhao, Y. et al. DETRs beat YOLOs on real-time object detection. in 2024 IEEE/CVF conference on computer vision and pattern recognition (CVPR) 16965–16974 (2024). doi:10.1109/cvpr52733.2024.01605.

295.

Shi, Y. et al. Smart lattice light-sheet microscopy for imaging rare and complex cellular events. Nature Methods 21, 301–310 (2024).

296.

Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Computation 9, 1735–1780 (1997).

297.

Stepp, W. L. et al. Smart hybrid microscopy for cell-friendly detection of rare events. Nature Communications 17, (2026).

298.

Nie, W.-Z., Li, W.-H., Liu, A.-A., Hao, T. & Su, Y.-T. 3D convolutional networks-based mitotic event detection in time-lapse phase contrast microscopy image sequences of stem cell populations. in 2016 IEEE conference on computer vision and pattern recognition workshops (CVPRW) 1359–1366 (2016). doi:10.1109/cvprw.2016.171.

299.

Meijering, E. A bird’s-eye view of deep learning in bioimage analysis. Computational and Structural Biotechnology Journal 18, 2312–2325 (2020).

300.

Sofroniew, N. et al. Napari: A multi-dimensional image viewer for python. Zenodo https://doi.org/10.5281/zenodo.21361474 (2026).

301.

Zhou, Z.-H. A brief introduction to weakly supervised learning. National Science Review 5, 44–53 (2018).

302.

Griebel, M. et al. Deep learning-enabled segmentation of ambiguous bioimages with deepflash2. Nature Communications 14, (2023).

303.

Rumelhart, D. E., Hinton, G. E. & Williams, R. J. Learning representations by back-propagating errors. Nature 323, 533–536 (1986).

304.

Yu, J., Jiang, Y., Wang, Z., Cao, Z. & Huang, T. UnitBox: An advanced object detection network. in Proceedings of the 24th ACM international conference on multimedia 516–520 (2016). doi:10.1145/2964284.2967274.

305.

Rezatofighi, H. et al. Generalized intersection over union: A metric and a loss for bounding box regression. in 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR) 658–666 (2019). doi:10.1109/cvpr.2019.00075.

306.

Lin, T.-Y., Goyal, P., Girshick, R., He, K. & Dollar, P. Focal loss for dense object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 42, 318–327 (2020).

307.

He, K., Gkioxari, G., Dollar, P. & Girshick, R. Mask R-CNN. in 2017 IEEE international conference on computer vision (ICCV) 2980–2988 (2017). doi:10.1109/iccv.2017.322.

308.

Ibrahim, K. A. et al. Self-driving microscopy detects the onset of protein aggregation and enables intelligent brillouin imaging. Nature Communications 16, (2025).

309.

Hockenberry, M. A. & Legant, W. R. Cells in the mechanical spotlight. Biophysical Journal 121, 3571–3572 (2022).

310.

Daetwyler, S. et al. Imaging of cellular dynamics from a whole organism to subcellular scale with self-driving, multiscale microscopy. Nature Methods 22, 569–578 (2025).

311.

Friedman, J., Hastie, T. & Tibshirani, R. Additive logistic regression: A statistical view of boosting (with discussion and a rejoinder by the authors). The Annals of Statistics 28, (2000).