Results 1 to 10 of about 10,352,216 (337)

BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models [PDF]

International Conference on Machine Learning, 2023
The cost of vision-and-language pre-training has become increasingly prohibitive due to end-to-end training of large-scale models. This paper proposes BLIP-2, a generic and efficient pre-training strategy that bootstraps vision-language pre-training from
Junnan Li, Dongxu Li, S. Savarese, Steven C. H. Hoi   +3 more
semanticscholar   +1 more source

Adding Conditional Control to Text-to-Image Diffusion Models [PDF]

IEEE International Conference on Computer Vision, 2023
We present ControlNet, a neural network architecture to add spatial conditioning controls to large, pretrained text-to-image diffusion models. ControlNet locks the production-ready large diffusion models, and reuses their deep and robust encoding layers ...
Lvmin Zhang, Anyi Rao, Maneesh Agrawala
semanticscholar   +1 more source

High-Resolution Image Synthesis with Latent Diffusion Models [PDF]

Computer Vision and Pattern Recognition, 2021
By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a guiding mechanism
Robin Rombach, A. Blattmann, Dominik Lorenz, Patrick Esser, B. Ommer   +4 more
semanticscholar   +1 more source

Hierarchical Text-Conditional Image Generation with CLIP Latents [PDF]

arXiv.org, 2022
Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style. To leverage these representations for image generation, we propose a two-stage model: a prior that generates a CLIP image ...
A. Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, Mark Chen   +4 more
semanticscholar   +1 more source

Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding [PDF]

Neural Information Processing Systems, 2022
We present Imagen, a text-to-image diffusion model with an unprecedented degree of photorealism and a deep level of language understanding. Imagen builds on the power of large transformer language models in understanding text and hinges on the strength ...
Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L. Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. S. Mahdavi, Raphael Gontijo Lopes, Tim Salimans, Jonathan Ho, David J. Fleet, Mohammad Norouzi   +13 more
semanticscholar   +1 more source

TIAToolbox as an end-to-end library for advanced tissue image analytics

Communications Medicine, 2022
Pocock, Graham et al. present TIAToolbox, a Python toolbox for computational pathology. The extendable library can be used for data loading, pre-processing, model inference, post-processing, and visualization.
Johnathan Pocock, Simon Graham, Quoc Dang Vu, Mostafa Jahanifar, Srijay Deshpande, Giorgos Hadjigeorghiou, Adam Shephard, Raja Muhammad Saad Bashir, Mohsin Bilal, Wenqi Lu, David Epstein, Fayyaz Minhas, Nasir M. Rajpoot, Shan E Ahmed Raza   +13 more
doaj   +1 more source

Analyzing and Improving the Image Quality of StyleGAN [PDF]

Computer Vision and Pattern Recognition, 2019
The style-based GAN architecture (StyleGAN) yields state-of-the-art results in data-driven unconditional generative image modeling. We expose and analyze several of its characteristic artifacts, and propose changes in both model architecture and training
Tero Karras, S. Laine, M. Aittala, Janne Hellsten, J. Lehtinen, Timo Aila   +5 more
semanticscholar   +1 more source

DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation [PDF]

Computer Vision and Pattern Recognition, 2022
Large text-to-image models achieved a remarkable leap in the evolution of AI, enabling high-quality and diverse synthesis of images from a given text prompt.
Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Y. Pritch, Michael Rubinstein, Kfir Aberman   +5 more
semanticscholar   +1 more source

Foldover Features for Dynamic Object Behaviour Description in Microscopic Videos

IEEE Access, 2020
A behavior description helps analyze tiny objects, similar objects, objects with weak visual information, and objects with similar visual information. It plays a fundamental role in the identification and classification of dynamic objects in microscopic ...
Xialin Li, Chen Li, Frank Kulwa, Md Mamunur Rahaman, Wenwei Zhao, Xue Wang, Dan Xue, Yudong Yao, Yilin Cheng, Jindong Li, Shouliang Qi, Tao Jiang   +11 more
doaj   +1 more source

An Enhanced Framework of Generative Adversarial Networks (EF-GANs) for Environmental Microorganism Image Augmentation With Limited Rotation-Invariant Training Data

IEEE Access, 2020
The main obstacle to image augmentation with Generative Adversarial Networks (GANs) is the need for a large amount of training data, but this is difficult for small datasets like Environmental Microorganisms (EMs). EM image analysis plays a vital role in
Hao Xu, Chen Li, Md Mamunur Rahaman, Yudong Yao, Zihan Li, Jinghua Zhang, Frank Kulwa, Xin Zhao, Shouliang Qi, Yueyang Teng   +9 more
doaj   +1 more source