---
base_model: unsloth/Llama-3.2-11B-Vision-Instruct
library_name: peft
license: mit
language:
- en
tags:
- chemistry
- text-generation-inference
- llama-3
- llama
- meta
- facebook
- atomgpt
- transformers
- multimodal
- vision
- pytorch
pipeline_tag: text-generation
---


# MicroscopyGPT: Generating Atomic-Structure Captions from Microscopy Images of 2D Materials with Vision-Language Transformers

<!-- Provide a quick summary of what the model is/does. -->


<!-- Provide a longer summary of what this model is. -->


GitHub: [https://github.com/atomgptlab/atomgpt](https://github.com/atomgptlab/atomgpt)


[Example colab notebook](https://colab.research.google.com/github/knc6/jarvis-tools-notebooks/blob/master/jarvis-tools-notebooks/MicroscopyGPT.ipynb)




Reference: [Choudhary, K. (2025). MicroscopyGPT: Generating Atomic-Structure Captions from Microscopy Images of 2D Materials with Vision-Language Transformers, ChemArxiv.](https://doi.org/10.26434/chemrxiv-2025-gblz7)

- 
### Framework versions

- PEFT 0.11.1