In the field of geological science, geological maps are a key tool for understanding the earth's surface and underground structures. However, interpreting these complex charts requires expertise and extensive experience. In order to improve the intelligence level in this field, Microsoft Research Asia recently launched a new benchmark set GeoMap-Bench, which is specifically used to evaluate the performance of multimodal large language models (MLLMs) in geological map comprehension.
The launch of GeoMap-Bench marks an important step in the application of artificial intelligence for geological map interpretation. Microsoft researchers conducted in-depth discussions with experts from the Chinese Academy of Geological Sciences and Wuhan University and determined the five key abilities required for geological map understanding: information extraction, positioning, referencing, reasoning and analysis. These capabilities cover multiple aspects from obtaining basic information to performing complex logical tasks, ensuring that AI has a comprehensive understanding of geological maps.
Using more than 7,000 geological maps, the researchers created GeoMap-Bench and generated more than 3,000 questions with standard answers to evaluate the limitations of existing multimodal models in geological map interpretation. Common challenges include processing of high-resolution images, the need for domain knowledge, and a diverse visual representation.
In order to further promote the intelligent analysis of geological maps, Microsoft has also developed GeoMap-Agent, which not only has the ability to digital geological maps, but also has significantly improved in high-resolution image processing and domain knowledge application. The GeoMap-Agent architecture includes three core modules: hierarchical information extraction, domain knowledge injection and enhanced prompt question and answer. The combination of these modules allows AI to efficiently and accurately analyze complex geological information.
Researchers said that the launch of GeoMap-Bench and GeoMap-Agent not only provides a new research foundation for AI applications in the field of geology, but will also greatly promote the digitalization and intelligence of geological information, and have far-reaching impacts on a wider range of fields such as disaster warning and resource exploration.