随着多模态大语言模型（MLLM）的飞速发展，能够像人类一样通过视觉输入操作图形用户界面（GUI）的智能体（Agent）正逐渐成为现实。然而，在通往通用计算机控制的道路上，如何让模型精准地将自然语言指令对应到屏幕上的具体元素 —— 即 GUI ...

在更接近真实场景的MobileWorld测试集上，MAI-UI-235B-A22B整体成功率41.7%，比其他端到端模型高出20.8个百分点。在需要主动询问用户的任务上成功率37.5%，在需要调用MCP工具的任务上成功率51.1%，分别比之前最好的成绩高出32.1和18.7个百分点。

In 'Road signs for physicians,' I've told you six weeks ago that French researchers had developed a new iconic drug information system named VCM, short for 'Visualization of Medical Knowledge.' Now, ...

A graphical user interface (or GUI, often pronounced "gooey"), is a particular case of user interface for interacting with a computer which employs graphical images and widgets in addition to text to ...

A graphical user interface (GUI) allows users to interact with graphics appearing on electronic devices (eg, smartphones, tablets and netbooks). Typically, a user interacts with a GUI by pressing ...

It wasn't just cost and Moore's law. The graphical user interface -- now known as the GUI ("gooey") -- is what really made computing widespread, personal and ubiquitous. Its friendly icons and ...

Software that lets a programmer or user develop a graphical user interface by dragging and dropping icons from a toolbar onto the interface window and editing them with graphics tools. Behind the ...

User interfaces on many products such as mobile phones, MP3 players, portable games, and industrial and in-home control monitors are becoming ever more visually and graphically interactive. Graphical ...

Sabre Travel Network reports it has launched its enhanced graphical capabilities in Sabre Red Workspace. Last month, Sabre began the global roll out of graphical view, giving Sabre-connected agencies ...