You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Bug] Screen tree lists no windows while a menu-bar popover is open (Control Center, MenuBarExtra panels) #142
Tool: VMPal 0.123 (build 123), VMPal Tools 0.42 in the guest Host: macOS 27.2.1 (26B131), Apple silicon Guest: macOS 27.2.1 (26B131) VM, fixed display 1440x900@2x, VMPal Tools allowed in
Privacy & Security › Device Control and Data Access (vmpal ui <VM> status → "screenTree": true) Date: 2026-11-19 (times below are UTC)
Summary
With an open menu-bar popover on screen — Apple's own Control Center, or a third-party
app's status-item panel (SwiftUI MenuBarExtra with .menuBarExtraStyle(.window)) — vmpal ui <VM> tree (and the MCP vmpal_tree / vmpal_act with observe: "tree") reports "No windows." / "windows": []. Only the menu bar items, Dock items and notifications
come back. The popover's controls (buttons, rows, text) cannot be read or targeted, so an
agent must fall back to screenshots and OCR for anything in a menu-bar popover.
Ordinary app windows are read fine in the same session (e.g. a regular Window of the
same app lists all its buttons with names and states).
Steps to reproduce
macOS VM with VMPal Tools 0.42 granted Device Control and Data Access; agent control on.
vmpal ui <VM> tree → note the shell elements (menu bar items) are listed.
Click the Control Center menu bar item, e.g. vmpal ui <VM> click 1120 13 (its position
from the tree: menu bar item "Control Center" (1120,13)). The Control Center popover opens
(screenshot attached).
vmpal ui <VM> tree --window all
Same with any app's status-item panel: open it and run step 4 (we saw it with our own app's MenuBarExtra panel, which CGWindowList reports as an on-screen window of that app at
window layer 101, 320x464 pt).
Expected
The open popover appears as a window (or as a "menu"/"popover" element under the menu bar
item) with its children: e.g. Control Center's Wi-Fi / Bluetooth / AirDrop / Focus toggles,
Display and Sound sliders, "Edit Controls…"; for an app's status-item panel, its buttons
and static texts. These are exposed to Accessibility (VoiceOver can navigate both).
Actual
Screen 1280×800 (screenshot pixels), frame 9. Tree read in 385 ms.
No windows.
macOS's menu bar, notifications and Dock:
e1 menu bar item "Control Center" (1120,13) 23×20
e2 menu bar item "Clock" = "Wed Nov 18 1:52 PM" (1204,13) 116×20
...
vmpal_act with observe: "tree" right after the click returned "windows": [] (frame 32,
2026-11-18T21:52Z) while the popover was visibly open (frame 33 screenshot).
Notes / hypothesis
The windows list seems to come only from regular (layer-0 / frontmost-app) windows. Menu-bar
popovers are owned by a background process (Control Center) or an LSUIElement app and sit at
a popup window level; their AX window is reachable through the owning process's AXWindows
(or via the menu bar item's AXChildren / AXShownMenu), which the tree does not appear to walk.
Impact and workaround
Agents testing menu-bar apps cannot read or click the app's main UI by reference. Workaround:
screenshots + OCR (vmpal ui observe), clicks by text or coordinates, and the window bounds
from CGWindowListCopyWindowInfo run inside the guest.
Attachments
A screenshot of Control Center open at the moment the tree reported no windows, and a VMPal diagnostics zip, are available on request.
Activity