Skip to content

[Bug] Screen tree lists no windows while a menu-bar popover is open (Control Center, MenuBarExtra panels) #142

Open

Description

@gin419

Tool: VMPal 0.123 (build 123), VMPal Tools 0.42 in the guest
Host: macOS 27.2.1 (26B131), Apple silicon
Guest: macOS 27.2.1 (26B131) VM, fixed display 1440x900@2x, VMPal Tools allowed in
Privacy & Security › Device Control and Data Access (vmpal ui <VM> status → "screenTree": true)
Date: 2026-11-19 (times below are UTC)

Summary

With an open menu-bar popover on screen — Apple's own Control Center, or a third-party
app's status-item panel (SwiftUI MenuBarExtra with .menuBarExtraStyle(.window)) —
vmpal ui <VM> tree (and the MCP vmpal_tree / vmpal_act with observe: "tree") reports
"No windows." / "windows": []. Only the menu bar items, Dock items and notifications
come back. The popover's controls (buttons, rows, text) cannot be read or targeted, so an
agent must fall back to screenshots and OCR for anything in a menu-bar popover.

Ordinary app windows are read fine in the same session (e.g. a regular Window of the
same app lists all its buttons with names and states).

Steps to reproduce

  1. macOS VM with VMPal Tools 0.42 granted Device Control and Data Access; agent control on.
  2. vmpal ui <VM> tree → note the shell elements (menu bar items) are listed.
  3. Click the Control Center menu bar item, e.g. vmpal ui <VM> click 1120 13 (its position
    from the tree: menu bar item "Control Center" (1120,13)). The Control Center popover opens
    (screenshot attached).
  4. vmpal ui <VM> tree --window all

Same with any app's status-item panel: open it and run step 4 (we saw it with our own app's
MenuBarExtra panel, which CGWindowList reports as an on-screen window of that app at
window layer 101, 320x464 pt).

Expected

The open popover appears as a window (or as a "menu"/"popover" element under the menu bar
item) with its children: e.g. Control Center's Wi-Fi / Bluetooth / AirDrop / Focus toggles,
Display and Sound sliders, "Edit Controls…"; for an app's status-item panel, its buttons
and static texts. These are exposed to Accessibility (VoiceOver can navigate both).

Actual

Screen 1280×800 (screenshot pixels), frame 9. Tree read in 385 ms.
No windows.
macOS's menu bar, notifications and Dock:
  e1 menu bar item "Control Center" (1120,13) 23×20
  e2 menu bar item "Clock" = "Wed Nov 18 1:52 PM" (1204,13) 116×20
  ...

vmpal_act with observe: "tree" right after the click returned "windows": [] (frame 32,
2026-11-18T21:52Z) while the popover was visibly open (frame 33 screenshot).

Notes / hypothesis

The windows list seems to come only from regular (layer-0 / frontmost-app) windows. Menu-bar
popovers are owned by a background process (Control Center) or an LSUIElement app and sit at
a popup window level; their AX window is reachable through the owning process's AXWindows
(or via the menu bar item's AXChildren / AXShownMenu), which the tree does not appear to walk.

Impact and workaround

Agents testing menu-bar apps cannot read or click the app's main UI by reference. Workaround:
screenshots + OCR (vmpal ui observe), clicks by text or coordinates, and the window bounds
from CGWindowListCopyWindowInfo run inside the guest.

Attachments

A screenshot of Control Center open at the moment the tree reported no windows, and a VMPal diagnostics zip, are available on request.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions