Agent clicks and types at incorrect coordinates on dynamic views (elements visually shifted) #353
Description
Issue Type
Agent Issue
Operating System
Windows
Description of the bug
Environment
- Product: BrowserOS (agent-driven web automation)
- Target Web App: CCH® Tagetik (modal parameter form)
Description
When the BrowserOS agent interacts with dynamic pages (e.g., Tagetik modal parameter dialog), it clicks and types at the wrong screen locations. It appears the agent believes fields are in coordinates that don’t match their actual rendered positions. This misalignment causes the agent to click empty space or other controls, failing form completion.
The issue is especially visible in modals with dropdowns/inputs rendered after layout shifts or frame transitions.
Impact
Automation fails to select mandatory parameters (Entity, Scenario, Period, Period Length, Currency, Management Category).
Blocks report execution workflows; manual intervention is required.
Affects reliability of BrowserOS in apps with modals, responsive containers, or lazy-loaded panels.
Steps to Reproduce
- Open Tagetik → Browse reports → open report Choose report
- Trigger modal “Select the value of the run parameters”.
- Instruct BrowserOS to populate required fields and press OK.
- Observe the agent’s clicks/typing (e.g., trying to open dropdowns).
- Actual: Clicks land offset from visible controls; typing goes to the wrong field or nowhere.
- Expected: Agent should click within each visible input/dropdown and type/select in the correct field.
Screenshots / Videos
BrowserOS Version
142.0.7565.49
Additional Context
The screenshot shows BrowserOS clicking and typing 12 which is value for field "Period" but this is completely off. Not where the fields are located.