Skip to content

Commit ac627c1

Browse files
clink42The android_world Authors
authored and
The android_world Authors
committed
Add UI Elements to M3A's output.
PiperOrigin-RevId: 688681270
1 parent 7c278be commit ac627c1

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

android_world/agents/m3a.py

+2
Original file line numberDiff line numberDiff line change
@@ -367,6 +367,7 @@ def step(self, goal: str) -> base_agent.AgentInteractionResult:
367367
step_data = {
368368
'raw_screenshot': None,
369369
'before_screenshot_with_som': None,
370+
'before_ui_elements': [],
370371
'after_screenshot_with_som': None,
371372
'action_prompt': None,
372373
'action_output': None,
@@ -385,6 +386,7 @@ def step(self, goal: str) -> base_agent.AgentInteractionResult:
385386
physical_frame_boundary = self.env.physical_frame_boundary
386387

387388
before_ui_elements = state.ui_elements
389+
step_data['before_ui_elements'] = before_ui_elements
388390
before_ui_elements_list = _generate_ui_elements_description_list(
389391
before_ui_elements, logical_screen_size
390392
)

0 commit comments

Comments
 (0)