OpenAppTaskEval

AndroidWorld, 2026-11-09. Agent: Lusor, model: DeepSeek V4.1 Flash (low).

GOAL
Open the contacts app. Clear any pop-ups that may appear by granting all permissions that are required.

RESULT
- Mobilerun's grader: pass
- Google's grader: pass
- Lusor time: 24.2 s; Mobilerun published time: 178.4 s (7.4x faster)
- Lusor model cost: $0.0090; Mobilerun estimated cost: ~$0.46
- Lusor tool calls: 10; Mobilerun published actions: 6
- App skills: none read

FINAL REPORT
The Contacts app is open and clear of pop-ups: I granted the one permission prompt it showed (notifications) and dismissed the account settings tooltip, leaving the app on its Contacts list ("No contacts yet").

STEPS (10; seconds into the video)
1. 30.05-30.06 s  get_ui_state  ok  Observe current screen to find contacts app
2. 31.22-33.16 s  swipe  ok  Open app drawer to find Contacts app
3. 33.85-34.75 s  tap_element  ok  Tap Contacts icon to launch app
4. 35.76-35.76 s  get_ui_state  ok  Read contacts app screen / permission dialog
5. 36.71-40.17 s  tap_element  ok  Tap Allow on permission dialog
6. 41.48-42.46 s  tap  ok  Dismiss tooltip pop-up by tapping outside it
7. 43.68-44.78 s  key  ok  Press back to dismiss tooltip overlay
8. 45.83-46.47 s  tap_element  ok  Relaunch Contacts app
9. 48.05-48.07 s  get_ui_state  ok  Confirm contacts app is open with no pop-ups remaining
10. 49.95-49.96 s  done  ok  Task complete; no further steps

FILES
- Video: video.mp4 (H.264), video.webm (VP9); poster: poster.webp
- Data: task.json, steps.json