# OpenAppTaskEval

AndroidWorld, 2026-11-09. Agent: Lusor, model: DeepSeek V4.1 Flash (low).

## Goal

Open the contacts app. Clear any pop-ups that may appear by granting all permissions that are required.

## Result
- Mobilerun's grader: pass
- Google's grader: pass
- Lusor time: 24.2 s; Mobilerun published time: 178.4 s (7.4x faster)
- Lusor model cost: $0.0090; Mobilerun estimated cost: ~$0.46
- Lusor tool calls: 10; Mobilerun published actions: 6
- App skills: none read

## Final report

The Contacts app is open and clear of pop-ups: I granted the one permission prompt it showed (notifications) and dismissed the account settings tooltip, leaving the app on its Contacts list ("No contacts yet").

## Steps (10; times are seconds into the video)

| # | Start | End | Tool | OK | Note |
|---|---|---|---|---|---|
| 1 | 30.05 | 30.06 | get_ui_state | yes | Observe current screen to find contacts app |
| 2 | 31.22 | 33.16 | swipe | yes | Open app drawer to find Contacts app |
| 3 | 33.85 | 34.75 | tap_element | yes | Tap Contacts icon to launch app |
| 4 | 35.76 | 35.76 | get_ui_state | yes | Read contacts app screen / permission dialog |
| 5 | 36.71 | 40.17 | tap_element | yes | Tap Allow on permission dialog |
| 6 | 41.48 | 42.46 | tap | yes | Dismiss tooltip pop-up by tapping outside it |
| 7 | 43.68 | 44.78 | key | yes | Press back to dismiss tooltip overlay |
| 8 | 45.83 | 46.47 | tap_element | yes | Relaunch Contacts app |
| 9 | 48.05 | 48.07 | get_ui_state | yes | Confirm contacts app is open with no pop-ups remaining |
| 10 | 49.95 | 49.96 | done | yes | Task complete; no further steps |

## Files
- Video: video.mp4 (H.264), video.webm (VP9); poster: poster.webp
- Data: task.json, steps.json