|
|
Simulation Step 3 of 15: Focus on One Region and Select ActionFocus on One Region Process This figure shows the result of the Focus on One Region process schematically by focusing on the selected region, which is Navigation Control Tab. This region was selected because it is judged by the process as the region that is most related to the description of the current goal. More specifically, the process took into account the user's background knowledge, that is, this particular user's preference for navigating by means of the tab menu. Action Selection Phase The simulation goes on to the Select Action process, where the selected region is used as input. At first, the the process recognizes objects in the selected region, Navigation Control Tab. Then it elaborates each screen object by using background knowledge, including semantic knowledge about the object and interface conventions specifying eligible actions associated with each object and the anticipated result of performing each action. In this case, the second tab menu item labeled by BOOKS is close to the goal, and thus the process selects "click on BOOKS navigation control tab menu." The site provides a new page, which is a subsite home page. Press Next ==> to proceed.
|