TypeScript SDK
Observe and act
Build portable semantic actions and execute them against the live screen.
Observe
const observation = await device.observe();
console.log(observation.rendered);
console.log(observation.elements);Portable actions
const observation = await device.observe();
const [firstAction] = observation.actions;
if (firstAction) {
await device.act(firstAction);
}Secrets
device.secrets.set("password", process.env.APP_PASSWORD!);
await device.type("%password%", {
field: "Password",
submit: true,
});