Skip Navigation

Technology @beehaw.org

Powderhorn @beehaw.org

11mo ago

Anthropic publicly releases AI tool that can take over the user’s mouse cursor

arstechnica.com

Anthropic publicly releases AI tool that can take over the user’s mouse cursor

Some days, continuing to read the news can be stressful.

5 comments

The fact that suddenly it went to watch a leisure website during work... did they use stolen screen recordings from human activity for training? Like if some corporation allowed them to record all the activity of their employees for training
- You mean like Microsoft Recall?
IIRC Windows has an accessibility feature where the cursor jumps to the primary default action in opening dialogs.
Doing it screenshot based seems inefficient if y du could iterate through windows and controls.
- Makes it work universally, even if the gui isn't made with a standard toolkit
  Also it's ai they don't care about efficiency
  
  Yeah this is one of those things where accessibility settings can probably get you 90% there but screenshots and machine learning can probably close the gap somewhat reliably (even if it's much less efficient).