Wxpython: Set Cursor To Absolute Screen Location And Click

January 23, 2024 Post a Comment

I'm having a little trouble trying to get WarpPointer to work out appropriately for me. The scenario I'm trying to do is akin to recording a user's clicks and then replaying them

Solution 1:

I don't think you can do this in wxPython alone. wx.Window.WarpPointer() can only move the mouse to an area controlled by that window, as you've discovered. Similarly, you're wx.EVT_LEFT_DOWN call won't work because you're setting the ID to the window, meaning it's the window that was clicked, not a click at (x,y).

After some light Googling and I found this article on Unit Testing in wxPython that breifly talks about testing at the GUI level. This isn't exactly what you're trying to do, but it is conceptually similiar. They suggest using an external library to manipulate the interface. The main problem they note about this approach is that most of the tools for simulation GUI interaction are under corporate licenses and/or platform dependent.

That article suggests using pywinauto for Windows systems. For your purposes, pywinauto.controls.HwndWrapper seems to have the methods you require; MoveMouse() and Click(). If you aren't using Windows or if you need cross-platform support you will need to research different libraries.

Basically, you will need to install and import pywinauto into your wxPython application and call its methods instead of wxPython's. As long as cross-platform compatibility is not an issue I think this is your simplest, best solution.

Solution 2:

wxPython only has control of the cursor when it's over a wxPython generated window, frame or widget. When you leave the confines of your wxPython application, it loses control of the mouse. You'll have to hook into the OS at that point. On Windows, the PyWin32 package is probably your best bet.

Baca Juga

There's also a cool little project called sikuli that might work too if you can figure out how to take a screenshot of the screen: http://sikuli.org/

Solution 3:

I have created the open source application JW_Record_Playback to be used as a record playback mechanism in python wxwindows. It actually uses TK / TCL as the external resource. It works fine on Linux (Tested both in the Suse and the Ubuntu distribution).

Please check: http://members.home.nl/wijnenjl/Record_Playback_Python_TclTk_INI_Wx_EN_01.html