cefsharp系列四:模拟点击

Minor error in trying to simulate MouseLeftDown-MouseLeftUp event in CefSharp browser control

Hello,

I am using the CefSharp webbrowser control. I will explain what I am trying to do:

1. I load in the URL: "https://uniswapv3.flipsidecrypto.com"

2. I find the control which is a SLIDER handle by classname "irs-handle from" successfully! (See red arrow in the image below)

3. I now find the X and Y coordinate for this SLIDER successfully!

4. Now I want to simulate a MouseLeftDown click on this X and Y coordinate, --- and DRAG this SLIDER to the right a bit by calling the MouseLeftUp event with a new X coordinate.

When executing the code. This SLIDER is actually clicked on because the slider changes value a bit. So this part is successful. But it seems that the MouseLeftUp event with the new X coordinate doesn't release the slider to the right.

This is the slider I am trying to move in the URL (The round green handle, - where the red arrow(1,773) in the image below in pointing to)

(As seen in the end of the post I have posted an image of the MouseLeftDown/MouseLeftUp events. Somehow the website will not post the question if I post that code as it is)

I wonder what I could be missing. It has to be a minor detail missing? This is how I try to drag the slider to the right: (+5 to +100)

1. //Now click and drag slider to the right
2. MouseLeftDown(int.Parse(coordx) + 5, int.Parse(coordy) + 5);
3. MouseLeftUp(int.Parse(coordx) + 100, int.Parse(coordy) + 5);

 

Thank you!

1. private void button1_Click(object sender, EventArgs e) { new Thread(moveSlideControl).Start(); }
3. void moveSlideControl()
4. {
5. var scriptTask = browser.EvaluateScriptAsync(@"
6. var play = document.getElementsByClassName('irs-handle from')[0]
7. function findPos(obj)
8. {
9. var curleft = 0;
10. var curtop = 0;
12. if (obj.offsetParent)
13. {
14. do
15. {
16. curleft += obj.offsetLeft;
17. curtop += obj.offsetTop;
18. } while (obj = obj.offsetParent);
20. return { X: curleft,Y: curtop};
21. }
22. }
23. findPos(play)"
24. ).ContinueWith(x =>
25. {
26. // 2. Continue with finding the coordinates and using MouseClick method
27. // for pressing left mouse button down and releasing it at desired end position.
28. var responseForMouseClick = x.Result;
29. if (responseForMouseClick.Success && responseForMouseClick.Result != null)
30. {
31. var xy = responseForMouseClick.Result;
32. var json = JsonConvert.SerializeObject(xy).ToString();
33. var coordx = json.Substring(json.IndexOf(':') + 1, 3);
34. var coordy = json.Substring(json.LastIndexOf(':') + 1, 3);
36. //Now click and drag slider to the right
37. MouseLeftDown(int.Parse(coordx) + 5, int.Parse(coordy) + 5);
38. MouseLeftUp(int.Parse(coordx) + 100, int.Parse(coordy) + 5);
39. }
40. });

dotnet-csharp

image.png (19.7 KiB)

image.png (40.8 KiB)

 Comment  Save

1 Answer

正在上传…重新上传取消

Click to vote1 Vote"1

TimonYang-MSFT answered • Jul 16 2021 at 2:20 PM | TimonYang-MSFT edited • Jul 19 2021 at 9:29 AM BEST ANSWERACCEPTED ANSWER

When executing the code. This SLIDER is actually clicked on because the slider changes value a bit.

I'm afraid not.

If this slider is indeed clicked, then when our mouse moves left and right, the slider will move with it, even if we did not click the slider (because we have clicked through the code).

But the current code does not seem to have this behavior, I still need to click on this slider and then move left and right.

After some testing, I found the cause of the problem.

The Y value of the position we need to pass to SendMouseClickEvent is shown in image 1. It is the position of the slider relative to the control. As we slide the wheel, it will change.

But the Y value obtained by the current JS code is shown in image 2. The position of the slider relative to the top of this website is fixed (as long as we don’t change the size of the page, if we adjust the page very narrowly,

Then the control will move down because of the re-formatting of the page).

So this code does not actually click the slider, which leads to the current confusion.

To capture the slider accurately, I modified the code. After clicking the button, hover the cursor on the slider, and then you can see the slider move with the execution of SendMouseMoveEvent.

1. public Form1()
2. {
3. InitializeComponent();
4. }
5. private ChromiumWebBrowser browser;//CefSharp brows
6. private void Form1_Load(object sender, EventArgs e)
7. {
8. browser = new ChromiumWebBrowser("https://uniswapv3.flipsidecrypto.com")
9. {
10. Dock = DockStyle.Fill,
11. };
12. this.Controls.Add(browser);
13. }
14. private void button1_Click(object sender, EventArgs e) { new Thread(moveSlideControl).Start(); }
15. void moveSlideControl()
16. {
17. //I did it deliberately, it cannot be submitted when S*leep() is included in the code, you should delete the *.
18. Thread.S*leep(2000);
20. Point ptCursor = new Point(0, 0);
22. this.Invoke(new Action(() =>
23. {
24. ptCursor = Cursor.Position;
25. ptCursor = PointToClient(ptCursor);
26. }));
27. MouseLeftUp(ptCursor.X, ptCursor.Y);
28. }
29. private void MouseLeftUp(int v1, int v2)
30. {
31. var host = browser.GetBrowser().GetHost();
32. host.SendMouseClickEvent(v1, v2, MouseButtonType.Left, false, 1, CefEventFlags.None);
34. for (int i = 0; i < 7; i++)
35. {
36. v1 = v1 + i * 2;
37. host.SendMouseMoveEvent(v1, v2, false, CefEventFlags.LeftMouseButton);//Move the mouse
38. Thread.S*leep(1000);
39. }
40. }

---

If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

capture.png (222.2 KiB)

1.png (122.8 KiB)

 Comment ·  Hide 1

正在上传…重新上传取消 Andreasss-5315 · Jul 16 2021 at 8:20 PM

Yes, I understand. I noticed also later that the JS code didn't capture the correct X and Y coordinates. The "SendMouseMoveEvent" was a gamechanger here! That was also really one problem I had to actually move the cursor.

It seems that the X and Y coordinates that was captured with JS, - and if adding 85 to the X and 123 to the Y coordinate. It seems to capture the control exactly. (It might be a clunky workaround though but it seems to work by doing that.)

Then, pass those coordinates to the:

1. int Xextra = 85; int Yextra = 123; //Somehow by adding this seems to capture the control exactly
3. MouseLeftUp(int.Parse(coordx) + Xextra, int.Parse(coordy) + Yextra);

Thank you for your help!