[JENKINS-71357] Jenkins webhook latency for Gitlab branch source plugin

[jenkins-infra-bot]

We have webhook latency and not working most of the time between Jenkins and gitlab for gitlab group and multibranch pipeline jobs. we have to recycle service to fix it but it should be fine for next few hours or day only, again the issue will happen.
Please help us and getting fix on this. we are using the below jenkins, tomcat and plugins for webhook.

Jenkins version 2.387.3 (open source)
apache tomcat version - 9.0.70
GitLab Version1.7.4
GitLab Branch Source Version1.5.7
GitLab API Version1.0.6
Generic Webhook Trigger Version1.86.2

This is my observation, whenever i see these threads, webhook are not working.

class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:10:31 EDT 2023 / SCMEvent 6
yes    5    RUNNABLERUNNABLE    java.base@​11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    218,604    205,000    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:10:31 EDT 2023 / SCMEvent 6. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:10:31 EDT 2023 / SCMEvent 6
class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:15:04 EDT 2023 / SCMEvent 10
yes    5    RUNNABLERUNNABLE    java.base@​11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    221,745    208,280    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:15:04 EDT 2023 / SCMEvent 10. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:15:04 EDT 2023 / SCMEvent 10
class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:16 EDT 2023 / SCMEvent 1
yes    5    RUNNABLERUNNABLE    java.base@​11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    386,744    362,960    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:16 EDT 2023 / SCMEvent 1. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:16 EDT 2023 / SCMEvent 1
class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:19 EDT 2023 / SCMEvent 7
yes    5    RUNNABLERUNNABLE    java.base@​11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    383,191    359,150    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:19 EDT 2023 / SCMEvent 7. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:19 EDT 2023 / SCMEvent 7
class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:36 EDT 2023 / SCMEvent 4
yes    5    RUNNABLERUNNABLE    java.base@​11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    381,679    357,940    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:36 EDT 2023 / SCMEvent 4. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:36 EDT 2023 / SCMEvent 4
class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 8
yes    5    RUNNABLERUNNABLE    java.base@​11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    375,611    351,140    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 8. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 8
class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:01:55 EDT 2023 / SCMEvent 3
yes    5    RUNNABLERUNNABLE    java.base@​11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    380,901    356,380    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:01:55 EDT 2023 / SCMEvent 3. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:01:55 EDT 2023 / SCMEvent 3
class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:04:15 EDT 2023 / SCMEvent 9
yes    5    RUNNABLERUNNABLE    java.base@​11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    387,911    364,560    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:04:15 EDT 2023 / SCMEvent 9. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:04:15 EDT 2023 / SCMEvent 9
class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 2
yes    5    RUNNABLERUNNABLE    java.base@​11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    382,987    358,350    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 2. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 2
class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:33 EDT 2023 / SCMEvent 5
yes    5    RUNNABLERUNNABLE    java.base@​11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    379,593    356,800    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:33 EDT 2023 / SCMEvent 5. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:33 EDT 2023 / SCMEvent 5
Cleaner-0
yes    8    

---

Originally reported by devensa, imported from: Jenkins webhook latency for Gitlab branch source plugin

• assignee: baymac
• status: Open
• priority: Major
• component(s): gitlab-api-plugin, gitlab-branch-source-plugin, gitlab-merge-request-jenkins-plugin, gitlab-plugin
• resolution: Unresolved
• votes: 1
• watchers: 2
• imported: 20251216-182730

Raw content of original issue

We have webhook latency and not working most of the time between Jenkins and gitlab for gitlab group and multibranch pipeline jobs. we have to recycle service to fix it but it should be fine for next few hours or day only, again the issue will happen.
Please help us and getting fix on this. we are using the below jenkins, tomcat and plugins for webhook.


Jenkins version 2.387.3 (open source)
apache tomcat version - 9.0.70
GitLab Version1.7.4
GitLab Branch Source Version1.5.7
GitLab API Version1.0.6
Generic Webhook Trigger Version1.86.2

This is my observation, whenever i see these threads, webhook are not working.

class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:10:31 EDT 2023 / SCMEvent 6
yes    5    RUNNABLERUNNABLE    java.base@11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    218,604    205,000    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:10:31 EDT 2023 / SCMEvent 6. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:10:31 EDT 2023 / SCMEvent 6
class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:15:04 EDT 2023 / SCMEvent 10
yes    5    RUNNABLERUNNABLE    java.base@11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    221,745    208,280    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:15:04 EDT 2023 / SCMEvent 10. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 09:15:04 EDT 2023 / SCMEvent 10
class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:16 EDT 2023 / SCMEvent 1
yes    5    RUNNABLERUNNABLE    java.base@11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    386,744    362,960    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:16 EDT 2023 / SCMEvent 1. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:16 EDT 2023 / SCMEvent 1
class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:19 EDT 2023 / SCMEvent 7
yes    5    RUNNABLERUNNABLE    java.base@11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    383,191    359,150    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:19 EDT 2023 / SCMEvent 7. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:19 EDT 2023 / SCMEvent 7
class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:36 EDT 2023 / SCMEvent 4
yes    5    RUNNABLERUNNABLE    java.base@11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    381,679    357,940    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:36 EDT 2023 / SCMEvent 4. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:02:36 EDT 2023 / SCMEvent 4
class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 8
yes    5    RUNNABLERUNNABLE    java.base@11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    375,611    351,140    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 8. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabMergeRequestSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 8
class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:01:55 EDT 2023 / SCMEvent 3
yes    5    RUNNABLERUNNABLE    java.base@11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    380,901    356,380    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:01:55 EDT 2023 / SCMEvent 3. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:01:55 EDT 2023 / SCMEvent 3
class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:04:15 EDT 2023 / SCMEvent 9
yes    5    RUNNABLERUNNABLE    java.base@11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    387,911    364,560    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:04:15 EDT 2023 / SCMEvent 9. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:04:15 EDT 2023 / SCMEvent 9
class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 2
yes    5    RUNNABLERUNNABLE    java.base@11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    382,987    358,350    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 2. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:23 EDT 2023 / SCMEvent 2
class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:33 EDT 2023 / SCMEvent 5
yes    5    RUNNABLERUNNABLE    java.base@11.0.19/java.net.SocketInputStream.socketRead0(Native Method)    379,593    356,800    Send a thread interrupt signal to class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:33 EDT 2023 / SCMEvent 5. The thread can test Thread.currentThread().isInterrupted() to stop itself.    Kill the thread class io.jenkins.plugins.gitlabbranchsource.GitLabPushSCMEvent Fri May 26 11:05:33 EDT 2023 / SCMEvent 5
Cleaner-0
yes    8    

• environment: Production

[jenkins-infra-bot]

devensa:

• Original comment link
• Raw content of original comment:

  I have tried with latest versions of gitlab and gitlab branch source plugin. still facing the same
  Jenkins version 2.387.3
  apache tomcat version - 9.0.70
  GitLab - Version 1.7.14
  GitLab Branch Source Plugin - Version 660.vd45c0f4c0042
  GitLab API Plugin - Version 5.2.0-86.v1ed41a_9cf486
  Generic Webhook Trigger - Version1.86.2
  

I have tried with latest versions of gitlab and gitlab branch source plugin. still facing the same
Jenkins version 2.387.3
apache tomcat version - 9.0.70
GitLab - Version 1.7.14
GitLab Branch Source Plugin - Version 660.vd45c0f4c0042
GitLab API Plugin - Version 5.2.0-86.v1ed41a_9cf486
Generic Webhook Trigger - Version1.86.2

[jenkins-infra-bot]

amidar:

• Original comment link
• Raw content of original comment:

  we are facing similar issue. the gitlab webhook test shows a response from the jenkins controller, but the job doesn't get trigered.
  
  gitlab 15.4
  
  jenkins 2.426.2
  
  gitlab branch source plugin 684.vea_fa_7c1e2fe3
  
  gitlab plugin 1.8.0
  
   
  

we are facing similar issue. the gitlab webhook test shows a response from the jenkins controller, but the job doesn't get trigered.

gitlab 15.4

jenkins 2.426.2

gitlab branch source plugin 684.vea_fa_7c1e2fe3

gitlab plugin 1.8.0