google-compute-engine-plugin icon indicating copy to clipboard operation
google-compute-engine-plugin copied to clipboard

Jenkins "forgets" GCE Configuration

Open dibi-codes opened this issue 6 years ago • 5 comments

Every now and then our Jenkins forgets the configuration of the GCE Plugin. Especially the part marked below:

<clouds>
    <com.google.jenkins.plugins.computeengine.ComputeEngineCloud plugin="[email protected]">
      <name>gce-google cloud</name>
      <instanceCap>1</instanceCap>
      <projectId>XXX</projectId>
      <credentialsId>XXX</credentialsId>
      <instanceId>123456789-1234-1234-1234-123456789012</instanceId>
      <configurations/> # THIS PART IS MISSING RIGHT NOW
    </com.google.jenkins.plugins.computeengine.ComputeEngineCloud>
  </clouds>

Does anyone have a recommendation what to do or whether this is a problem with the plugin or with jenkins in general?

Jenkins ver. 2.190.3 [email protected]

dibi-codes avatar Dec 04 '19 11:12 dibi-codes

@dabeck thanks for reporting this. How often would you say this occurs? Does it corresponding with a plugin upgrade per chance?

craigdbarber avatar Dec 09 '19 19:12 craigdbarber

@craigdbarber It occurs a minimum of once a week and furthermore everytime jenkins reboots due to a crash or something else. I think it might be related to the last plugin update. I'll try to do a rollback and see if this fixes the problem.

dibi-codes avatar Dec 10 '19 10:12 dibi-codes

Sounds good. Please keep us posted.

On Tue, Dec 10, 2019 at 2:04 AM Daniel Becker [email protected] wrote:

@craigdbarber https://github.com/craigdbarber It occurs a minimum of once a week and furthermore everytime jenkins reboots due to a crash or something else. I think it might be related to the last plugin update. I'll try to do a rollback and see if this fixes the problem.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/jenkinsci/google-compute-engine-plugin/issues/167?email_source=notifications&email_token=AFNZUNMSQ7IP6YCJAQUJKULQX5STPA5CNFSM4JVG2FO2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEGOVQYQ#issuecomment-563959906, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFNZUNOOIOOZ74L5HOEILETQX5STPANCNFSM4JVG2FOQ .

-- Craig Barber Tech Lead - Cloud Graphite: CI/CD

craigdbarber avatar Dec 10 '19 18:12 craigdbarber

After a rollack to 4.0.0 the configuration doesn't get purged BUT the configuration is now kind of incompatible. Did not have much time to look into it. Jenkins throws an exception with 4.0.0

2019-12-18 10:24:25.306+0000 [id=57129] WARNING o.e.j.s.h.ContextHandler$Context#log: Error while serving https://jenkins.<host>/cloud/gce-google%20cloud/provision
java.lang.NoClassDefFoundError: Could not initialize class com.google.common.io.BaseEncoding                                                                                                                                                                                                                                                                                                                                                
        at org.jclouds.ssh.SshKeys.encodeAsOpenSSH(SshKeys.java:158)                                                                                                                                                                                                                                                                                                                                                                        
        at org.jclouds.ssh.SshKeys.generate(SshKeys.java:151)                                                                                                                                                                                                                                                                                                                                                                               
        at org.jclouds.ssh.SshKeys.generate(SshKeys.java:142)                                                                                                                                                                                                                                                                                                                                                                               
        at com.google.jenkins.plugins.computeengine.ssh.GoogleKeyPair.generate(GoogleKeyPair.java:35)                                                                                                                                                                                                                                                                                                                                       
        at com.google.jenkins.plugins.computeengine.InstanceConfiguration.configureSSHKeyPair(InstanceConfiguration.java:430)                                                                                                                                                                                                                                                                                                               
        at com.google.jenkins.plugins.computeengine.InstanceConfiguration.instance(InstanceConfiguration.java:364)                                                                                                                                                                                                                                                                                                                          
        at com.google.jenkins.plugins.computeengine.InstanceConfiguration.provision(InstanceConfiguration.java:298)                                                                                                                                                                                                                                                                                                                         
        at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.doProvision(ComputeEngineCloud.java:421)                                                                                                                                                                                                                                                                                                                             
        at java.lang.invoke.MethodHandle.invokeWithArguments(MethodHandle.java:627)                                                                                                                                                                                                                                                                                                                                                         
        at org.kohsuke.stapler.Function$MethodFunction.invoke(Function.java:396)                                                                                                                                                                                                                                                                                                                                                            
Caused: java.lang.reflect.InvocationTargetException                                                                                                                                                                                                                                                                                                                                                                                         
        at org.kohsuke.stapler.Function$MethodFunction.invoke(Function.java:400)                                                                                                                                                                                                                                                                                                                                                            
        at org.kohsuke.stapler.Function$InstanceFunction.invoke(Function.java:408)                                                                                                                                                                                                                                                                                                                                                          
        at org.kohsuke.stapler.Function.bindAndInvoke(Function.java:212)                                                                                                                                                                                                                                                                                                                                                                    
        at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:145)                                                                                                                                                                                                                                                                                                                                                    
        at org.kohsuke.stapler.MetaClass$11.doDispatch(MetaClass.java:535)                                                                                                                                                                                                                                                                                                                                                                  
        at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58)                                                                                                                                                                                                                                                                                                                                                    
        at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:747)                                                                                                                                                                                                                                                                                                                                                                          
        at org.kohsuke.stapler.Stapler.invoke(Stapler.java:878)                                                                                                                                                                                                                                                                                                                                                                             
        at org.kohsuke.stapler.MetaClass$4.doDispatch(MetaClass.java:280)                                                                                                                                                                                                                                                                                                                                                                   
        at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58)                                                                                                                                                                                                                                                                                                                                                    
        at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:747)                                                                                                                                                                                                                                                                                                                                                                          
        at org.kohsuke.stapler.Stapler.invoke(Stapler.java:878)                                                                                                                                                                                                                                                                                                                                                                             
        at org.kohsuke.stapler.Stapler.invoke(Stapler.java:676)                                                                                                                                                                                                                                                                                                                                                                             
        at org.kohsuke.stapler.Stapler.service(Stapler.java:238)                                                                                                                                                                                                                                                                                                                                                                            
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)                                                                                                                                                                                                                                                                                                                                                                     
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)                                                                                                                                                                                                                                                                                                                                                           
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)                                                                                                                                                                                                                                                                                                                                          
        at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:154)                                                                                                                                                                                                                                                                                                                                                         
        at org.jenkinsci.plugins.ssegateway.Endpoint$SSEListenChannelFilter.doFilter(Endpoint.java:246)                                                                                                                                                                                                                                                                                                                                     
        at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:151)                                                                                                                                                                                                                                                                                                                                                         
        at io.jenkins.blueocean.ResourceCacheControl.doFilter(ResourceCacheControl.java:134)                                                                                                                                                                                                                                                                                                                                                
        at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:151)                                                                                                                                                                                                                                                                                                                                                         
        at io.jenkins.blueocean.auth.jwt.impl.JwtAuthenticationFilter.doFilter(JwtAuthenticationFilter.java:61)                                                                                                                                                                                                                                                                                                                             
        at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:151)                                                                                                                                                                                                                                                                                                                                                         
        at hudson.plugins.greenballs.GreenBallFilter.doFilter(GreenBallFilter.java:59)                                                                                                                                                                                                                                                                                                                                                      
        at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:151)                                                                                                                                                                                                                                                                                                                                                         
        at hudson.plugins.scm_sync_configuration.extensions.ScmSyncConfigurationFilter$1.call(ScmSyncConfigurationFilter.java:49)                                                                                                                                                                                                                                                                                                           
        at hudson.plugins.scm_sync_configuration.extensions.ScmSyncConfigurationFilter$1.call(ScmSyncConfigurationFilter.java:44)                                                                                                                                                                                                                                                                                                           
        at hudson.plugins.scm_sync_configuration.ScmSyncConfigurationDataProvider.provideRequestDuring(ScmSyncConfigurationDataProvider.java:106)                                                                                                                                                                                                                                                                                           
        at hudson.plugins.scm_sync_configuration.extensions.ScmSyncConfigurationFilter.doFilter(ScmSyncConfigurationFilter.java:44)                                                                                                                                                                                                                                                                                                         
        at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:151)                                                                                                                                                                                                                                                                                                                                                         
        at jenkins.telemetry.impl.UserLanguages$AcceptLanguageFilter.doFilter(UserLanguages.java:128)                                                                                                                                                                                                                                                                                                                                       
        at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:151)                                                                                                                                                                                                                                                                                                                                                         
        at hudson.util.PluginServletFilter.doFilter(PluginServletFilter.java:157)                                                                                                                                                                                                                                                                                                                                                           
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)                                                                                                                                                                                                                                                                                                                                          
        at hudson.security.csrf.CrumbFilter.doFilter(CrumbFilter.java:99)                                                                                                                                                                                                                                                                                                                                                                   
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)                                                                                                                                                                                                                                                                                                                                          
        at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:84)                                                                                                                                                                                                                                                                                                                                                    
        at hudson.security.UnwrapSecurityExceptionFilter.doFilter(UnwrapSecurityExceptionFilter.java:51)                                                                                                                                                                                                                                                                                                                                    
        at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)                                                                                                                                                                                                                                                                                                                                                    
        at jenkins.security.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:117)                                                                                                                                                                                                                                                                                                                                        
        at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)                                                                                                                                                                                                                                                                                                                                                    
        at org.acegisecurity.providers.anonymous.AnonymousProcessingFilter.doFilter(AnonymousProcessingFilter.java:125)                                                                                                                                                                                                                                                                                                                     
        at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)                                                                                                                                                                                                                                                                                                                                                    
        at org.acegisecurity.ui.rememberme.RememberMeProcessingFilter.doFilter(RememberMeProcessingFilter.java:142)                                                                                                                                                                                                                                                                                                                         
        at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)                                                                                                                                                                                                                                                                                                                                                    
        at org.acegisecurity.ui.AbstractProcessingFilter.doFilter(AbstractProcessingFilter.java:271)                                                                                                                                                                                                                                                                                                                                        
        at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)                                                                                                                                                                                                                                                                                                                                                    
        at jenkins.security.BasicHeaderProcessor.doFilter(BasicHeaderProcessor.java:93)                                                                                                                                                                                                                                                                                                                                                     
        at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)                                                                                                                                                                                                                                                                                                                                                    
        at org.acegisecurity.context.HttpSessionContextIntegrationFilter.doFilter(HttpSessionContextIntegrationFilter.java:249)                                                                                                                                                                                                                                                                                                             
        at hudson.security.HttpSessionContextIntegrationFilter2.doFilter(HttpSessionContextIntegrationFilter2.java:67)                                                                                                                                                                                                                                                                                                                      
        at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)                                                                                                                                                                                                                                                                                                                                                    
        at hudson.security.ChainedServletFilter.doFilter(ChainedServletFilter.java:90)                                                                                                                                                                                                                                                                                                                                                      
        at hudson.security.HudsonFilter.doFilter(HudsonFilter.java:171)                                                                                                                                                                                                                                                                                                                                                                     
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)                                                                                                                                                                                                                                                                                                                                          
        at org.kohsuke.stapler.compression.CompressionFilter.doFilter(CompressionFilter.java:49)                                                                                                                                                                                                                                                                                                                                            
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)                                                                                                                                                                                                                                                                                                                                          
        at hudson.util.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:82)                                                                                                                                                                                                                                                                                                                                                    
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)                                                                                                                                                                                                                                                                                                                                          
        at org.kohsuke.stapler.DiagnosticThreadNameFilter.doFilter(DiagnosticThreadNameFilter.java:30)                                                                                                                                                                                                                                                                                                                                      
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)                                                                                                                                                                                                                                                                                                                                          
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)                                                                                                                                                                                                                                                                                                                                                       
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)                                                                                                                                                                                                                                                                                                                                                    
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)                                                                                                                                                                                                                                                                                                                                                      
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)                                                                                                                                                                                                                                                                                                                                                  
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)                                                                                                                                                                                                                                                                                                                                                
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1700)                                                                                                                                                                                                                                                                                                                                               
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)                                                                                                                                                                                                                                                                                                                                                
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)                                                                                                                                                                                                                                                                                                                                               
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)                                                                                                                                                                                                                                                                                                                                                 
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)                                                                                                                                                                                                                                                                                                                                                        
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1667)                                                                                                                                                                                                                                                                                                                                                
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)                                                                                                                                                                                                                                                                                                                                                 
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)                                                                                                                                                                                                                                                                                                                                                
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)     
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:698)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:804)
        at java.lang.Thread.run(Thread.java:748)

dibi-codes avatar Dec 18 '19 10:12 dibi-codes

FWIW, we ran into this issue today. We think it was related to upgrading another plugin.

russtaylor avatar Dec 10 '21 18:12 russtaylor