[Spacewalk-list] osad and 'No more data to read from socket'

Wed Sep 10 15:45:44 UTC 2008

Hi all,

I've broken my spacewalk...
I get an internal server error when I go to the 'Install' page of any of 
my systems, caused by a SQLException: No more data to read from socket.

Things worked fine until I tried to install osa. I couldn't get it to 
work, tinkered with the configuration files a bit and encountered the 
problem when I tried installing packages again. Uninstalling 
osa-dispatcher and jabberd hasn't fixed anything.
Looking around I found that this problem is usually related to stale 
connections in connection pools, but restarting both database and 
spacewalk did nothing, and furthermore it's only this particular page 
that I've seen afflicted so far.

As a side comment: I think the osa-dispatcher package should be made to 
depend on jabberd, it wasn't hard, but I had to rummage a bit to find 
out jabberd was also necessary. Also, I found the documentation on osa a 
bit obscure, with no clear mention in the satellite docs nor the wiki on 
how to set it up on client and server. The previous osa discussion on 
the list was a big help, but not enough. It'd be great if anyone with 
the knowledge could get to write a mini how-to on the wiki. If no one 
does I'll try to once I get it work (if I can :)).

Back on topic: I'm posting the traceback in case anyone knows how to fix 
the 'Install' page problem.

Thanks.

Adrián

The following exception occurred while executing this request:
GET /rhn/systems/details/packages/InstallPackages.do

Date:9/9/08 1:52:29 PM UYT
Headers:
  host: spacewalk.geocom.com.uy
  user-agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
  accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
  accept-language: en,en-us;q=0.8,es-es;q=0.5,es;q=0.3
  accept-encoding: gzip,deflate
  accept-charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
  Keep-Alive: 300
  connection: keep-alive
  referer: https://spacewalk.geocom.com.uy/rhn/systems/details/packages/Packages.do?sid=1000010021
  cookie: JSESSIONID=6814803DDF6A1C5D415A37991947EF16; __utmz=185197503.1216226747.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); __utma=185197503.407703998778250940.1216226747.1218763063.1220116666.6; pxt-session-cookie=504xbb8b0863dbef84473c1540b0ee0d36c4
  Max-Forwards: 10

Request:
Local Name = spacewalk.geocom.com.uy
Server Name = spacewalk.geocom.com.uy
Requested Session Id came from Cookie
Requested Session Valid = true
Session = org.apache.catalina.session.StandardSessionFacade at 1f20541[session=StandardSession[6814803DDF6A1C5D415A37991947EF16]]
Protocol = https
Request Locale = en_US
Request Character Encoding = UTF-8
Attribute Names = rhnActiveLang, __sitemesh__page, javax.servlet.jsp.jstl.fmt.timeZone.request, javax.servlet.error.status_code, javax.servlet.error.servlet_name, javax.servlet.request.key_size, requestedUri, javax.servlet.request.ssl_session, org.apache.struts.action.MESSAGE, javax.servlet.error.message, session, __sitemesh__filterapplied, javax.servlet.request.cipher_suite, javax.servlet.error.exception, org.apache.struts.action.mapping.instance, javax.servlet.error.request_uri, org.apache.struts.action.MODULE, 

User Information:
User spacewalk (id 1, org_id 1)

Exception:
javax.servlet.ServletException: No more data to read from socket
	at org.apache.struts.action.RequestProcessor.processException(RequestProcessor.java:535)
	at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:433)
	at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:237)
	at com.redhat.rhn.frontend.struts.RhnRequestProcessor.process(RhnRequestProcessor.java:82)
	at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196)
	at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:414)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:690)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
	at com.redhat.rhn.frontend.servlets.AuthFilter.doFilter(AuthFilter.java:73)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
	at com.opensymphony.module.sitemesh.filter.PageFilter.parsePage(PageFilter.java:142)
	at com.opensymphony.module.sitemesh.filter.PageFilter.doFilter(PageFilter.java:58)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
	at com.redhat.rhn.frontend.servlets.LocalizedEnvironmentFilter.doFilter(LocalizedEnvironmentFilter.java:67)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
	at com.redhat.rhn.frontend.servlets.EnvironmentFilter.doFilter(EnvironmentFilter.java:107)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
	at com.redhat.rhn.frontend.servlets.SessionFilter.doFilter(SessionFilter.java:55)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
	at com.redhat.rhn.frontend.servlets.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:97)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:210)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151)
	at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:200)
	at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:283)
	at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:773)
	at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:703)
	at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:895)
	at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:685)
	at java.lang.Thread.run(Thread.java:636)
Caused by: com.redhat.rhn.common.db.WrappedSQLException: No more data to read from socket
	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112)
	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:146)
	at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:208)
	at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1123)
	at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1075)
	at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:480)
	at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:219)
	at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:970)
	at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1072)
	at oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:854)
	at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1154)
	at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3370)
	at oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3476)
	at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.execute(NewProxyPreparedStatement.java:651)
	at com.redhat.rhn.common.db.NamedPreparedStatement.execute(NamedPreparedStatement.java:137)
	at com.redhat.rhn.common.db.datasource.CachedStatement.execute(CachedStatement.java:448)
	at com.redhat.rhn.common.db.datasource.CachedStatement.execute(CachedStatement.java:425)
	at com.redhat.rhn.common.db.datasource.CachedStatement.execute(CachedStatement.java:329)
	at com.redhat.rhn.common.db.datasource.CachedStatement.execute(CachedStatement.java:334)
	at com.redhat.rhn.common.db.datasource.CachedStatement.execute(CachedStatement.java:274)
	at com.redhat.rhn.common.db.datasource.SelectMode.execute(SelectMode.java:105)
	at com.redhat.rhn.manager.BaseManager.makeDataResult(BaseManager.java:57)
	at com.redhat.rhn.manager.rhnpackage.PackageManager.systemAvailablePackages(PackageManager.java:232)
	at com.redhat.rhn.frontend.action.rhnpackage.InstallPackageSetupAction.getDataResult(InstallPackageSetupAction.java:84)
	at com.redhat.rhn.frontend.action.rhnpackage.InstallPackageSetupAction.execute(InstallPackageSetupAction.java:62)
	at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:431)
	... 40 more
Caused by: java.sql.SQLException: No more data to read from socket
	... 66 more