[Logo] Terracotta Discussion Forums (LEGACY READ-ONLY ARCHIVE)
  [Search] Search   [Recent Topics] Recent Topics   [Members]  Member Listing   [Groups] Back to home page 
[Register] Register /  [Login] Login 
[Expert]
terracotta server and client start showing mailfunction and finaly our web application stop working  XML
Forum Index -> Terracotta for Web Sessions
Author Message
[Post New]03/06/2013 18:37:56
    Subject: terracotta server and client start showing mailfunction and finaly our web application stop working
[Up]
mkgangol

neo

Joined: 03/06/2013 18:17:18
Messages: 1
Offline
Hi
I am new here , apreciate if some one guide me where to start from
below are snip from server and client log

Server log
****************
2013-03-04 22:48:38,057 [Statistics Logger] INFO com.terracottatech.dso - memory used : 257812488
2013-03-04 22:48:38,057 [Statistics Logger] INFO com.terracottatech.dso - memory max : 984285184
2013-03-04 23:03:38,058 [Statistics Logger] INFO com.terracottatech.dso - memory free : 742312264
2013-03-04 23:03:38,058 [Statistics Logger] INFO com.terracottatech.dso - memory used : 241972920
2013-03-04 23:03:38,058 [Statistics Logger] INFO com.terracottatech.dso - memory max : 984285184
2013-03-04 23:16:43,569 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] WARN com.tc.net.protocol.transport.ConnectionHealthCheckerImpl. DSO Server - localhost.localdomain:41170 might be in Long GC. GC count since last ping reply : 1
2013-03-04 23:16:43,691 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] WARN com.tc.net.protocol.transport.ConnectionHealthCheckerImpl. DSO Server - localhost.localdomain:41178 might be in Long GC. GC count since last ping reply : 1
2013-03-04 23:16:52,131 [L2_L1:TCWorkerComm # 1_R] WARN com.tc.net.core.CoreNIOServices - Exception trying to shutdown socket output: Transport endpoint is not connected
2013-03-04 23:16:52,194 [L2_L1:TCWorkerComm # 1_R] WARN com.tc.net.protocol.transport.ServerMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): CLOSE EVENT : com.tc.net.core.TCConnectionJDK14@1653293411: connected: false, closed: true local=127.0.0.1:9510 remote=127.0.0.1:41178 connect=[Mon Mar 04 20:58:12 IST 2013] idle=1137ms [328674 read, 347520 write]. STATUS : ESTABLISHED
2013-03-04 23:16:52,195 [HealthChecker] INFO com.tc.net.protocol.transport.ConnectionHealthCheckerImpl: DSO Server - [localhost.localdomain:41178] is not connected. Health Monitoring for this node is now disabled.
2013-03-04 23:16:52,621 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'org.terracotta:clients=Clients,name=Terracotta Instrumentation Logging Bean,subsystem=Logging,type=DSO Client,node=localhost.localdomain/41178'
2013-03-04 23:16:52,623 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'net.sf.ehcache:SampledCacheManager=tej2CacheManager,clients=Clients,name=companyData,type=SampledCache,node=localhost.localdomain/41178'
2013-03-04 23:16:52,625 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'org.terracotta.internal:clients=Clients,name=DSO Client Dump Bean,type=DSO Client,node=localhost.localdomain/41178'
2013-03-04 23:16:52,857 [L2_L1:TCWorkerComm # 1_R] INFO com.tc.objectserver.persistence.sleepycat.SleepycatPersistor - Deleted client state for ChannelID=[4]
2013-03-04 23:16:52,881 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'org.terracotta:clients=Clients,name=Terracotta Cluster Bean,type=Terracotta Cluster,node=localhost.localdomain/41178'
2013-03-04 23:16:52,882 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'org.terracotta.internal:clients=Clients,name=Terracotta Statistics Emitter,subsystem=Statistics,type=Terracotta Agent,node=localhost.localdomain/41178'
2013-03-04 23:16:52,882 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'net.sf.ehcache:SampledCacheManager=tej2CacheManager,clients=Clients,name=sublistListData,type=SampledCache,node=localhost.localdomain/41178'
2013-03-04 23:16:52,883 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'org.terracotta:clients=Clients,feature=org.terracotta.modules.tim-ehcache-2.x-ui-1.6.0,name=Ehcache,type=Loader,node=localhost.localdomain/41178'
2013-03-04 23:16:52,883 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'org.terracotta.internal:clients=Clients,name=Terracotta Statistics Manager,subsystem=Statistics,type=Terracotta Agent,node=localhost.localdomain/41178'
2013-03-04 23:16:52,883 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'org.terracotta:clients=Clients,feature=org.terracotta.modules.tim-ehcache-2.x-hibernate-ui-1.6.0,name=Hibernate,type=Loader,node=localhost.localdomain/41178'
2013-03-04 23:16:52,914 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'org.terracotta:clients=Clients,name=Terracotta Runtime Output Options Bean,subsystem=Logging,type=DSO Client,node=localhost.localdomain/41178'
2013-03-04 23:16:52,914 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'net.sf.ehcache:clients=Clients,name=tej2CacheManager,type=SampledCacheManager,node=localhost.localdomain/41178'
2013-03-04 23:16:52,979 [WorkerThread(channel_life_cycle_stage, 0)] INFO com.tc.objectserver.handler.ChannelLifeCycleHandler - : Received transport disconnect. Shutting down client ClientID[4]
2013-03-04 23:16:52,982 [WorkerThread(channel_life_cycle_stage, 0)] INFO com.tc.objectserver.persistence.impl.TransactionStoreImpl - shutdownClient() : Removing txns from DB : 0
2013-03-04 23:16:52,993 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'org.terracotta:clients=Clients,name=L1 Info Bean,type=DSO Client,node=localhost.localdomain/41178'
2013-03-04 23:16:53,008 [Job_Executor4] INFO com.tc.management.remote.connect.ClientBeanBag - Unregistered Tunneled MBean 'net.sf.ehcache:SampledCacheManager=tej2CacheManager,clients=Clients,name=tokenCache,type=SampledCache,node=localhost.localdomain/41178'
**********************


Client log
*****************
2013-03-04 22:43:11,855 [Statistics Logger] INFO com.terracottatech.dso - memory used : 264939816
2013-03-04 22:43:11,855 [Statistics Logger] INFO com.terracottatech.dso - memory max : 1908932608
2013-03-04 22:58:11,858 [Statistics Logger] INFO com.terracottatech.dso - memory free : 1584967096
2013-03-04 22:58:11,858 [Statistics Logger] INFO com.terracottatech.dso - memory used : 323965512
2013-03-04 22:58:11,858 [Statistics Logger] INFO com.terracottatech.dso - memory max : 1908932608
2013-03-04 23:13:11,855 [Statistics Logger] INFO com.terracottatech.dso - memory free : 1493502056
2013-03-04 23:13:11,856 [Statistics Logger] INFO com.terracottatech.dso - memory used : 415430552
2013-03-04 23:13:11,856 [Statistics Logger] INFO com.terracottatech.dso - memory max : 1908932608
2013-03-04 23:16:44,559 [HealthChecker] INFO com.tc.net.protocol.transport.ConnectionHealthCheckerImpl. DSO Client - Socket Connect to localhost.localdomain:9510(callbackport:9510) taking long time. probably not reachable.
2013-03-04 23:16:44,650 [HealthChecker] INFO com.tc.net.protocol.transport.ConnectionHealthCheckerImpl. DSO Client - localhost.localdomain:9510 is DEAD
2013-03-04 23:16:44,655 [HealthChecker] ERROR com.tc.net.protocol.transport.ConnectionHealthCheckerImpl: DSO Client - Declared connection dead ConnectionID(4.5b75c2d727d247f4895362d3603792aa) idle time 33146ms
2013-03-04 23:16:52,459 [ClientLockManager Lock Lease Timer] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Ignoring message sent to non-established transport: Message Class: com.tc.object.msg.LockRequestMessage
Sealed: true, Header Length: 8, Data Length: 47, Total Length: 55
Header (com.tc.net.protocol.tcm.TCMessageHeaderImpl)
msgType: LOCK_REQUEST_MESSAGE (9), msgVer=0
Payload:
Request Type: RECALL_COMMIT
DsoLockID(ObjectID=[1864]) ThreadID=[-9223372036854775808] Lock Type: null
Holder/Waiters/Pending contexts size = 1

2013-03-04 23:16:53,025 [L1_L2:TCComm Main Selector Thread_W (listen 0:0:0:0:0:0:0:0:47210)] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): CLOSE EVENT : com.tc.net.core.TCConnectionJDK14@461212666: connected: false, closed: true local=127.0.0.1:41178 remote=127.0.0.1:9510 connect=[Mon Mar 04 20:58:12 IST 2013] idle=29437ms [346662 read, 328674 write]. STATUS : DISCONNECTED
2013-03-04 23:16:53,135 [L1_L2:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:47210)] INFO com.tc.net.core.CoreNIOServices - selection key cancelled key@730406136
2013-03-04 23:16:53,136 [ClientLockManager LockGC] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Ignoring message sent to non-established transport: Message Class: com.tc.object.msg.LockRequestMessage
Sealed: true, Header Length: 8, Data Length: 16, Total Length: 24
Header (com.tc.net.protocol.tcm.TCMessageHeaderImpl)
msgType: LOCK_REQUEST_MESSAGE (9), msgVer=0
Payload:
Request Type: RECALL_COMMIT
DsoLockID(ObjectID=[1859]) ThreadID=[-9223372036854775808] Lock Type: null

2013-03-04 23:16:56,601 [ClientLockManager LockGC] INFO com.tc.object.locks.ClientLockManager - ClientID[4]: Lock GC collected 1 garbage locks
2013-03-04 23:17:03,471 [L1_L2:TCComm Main Selector Thread_W (listen 0:0:0:0:0:0:0:0:47210)] INFO com.tc.net.protocol.tcm.ClientMessageChannel - ClientMessageChannel moves to SessionID=[1]
2013-03-04 23:17:03,999 [WorkerThread(client_coordination_stage, 0)] INFO com.tc.object.handshakemanager.ClientHandshakeManagerImpl - ClientID[4]: Disconnected: Pausing from State[ RUNNING ] RemoteNode : GroupID[0]. Disconnect count: 0
2013-03-04 23:17:04,004 [WorkerThread(client_coordination_stage, 0)] INFO com.tc.object.handshakemanager.ClientHandshakeManagerImpl - ClientID[4]: ClientHandshakeManager moves to SessionID=[1]
2013-03-04 23:17:06,037 [ConnectionEstablisher] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Reconnect attempt 0 of unlimited reconnect tries to 127.0.0.1:9510:Tc-Group-0, timeout=10000
2013-03-04 23:17:06,101 [ConnectionEstablisher] INFO com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Attaching new connection: com.tc.net.core.TCConnectionJDK14@279439790: connected: true, closed: false local=127.0.0.1:41224 remote=127.0.0.1:9510 connect=[Mon Mar 04 23:17:06 IST 2013] idle=8ms [0 read, 0 write]
2013-03-04 23:17:17,249 [L1_L2:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:47210)] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): CLOSE EVENT : com.tc.net.core.TCConnectionJDK14@279439790: connected: false, closed: true local=127.0.0.1:41224 remote=127.0.0.1:9510 connect=[Mon Mar 04 23:17:06 IST 2013] idle=11136ms [0 read, 84 write]. STATUS : START
2013-03-04 23:17:17,251 [L1_L2:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:47210)] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): closing down connection - com.tc.net.core.TCConnectionJDK14@279439790: connected: false, closed: true local=127.0.0.1:41224 remote=127.0.0.1:9510 connect=[Mon Mar 04 23:17:06 IST 2013] idle=11138ms [0 read, 84 write]
2013-03-04 23:17:17,336 [ConnectionEstablisher] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Timeout of 10000 milliseconds occured [lossy interval: 10000ms]
2013-03-04 23:17:18,340 [ConnectionEstablisher] INFO com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Attaching new connection: com.tc.net.core.TCConnectionJDK14@730761155: connected: true, closed: false local=127.0.0.1:41225 remote=127.0.0.1:9510 connect=[Mon Mar 04 23:17:18 IST 2013] idle=1ms [0 read, 0 write]
2013-03-04 23:17:28,515 [ConnectionEstablisher] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Timeout of 10000 milliseconds occured [lossy interval: 10000ms]
2013-03-04 23:17:28,518 [L1_L2:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:47210)] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): CLOSE EVENT : com.tc.net.core.TCConnectionJDK14@730761155: connected: false, closed: true local=127.0.0.1:41225 remote=127.0.0.1:9510 connect=[Mon Mar 04 23:17:18 IST 2013] idle=10175ms [0 read, 84 write]. STATUS : START
2013-03-04 23:17:28,519 [L1_L2:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:47210)] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): closing down connection - com.tc.net.core.TCConnectionJDK14@730761155: connected: false, closed: true local=127.0.0.1:41225 remote=127.0.0.1:9510 connect=[Mon Mar 04 23:17:18 IST 2013] idle=10177ms [0 read, 84 write]
2013-03-04 23:17:29,518 [ConnectionEstablisher] INFO com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Attaching new connection: com.tc.net.core.TCConnectionJDK14@1088857655: connected: true, closed: false local=127.0.0.1:41226 remote=127.0.0.1:9510 connect=[Mon Mar 04 23:17:29 IST 2013] idle=1ms [0 read, 0 write]
2013-03-04 23:17:39,550 [ConnectionEstablisher] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Timeout of 10000 milliseconds occured [lossy interval: 10000ms]
2013-03-04 23:17:39,558 [L1_L2:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:47210)] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): CLOSE EVENT : com.tc.net.core.TCConnectionJDK14@1088857655: connected: false, closed: true local=127.0.0.1:41226 remote=127.0.0.1:9510 connect=[Mon Mar 04 23:17:29 IST 2013] idle=10032ms [0 read, 84 write]. STATUS : START
2013-03-04 23:17:39,558 [L1_L2:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:47210)] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): closing down connection - com.tc.net.core.TCConnectionJDK14@1088857655: connected: false, closed: true local=127.0.0.1:41226 remote=127.0.0.1:9510 connect=[Mon Mar 04 23:17:29 IST 2013] idle=10040ms [0 read, 84 write]
2013-03-04 23:17:40,562 [ConnectionEstablisher] INFO com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Attaching new connection: com.tc.net.core.TCConnectionJDK14@308201512: connected: true, closed: false local=127.0.0.1:41227 remote=127.0.0.1:9510 connect=[Mon Mar 04 23:17:40 IST 2013] idle=1ms [0 read, 0 write]
2013-03-04 23:17:50,600 [ConnectionEstablisher] WARN com.tc.net.protocol.transport.ClientMessageTransport - ConnectionID(4.5b75c2d727d247f4895362d3603792aa): Timeout of 10000 milliseconds occured [lossy interval: 10000ms]
**************************************
setting in start-tera.sh
"${JAVA_HOME}/bin/java" \
$SERVER_OPT -Xms512m -Xmx1024m -XX:NewRatio=3 -XX:MaxTenuringThreshold=15 -XX:+HeapDumpOnOutOfMemoryError \
-Dcom.

***************
tomcat
which perhaps to use by client


JAVA_OPTS="-Xms512M -Xmx2048M -Xss512K -XX:MaxPermSize=1024M"



Kindly help how to get rid of this issue .. happening every day.


below is terrotta config
**********************
<?xml version="1.0" encoding="UTF-8"?>

<tc:tc-config xmlns:tc="http://www.terracotta.org/config"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.terracotta.org/schema/terracotta-6.xsd">

<servers>
<!-- Sets where the Terracotta server can be found. Replace the value of
host with the server's IP address. -->

<server host="127.0.0.1" name="tc-server-1" >
<data>/logs/data</data>
<logs>/logs/logs</logs>
<statistics>/logs/tc-server-1/statistics</statistics>
<dso-port>9510</dso-port>
</server>

<!-- If using a standby Terracotta server, also referred to as an ACTIVE-PASSIVE
configuration, add the second server here. -->

<!--<server host="118.67.123.23" name="tc-server-2">
<data>/logs/data</data>
<logs>/logs/logs</logs>
<statistics>/logs/tc-server-2/statistics</statistics>

<dso-port>9510</dso-port>
</server>
-->
<!-- If using more than one server, add an <ha> section. -->
<!--<ha>
<mode>networked-active-passive</mode>
<networked-active-passive>
<election-time>5</election-time>
</networked-active-passive>
</ha>-->
</servers>

<!-- Sets where the generated client logs are saved on clients. Note that
the exact location of Terracotta logs on client machines may vary based on
the value of user.home and the local disk layout. -->

<clients>
<logs>/logs/client/logs</logs>
</clients>

</tc:tc-config>

********************
[Post New]03/07/2013 01:30:33
    Subject: terracotta server and client start showing mailfunction and finaly our web application stop working
[Up]
rajoshi

seraphim

Joined: 07/04/2011 04:36:10
Messages: 1491
Offline
Can you please share your tc-config.xml , it seems there is some network connection issue between terracotta server and client. Can you share detail about your set up , it seems both client and server are running on same machine.
Rakesh Joshi
Senior Consultant
Terracotta.
 
Forum Index -> Terracotta for Web Sessions
Go to:   
Powered by JForum 2.1.7 © JForum Team