Terracotta Discussion Forums (LEGACY READ-ONLY ARCHIVE)

In my app,I used Ehcache + Terracotta + weblogic + linux
When I restart the Terracotta server,then the weblogic server start very slowly!
I get some start log,such as:
2013-02-27 19:04:43,907 [DEBUG] [opCode:${ctx:opCode}] [ EhCacheEngine:84 ] ehCache已经启动! 启动配置文件为file:/webapp/applications/uif1/WEB-INF/classes/ehcache.xml
2013-02-27 19:04:43,915 [DEBUG] [opCode:${ctx:opCode}] [ MemoryStore:149] Initialized net.sf.ehcache.store.MemoryStore for BEAN_ROUTE_MSG
2013-02-27 19:04:43,926 [DEBUG] [opCode:${ctx:opCode}] [ DiskStorePathManager:169] Using diskstore path /webapp/applications/uif1/ehcache
2013-02-27 19:04:43,927 [DEBUG] [opCode:${ctx:opCode}] [ DiskStorePathManager:170] Holding exclusive lock on /webapp/applications/uif1/ehcache/.ehcache-diskstore.lock
2013-02-27 19:04:43,940 [DEBUG] [opCode:${ctx:opCode}] [ DiskStorageFactory:168] Matching data file missing (or empty) for index file. Deleting index file /webapp/applications/uif1/ehcache/%0042%0045%0041%004e_%0052%004f%0055%0054%0045_%004d%0053%0047.index
2013-02-27 19:04:43,941 [DEBUG] [opCode:${ctx:opCode}] [ DiskStorageFactory:860] Failed to delete file %0042%0045%0041%004e_%0052%004f%0055%0054%0045_%004d%0053%0047.index
2013-02-27 19:04:43,948 [DEBUG] [opCode:${ctx:opCode}] [ Cache:1164] Initialised cache: BEAN_ROUTE_MSG
2013-02-27 19:04:43,949 [DEBUG] [opCode:${ctx:opCode}] [ ConfigurationHelper:354] CacheDecoratorFactory not configured for defaultCache. Skipping for 'BEAN_ROUTE_MSG'.
2013-02-27 19:04:43,950 [DEBUG] [opCode:${ctx:opCode}] [ MemoryStore:149] Initialized net.sf.ehcache.store.MemoryStore for SCRIPT_RULE_SCENARIO

it seems have some Exceptions,but I don't know!

My tc-config.xml :
<servers>
<server host="%i" name="sample">
<dso-port>9510</dso-port>
<jmx-port>9520</jmx-port>
<data>terracotta/demo-server/server-data</data>
<logs>terracotta/demo-server/server-logs</logs>
<statistics>terracotta/demo-server/server-statistics</statistics>
</server>
</servers>

When you restart Terracotta it is having issue in loading server data and it tries to delete the index file(which is a pointer to real data) from your Terracotta server data directory i.e "terracotta/demo-server/server-data" but it's not able to do so . Can you check the permissions on this directory .

Thanks for your answer,but I cann't find xxx.index file at the "terracotta/demo-server/server-data" directory ,there is one file named "startup.lck" and a directory named "objectdb" ,in the directory there are four files【00000000.jdb】【je.info.0】【je.info.0.lck】【je.lck】。
EN..there is another question,I found when I restart the terracotta TCServer,the data seems all of them was loss!App must reload them next time,this is very unhappy,how can I save this cache data on the disk?
Thank you!

To persist the Data on server restart use following in your tc-config.xml :

<persistence>
<mode>permanent-store</mode>
</persistence>

For example below it's done for Server1 :

<servers>
<server name="Server1">
<data>/opt/terracotta/server1-data</data>
<l2-group-port>9530</l2-group-port>
<dso>


<persistence>
<mode>permanent-store</mode>
</persistence>

</dso>
</server>
</servers>

Also from logs it poitns the index file in your directory in "/webapp/applications/uif1" , can you please check this . Indexes are generally used for search in terracotta.

Thanks!
Sorry I have many questions
I want to know ,the Terracotta TCServer which time to persist the Data ,or under which condition to persist the Data ?When the server shut down?When out of memory?

Go through this link :

http://terracotta.org/documentation/bigmemorymax/terracotta-server-array/server-arrays

Hope it helps.

Thank you very much,I dare say know,
and...following codes is my teracotta start log:
2013-03-01 20:01:55,587 [main] INFO com.terracottatech.console - Available Max Runtime Memory: 490MB
2013-03-01 20:01:55,706 [main] INFO com.terracottatech.dso - Standard DSO Server created
2013-03-01 20:01:55,708 [main] INFO com.terracottatech.dso - Creating server nodeID: NodeID[137.64.43.84:10001]
2013-03-01 20:01:55,723 [Statistics Logger] INFO com.terracottatech.dso - memory free : 439.370911 MB
2013-03-01 20:01:55,723 [Statistics Logger] INFO com.terracottatech.dso - memory used : 51.316589 MB
2013-03-01 20:01:55,723 [Statistics Logger] INFO com.terracottatech.dso - memory max : 490.687500 MB
2013-03-01 20:01:57,777 [main] INFO com.terracottatech.dso - Statistics buffer: '/cache/terracotta-3.7.3/terracotta/demo-server/server-statistics'.
2013-03-01 20:01:57,797 [main] INFO com.tc.objectserver.managedobject.ConcurrentDistributedMapManagedObjectState - Eviction overshoot threshold is 15.0
2013-03-01 20:01:57,841 [main] INFO com.terracottatech.console - JMX Server started. Available at URL[service:jmx:jmxmp://0.0.0.0:9520]
2013-03-01 20:01:57,857 [main] INFO com.tc.objectserver.storage.berkeleydb.BerkeleyDBEnvironment - Sleepy cat version being used 5.0.55
2013-03-01 20:01:57,885 [main] INFO com.tc.objectserver.storage.berkeleydb.BerkeleyDBEnvironment - Env config = allowCreate=true
cacheSize=0
txnNoSync=false
txnWriteNoSync=false
{je.cleaner.minAge=5, je.cleaner.bytesInterval=20000000, je.env.isTransactional=true, je.cleaner.lookAheadCacheSize=32768, je.env.isReadOnly=false, je.maxMemoryPercent=25, je.lock.nLockTables=7, je.checkpointer.bytesInterval=100000000, je.cleaner.detailMaxMemoryPercentage=5, je.lock.timeout=180000000}
DB Config = allowCreate=true
exclusiveCreate=false
transactional=true
readOnly=false
sortedDuplicates=false
deferredWrite=false
temporary=false
keyPrefixing=false
JE Properties = {je.cleaner.detailMaxMemoryPercentage=5, je.cleaner.bytesInterval=20000000, je.cleaner.lookAheadCacheSize=32768, je.checkpointer.bytesInterval=100000000, je.maxMemoryPercent=25, je.lock.nLockTables=7, je.cleaner.minAge=5, je.lock.timeout=180000000}
2013-03-01 20:01:58,309 [main] INFO com.terracottatech.dso - Terracotta persistence version is 2.2
2013-03-01 20:01:58,487 [main] INFO com.tc.net.core.TCWorkerCommManager - Creating 8 worker comm threads for L2_L1
2013-03-01 20:01:58,511 [main] INFO com.tc.net.protocol.transport.ConnectionHealthCheckerImpl: DSO Server - HealthChecker Started
2013-03-01 20:01:58,511 [main] INFO com.tc.net.protocol.tcm.CommunicationsManager - HealthCheck CallbackPort Listener not requested
2013-03-01 20:01:58,516 [main] INFO com.tc.objectserver.l1.impl.ClientObjectReferenceSet - ServerMapEviction Client Object References refresh interval 60 seconds.

How can I change the max Runtime Memory?

2013-03-01 21:22:05,942 INFO - Terracotta 3.7.3, as of 20130116-060539 (Revision unknown-21992 by cruise@su10vmo118 from 3.7.3)
2013-03-01 21:22:06,346 INFO - Successfully loaded base configuration from file at '/cache/terracotta-3.7.3/tc-config.xml'.

WARN: The log directory, '/cache/terracotta-3.7.3/terracotta/demo-server/server-logs', is already in use by another Terracotta process. Logging will proceed to the console only.

2013-03-01 21:22:08,521 ERROR -
**************************************************************************************
The statistics store couldn't be opened at
'/cache/terracotta-3.7.3/terracotta/demo-server/server-statistics'.
The CVT gathering system will not be active for this node.

A common reason for this is that you're launching several Terracotta clients or
servers on the same machine. The default directory for the statistics store
uses the IP address of the machine that it runs on as the identifier.
When several clients are being executed on the same machine, a typical solution
to properly separate these directories is by using a JVM property at startup
that is unique for each client.

For example:
dso-java.sh -Dtc.node-name=node1 your.main.Class

You can then adapt the tc-config.xml file so that this JVM property is picked
up when the statistics directory is configured by using %(tc.node-name) in the
statistics path.
**************************************************************************************

java.lang.RuntimeException: Unable to setup StatisticsGathererSubSystem
at com.tc.server.TCServerImpl.<init>(TCServerImpl.java:158)
at com.tc.server.TCServerImpl.<init>(TCServerImpl.java:137)
at com.tc.server.StandardServerFactory.createServer(StandardServerFactory.java:12)
at com.tc.server.TCServerMain.main(TCServerMain.java:29)

When I start one TCServer,then the anthor server cann't be start!
my tc-config.xml:
<servers>
<server host="137.64.43.84" name="CACHE84">
<dso-port>10001</dso-port>
<jmx-port>9520</jmx-port>
<data>terracotta/demo-server/server-data</data>
<logs>terracotta/demo-server/server-logs</logs>
<dso>
<client-reconnect-window>120</client-reconnect-window>

<persistence>
<mode>permanent-store</mode>
</persistence>
</dso>
</server>
<server host="137.64.43.93" name="CACHE93">
<dso-port>10001</dso-port>
<jmx-port>9520</jmx-port>
<data>terracotta/demo-server/server-data</data>
<logs>terracotta/demo-server/server-logs</logs>
<dso>
<client-reconnect-window>120</client-reconnect-window>

<persistence>
<mode>permanent-store</mode>
</persistence>
</dso>
</server>
<ha>
<mode>networked-active-passive</mode>
<networked-active-passive>
<election-time>5</election-time>
</networked-active-passive>
</ha>
</servers>
<clients>
<logs>/terracotta/client-logs</logs>
</clients>

Specify Different paths for the <data> and <logs> for each server . Right now both the servers have same data and log directory that's why the error. Also I would suggest you to go through our website and read about the products , you will find many such basic details there .

You can change the max Runtime memory in the server-start.sh script inside bin folder .

I will change the <data>and<logs> for each server,then try again.
And How can I change the max Runtime memory in the server-start.sh ?

2013-03-02 14:57:18,403 [WorkerThread(client_handshake_stage, 0)] INFO tc.operator.event - NODE : CACHE93 Subsystem: CLUSTER_TOPOLOGY Message: Node ClientID[54] joined the cluster
2013-03-02 14:57:18,417 [WorkerThread(jmxremote_tunnel_stage, 0)] INFO com.tc.management.remote.protocol.terracotta.ClientTunnelingEventHandler - L1[ChannelID=[54]] notified us that their JMX server is now available
2013-03-02 14:57:30,354 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:10001)] INFO com.tc.net.core.CoreNIOServices - IOException attempting to finish socket connection
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at com.tc.net.core.CoreNIOServices$CommThread.doConnect(CoreNIOServices.java:676)
at com.tc.net.core.CoreNIOServices$CommThread.selectLoop(CoreNIOServices.java:616)
at com.tc.net.core.CoreNIOServices$CommThread.run(CoreNIOServices.java:290)
2013-03-02 14:57:30,355 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:10001)] INFO com.tc.net.core.TCConnectionManager - error event on connection com.tc.net.core.TCConnectionImpl@1414405406: connected: false, closed: false connect=[no connect time] idle=21001ms [0 read, 0 write]: Connection timed out
2013-03-02 14:57:30,355 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:10001)] INFO com.tc.net.protocol.transport.ConnectionHealthCheckerImpl. DSO Server - Config Factor updated from 1 to 3

I have two terracotta TCserver,one server sometimes show me these logs.
What's wrong?