[Logo] Terracotta Discussion Forums (LEGACY READ-ONLY ARCHIVE)
  [Search] Search   [Recent Topics] Recent Topics   [Members]  Member Listing   [Groups] Back to home page 
[Register] Register / 
[Login] Login 
[Expert]
BigMemory using disk storage even when offheap is not full  XML
Forum Index -> BigMemory
Author Message
sjadeter

neo

Joined: 10/29/2012 14:06:49
Messages: 2
Offline

Hi,

I may not be using some configuration properties properly.

Here is the cache config without having any disk storage:

<cache name="InMemAndBigMemTest"
eternal="true"
maxEntriesLocalHeap="10000000"
overflowToOffHeap="true"
maxBytesLocalOffHeap="2G"
copyOnRead="false"
statistics="true"
memoryStoreEvictionPolicy="LFU">
<persistence strategy="none"/>
</cache>

It took about 15 sec to insert 1.5million records.

I changed the configuration to:

<cache name="InMemAndBigMemTest"
eternal="true"
maxEntriesLocalHeap="10000000"
overflowToOffHeap="true"
maxBytesLocalOffHeap="2G"
copyOnRead="false"
statistics="true"
memoryStoreEvictionPolicy="LFU">
<persistence strategy="localTempSwap"/>
</cache>

My understanding was that the disk persistence would be used when the off heap becomes full. I was expecting the same performance for the insertion of 1.5million records. However, it took, ~7 minutes!!

It completely baffles me... Can someone explain or point me in the right direction?

Thanks much!!
cdennis

master

Joined: 01/19/2009 10:03:26
Messages: 89
Offline

The disk persistence settings do not work in that way. If you run with localTempSwap on it will put everything to disk initially. The offheap and heap will act as read caches for that disk layer. This is why you don't see the write throughput you expect.

Chris Dennis (Terracotta Engineer)
sjadeter

neo

Joined: 10/29/2012 14:06:49
Messages: 2
Offline

Thanks so much Chris.

So, what would be the right configuration to use the disk after the local and off-heap are full respectively.

Thanks much!
 
Forum Index -> BigMemory
Go to:   
Powered by JForum 2.1.7 © JForum Team