[MarkLogic Dev General] Not enough disk space when merging

Gene.Thomas at mitchell1.com Gene.Thomas at mitchell1.com
Tue Aug 7 10:06:31 PDT 2012


Our solution to this problem is to merge a different forest each day to
keep the merges from requiring so much disk space.

-----Original Message-----
From: general-bounces at developer.marklogic.com
[mailto:general-bounces at developer.marklogic.com] On Behalf Of Michael
Blakeley
Sent: Tuesday, August 07, 2012 9:33 AM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] Not enough disk space when merging

I don't think a max merge size will help. If the forest could find a
smaller set of stands to merge, it would.

You could try lowering the merge ratio to 1. This is unlikely to make
any difference, but it's worth a try. Restart the forest after making
any changes, so it can come out of the error state.

If you are using an older version of MarkLogic you may be able to
disable merges. If you do this, do *not* allow any updates. Ideally,
force the forest into read-only or delete-only mode. Otherwise you will
likely make the situation even worse.

In any case, running a filesystem down to 17-GiB is an ugly situation to
be in. Sorry I can't offer any suggestions, but I hope at least one DBA
will read about this and start monitoring free disk space.

-- Mike

On 7 Aug 2012, at 08:45 , Gary Larsen wrote:

> I read this but did not fully understand the impact.  Fortunately the
customer found an old backup to delete and gained an additional 12Gb so
hopefully the merge will complete.
>  
> Gary
>  
> From: general-bounces at developer.marklogic.com
[mailto:general-bounces at developer.marklogic.com] On Behalf OfGeert
Josten
> Sent: Tuesday, August 07, 2012 11:20 AM
> To: MarkLogic Developer Discussion
> Subject: Re: [MarkLogic Dev General] Not enough disk space when
merging
>  
> Hi Gary,
>  
> That is would the help seems to indicate:
>  
> merge max size specifies the maximum size, in megabytes, of a stand
that will result from a merge. If a stand grows beyond the specified
size, it will not be merged. If two stands would be larger than the
specified size if merged, they will not be merged together. If you set
this to smaller sizes, large merges (which may require more disk and CPU
resources) will be prevented. Set this to 0 (the default) to allow any
sized stand to merge. Use care when setting this to a non-zero value, as
this can prevent merges which are ultimately required for the system to
maintain performance levels and to allow optimized updates to the
system.
>  
> (You can find a help link at any admin page..)
>  
> So, I think this will pretty much only prevent merge errors from
appearing in the error log.. :-/
>  
> Kind regards,
> Geert
>  
> Van: general-bounces at developer.marklogic.com
[mailto:general-bounces at developer.marklogic.com] Namens Gary Larsen
> Verzonden: dinsdag 7 augustus 2012 17:06
> Aan: 'MarkLogic Developer Discussion'
> Onderwerp: Re: [MarkLogic Dev General] Not enough disk space when
merging
>  
> Thanks for the advice on this problem.
>  
> The merge error says it needs 17Gb of disk space.   Would setting the
'max merge size' be any help in this case?  The admin guide sounds like
this is not really recommended, but if I set this to 8Gb that wouldn't
that limit the disk space required?  I guess the down side of this would
be that existing large stands would never get merged.
>  
> Gary Larsen
> Envisn Inc.
> 978-779-0400 x202
> 508-259-6465 (cell)
>  
> From: general-bounces at developer.marklogic.com
[mailto:general-bounces at developer.marklogic.com] On Behalf Of Geert
Josten
> Sent: Tuesday, August 07, 2012 10:47 AM
> To: MarkLogic Developer Discussion
> Subject: Re: [MarkLogic Dev General] Not enough disk space when
merging
>  
> Hi Gary,
>  
> If you have multiple forests connected to your database, you could
merge them one by one. Merge the smallest first.
>  
> Alternatively, disconnect other forests/databases, and move them away
temporarily. Probably not an option on production I'm afraid.
>  
> Another option might be to temporarily move part of your data to an
external location. That comes with a performance penalty though..
>  
> Kind regards,
> Geert
>  
> Van: general-bounces at developer.marklogic.com
[mailto:general-bounces at developer.marklogic.com] NamensGary Larsen
> Verzonden: dinsdag 7 augustus 2012 15:28
> Aan: 'MarkLogic Developer Discussion'
> Onderwerp: [MarkLogic Dev General] Not enough disk space when merging
>  
> Hi,
>  
> Until an addition drive can be added to the server, is there some way
to configure the merge to use less disk space?
>  
> <image001.png>
>  
> Thanks,
> Gary
>  
> _______________________________________________
> General mailing list
> General at developer.marklogic.com
> http://developer.marklogic.com/mailman/listinfo/general

_______________________________________________
General mailing list
General at developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general


More information about the General mailing list