[MarkLogic Dev General] Not enough disk space when merging

Geert Josten geert.josten at dayon.nl
Tue Aug 7 10:37:05 PDT 2012


Nice, and easy to schedule..

Kind regards,
Geert

> -----Oorspronkelijk bericht-----
> Van: general-bounces at developer.marklogic.com [mailto:general-
> bounces at developer.marklogic.com] Namens Gene.Thomas at mitchell1.com
> Verzonden: dinsdag 7 augustus 2012 19:07
> Aan: general at developer.marklogic.com
> Onderwerp: Re: [MarkLogic Dev General] Not enough disk space when
merging
>
> Our solution to this problem is to merge a different forest each day to
> keep the merges from requiring so much disk space.
>
> -----Original Message-----
> From: general-bounces at developer.marklogic.com
> [mailto:general-bounces at developer.marklogic.com] On Behalf Of Michael
> Blakeley
> Sent: Tuesday, August 07, 2012 9:33 AM
> To: MarkLogic Developer Discussion
> Subject: Re: [MarkLogic Dev General] Not enough disk space when merging
>
> I don't think a max merge size will help. If the forest could find a
> smaller set of stands to merge, it would.
>
> You could try lowering the merge ratio to 1. This is unlikely to make
> any difference, but it's worth a try. Restart the forest after making
> any changes, so it can come out of the error state.
>
> If you are using an older version of MarkLogic you may be able to
> disable merges. If you do this, do *not* allow any updates. Ideally,
> force the forest into read-only or delete-only mode. Otherwise you will
> likely make the situation even worse.
>
> In any case, running a filesystem down to 17-GiB is an ugly situation to
> be in. Sorry I can't offer any suggestions, but I hope at least one DBA
> will read about this and start monitoring free disk space.
>
> -- Mike
>
> On 7 Aug 2012, at 08:45 , Gary Larsen wrote:
>
> > I read this but did not fully understand the impact.  Fortunately the
> customer found an old backup to delete and gained an additional 12Gb so
> hopefully the merge will complete.
> >
> > Gary
> >
> > From: general-bounces at developer.marklogic.com
> [mailto:general-bounces at developer.marklogic.com] On Behalf OfGeert
> Josten
> > Sent: Tuesday, August 07, 2012 11:20 AM
> > To: MarkLogic Developer Discussion
> > Subject: Re: [MarkLogic Dev General] Not enough disk space when
> merging
> >
> > Hi Gary,
> >
> > That is would the help seems to indicate:
> >
> > merge max size specifies the maximum size, in megabytes, of a stand
> that will result from a merge. If a stand grows beyond the specified
> size, it will not be merged. If two stands would be larger than the
> specified size if merged, they will not be merged together. If you set
> this to smaller sizes, large merges (which may require more disk and CPU
> resources) will be prevented. Set this to 0 (the default) to allow any
> sized stand to merge. Use care when setting this to a non-zero value, as
> this can prevent merges which are ultimately required for the system to
> maintain performance levels and to allow optimized updates to the
> system.
> >
> > (You can find a help link at any admin page..)
> >
> > So, I think this will pretty much only prevent merge errors from
> appearing in the error log.. :-/
> >
> > Kind regards,
> > Geert
> >
> > Van: general-bounces at developer.marklogic.com
> [mailto:general-bounces at developer.marklogic.com] Namens Gary Larsen
> > Verzonden: dinsdag 7 augustus 2012 17:06
> > Aan: 'MarkLogic Developer Discussion'
> > Onderwerp: Re: [MarkLogic Dev General] Not enough disk space when
> merging
> >
> > Thanks for the advice on this problem.
> >
> > The merge error says it needs 17Gb of disk space.   Would setting the
> 'max merge size' be any help in this case?  The admin guide sounds like
> this is not really recommended, but if I set this to 8Gb that wouldn't
> that limit the disk space required?  I guess the down side of this would
> be that existing large stands would never get merged.
> >
> > Gary Larsen
> > Envisn Inc.
> > 978-779-0400 x202
> > 508-259-6465 (cell)
> >
> > From: general-bounces at developer.marklogic.com
> [mailto:general-bounces at developer.marklogic.com] On Behalf Of Geert
> Josten
> > Sent: Tuesday, August 07, 2012 10:47 AM
> > To: MarkLogic Developer Discussion
> > Subject: Re: [MarkLogic Dev General] Not enough disk space when
> merging
> >
> > Hi Gary,
> >
> > If you have multiple forests connected to your database, you could
> merge them one by one. Merge the smallest first.
> >
> > Alternatively, disconnect other forests/databases, and move them away
> temporarily. Probably not an option on production I'm afraid.
> >
> > Another option might be to temporarily move part of your data to an
> external location. That comes with a performance penalty though..
> >
> > Kind regards,
> > Geert
> >
> > Van: general-bounces at developer.marklogic.com
> [mailto:general-bounces at developer.marklogic.com] NamensGary Larsen
> > Verzonden: dinsdag 7 augustus 2012 15:28
> > Aan: 'MarkLogic Developer Discussion'
> > Onderwerp: [MarkLogic Dev General] Not enough disk space when merging
> >
> > Hi,
> >
> > Until an addition drive can be added to the server, is there some way
> to configure the merge to use less disk space?
> >
> > <image001.png>
> >
> > Thanks,
> > Gary
> >
> > _______________________________________________
> > General mailing list
> > General at developer.marklogic.com
> > http://developer.marklogic.com/mailman/listinfo/general
>
> _______________________________________________
> General mailing list
> General at developer.marklogic.com
> http://developer.marklogic.com/mailman/listinfo/general
> _______________________________________________
> General mailing list
> General at developer.marklogic.com
> http://developer.marklogic.com/mailman/listinfo/general


More information about the General mailing list