[MarkLogic Dev General] ML 5 giving different result count than ML4.2

amit gope amitgope2 at gmail.com
Wed Aug 22 08:26:09 PDT 2012


Hi All,

Just to add to my query, ML 4.2 is giving results correctly irrespective of
the filter used being "filtered" or "unfiltered". But when i change my
query from unfiltered to filtered it gives me the correct result. Please
suggest.

Regards
Amit

On 22 August 2012 20:20, <general-request at developer.marklogic.com> wrote:

> Send General mailing list submissions to
>         general at developer.marklogic.com
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         http://developer.marklogic.com/mailman/listinfo/general
> or, via email, send a message with subject or body 'help' to
>         general-request at developer.marklogic.com
>
> You can reach the person managing the list at
>         general-owner at developer.marklogic.com
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of General digest..."
>
> Today's Topics:
>
>    1. Number of threads for ML app (Danny Sinang)
>    2. Option to not hit cache (Danny Sinang)
>    3. Re: Option to not hit cache (David Lee)
>    4. ML 5 giving different result count than   ML4.2 (amit gope)
>    5. Re: Option to not hit cache (Wayne Feick)
>    6. Re: Option to not hit cache (semerau at hotmail.com)
>    7. Re: Number of threads for ML app (Michael Blakeley)
>    8. Re: Option to not hit cache (Michael Blakeley)
>
>
> ---------- Forwarded message ----------
> From: Danny Sinang <d.sinang at gmail.com>
> To: general <General at developer.marklogic.com>
> Cc:
> Date: Wed, 22 Aug 2012 07:33:54 -0400
> Subject: [MarkLogic Dev General] Number of threads for ML app
> Hi,
>
> Our ML server is hosted by a machine with 16 cores with hypterthreading so
> it looks like it has 32 cores total.
>
> Our main ML app is configured to use 32 threads with a backlog of 256
> . Should we stick to this setting or can we bump up the number of threads
> to handle more requests simultaneously ?
>
> My colleague thinks we should match the number of ML threads to the number
> of threads accepted by the application servers call ML services. I,
> however, think we can't and shouldn't go beyond 32 because that's the
> actual number of cores our machine has.
>
> Would appreciate any advice on this matter.
>
> Regards,
> Danny
>
>
> ---------- Forwarded message ----------
> From: Danny Sinang <d.sinang at gmail.com>
> To: general <General at developer.marklogic.com>
> Cc:
> Date: Wed, 22 Aug 2012 08:00:15 -0400
> Subject: [MarkLogic Dev General] Option to not hit cache
> Hi,
>
> Is there an option in xquery, cts:search, or search:search telling ML not
> to fetch results from the cache ?
>
> We need to test the performance of some queries and we want to see its
> actual speed not coming from the cache.
>
> Regards,
> Danny
>
>
>
> ---------- Forwarded message ----------
> From: David Lee <David.Lee at marklogic.com>
> To: MarkLogic Developer Discussion <general at developer.marklogic.com>
> Cc:
> Date: Wed, 22 Aug 2012 05:03:01 -0700
> Subject: Re: [MarkLogic Dev General] Option to not hit cache
>
> Good question.****
>
> Dumb suggestion:  reboot the server between each query  ?****
>
> ** **
>
> ** **
>
>
> -----------------------------------------------------------------------------
> ****
>
> David Lee
> Lead Engineer
> MarkLogic Corporation
> dlee at marklogic.com
> Phone: +1 812-482-5224****
>
> Cell:  +1 812-630-7622
> www.marklogic.com
>
> This e-mail and any accompanying attachments are confidential. The
> information is intended solely for the use of the individual to whom it is
> addressed. Any review, disclosure, copying, distribution, or use of this
> e-mail communication by others is strictly prohibited. If you are not the
> intended recipient, please notify us immediately by returning this message
> to the sender and delete all copies. Thank you for your cooperation.****
>
> ** **
>
> *From:* general-bounces at developer.marklogic.com [mailto:
> general-bounces at developer.marklogic.com] *On Behalf Of *Danny Sinang
> *Sent:* Wednesday, August 22, 2012 8:00 AM
> *To:* general
> *Subject:* [MarkLogic Dev General] Option to not hit cache****
>
> ** **
>
> Hi,****
>
> ** **
>
> Is there an option in xquery, cts:search, or search:search telling ML not
> to fetch results from the cache ?****
>
> ** **
>
> We need to test the performance of some queries and we want to see its
> actual speed not coming from the cache.****
>
> ** **
>
> Regards,****
>
> Danny****
>
> ** **
>
>
> ---------- Forwarded message ----------
> From: amit gope <amitgope2 at gmail.com>
> To: general at developer.marklogic.com
> Cc:
> Date: Wed, 22 Aug 2012 17:44:31 +0530
> Subject: [MarkLogic Dev General] ML 5 giving different result count than
> ML4.2
> Hello All,
>
> I have a search query, and while running the query on Ml5.0 the result
> count is almost the double than what it returns on ML4.2 . Can anyone
> suggest what can be the cause of this behaviour?
>
> --
> Regards
> Amit
>
>
>
>
> ---------- Forwarded message ----------
> From: Wayne Feick <Wayne.Feick at marklogic.com>
> To: MarkLogic Developer Discussion <general at developer.marklogic.com>
> Cc: general <General at developer.marklogic.com>
> Date: Wed, 22 Aug 2012 05:59:51 -0700
> Subject: Re: [MarkLogic Dev General] Option to not hit cache
>
> No, there isn't. Your best bet would be to stop the server, clear OS caching from memory (e.g. unmount and remount the filesystem), and then restart the server again.
>
> Wayne
>
> Danny Sinang <d.sinang at gmail.com> wrote:
>
>
> Hi,
>
>  Is there an option in xquery, cts:search, or search:search telling ML
> not to fetch results from the cache ?
>
>  We need to test the performance of some queries and we want to see its
> actual speed not coming from the cache.
>
>  Regards,
> Danny
>
>
>
> ---------- Forwarded message ----------
> From: "semerau at hotmail.com" <semerau at hotmail.com>
> To: MarkLogic Developer Discussion <general at developer.marklogic.com>
> Cc: MarkLogic Developer Discussion <general at developer.marklogic.com>
> Date: Wed, 22 Aug 2012 08:21:50 -0600
> Subject: Re: [MarkLogic Dev General] Option to not hit cache
> What about setting the amounts for expanded and compressed tree caches to
> be really small? Would that work?
>
> Sent from my iPhone
>
> On Aug 22, 2012, at 7:01 AM, "Wayne Feick" <Wayne.Feick at marklogic.com>
> wrote:
>
> No, there isn't. Your best bet would be to stop the server, clear OS caching from memory (e.g. unmount and remount the filesystem), and then restart the server again.
>
> Wayne
>
> Danny Sinang <d.sinang at gmail.com> wrote:
>
>
> Hi,
>
>  Is there an option in xquery, cts:search, or search:search telling ML
> not to fetch results from the cache ?
>
>  We need to test the performance of some queries and we want to see its
> actual speed not coming from the cache.
>
>  Regards,
> Danny
>
>  _______________________________________________
> General mailing list
> General at developer.marklogic.com
> http://developer.marklogic.com/mailman/listinfo/general
>
>
>
> ---------- Forwarded message ----------
> From: Michael Blakeley <mike at blakeley.com>
> To: MarkLogic Developer Discussion <general at developer.marklogic.com>
> Cc:
> Date: Wed, 22 Aug 2012 07:43:10 -0700
> Subject: Re: [MarkLogic Dev General] Number of threads for ML app
> Your workload should guide you to the correct number of threads. I would
> start with 2x cores, because of network latency.
>
> You may also want to consider a load balancer and/or reverse-proxy in
> front of MarkLogic. The benefits from operational flexibility should be
> clear. But in the case where you need to handle large numbers of requests
> from distant, high-latency clients, this gives you a cheap place to buffer
> them up. If your clients are few and well-connected, this is less of an
> issue. But the operational flexibility is still useful.
>
> -- Mike
>
> On 22 Aug 2012, at 04:33 , Danny Sinang wrote:
>
> > Hi,
> >
> > Our ML server is hosted by a machine with 16 cores with hypterthreading
> so it looks like it has 32 cores total.
> >
> > Our main ML app is configured to use 32 threads with a backlog of 256 .
> Should we stick to this setting or can we bump up the number of threads to
> handle more requests simultaneously ?
> >
> > My colleague thinks we should match the number of ML threads to the
> number of threads accepted by the application servers call ML services. I,
> however, think we can't and shouldn't go beyond 32 because that's the
> actual number of cores our machine has.
> >
> > Would appreciate any advice on this matter.
> >
> > Regards,
> > Danny
> > _______________________________________________
> > General mailing list
> > General at developer.marklogic.com
> > http://developer.marklogic.com/mailman/listinfo/general
>
>
>
>
> ---------- Forwarded message ----------
> From: Michael Blakeley <mike at blakeley.com>
> To: MarkLogic Developer Discussion <general at developer.marklogic.com>
> Cc:
> Date: Wed, 22 Aug 2012 07:50:46 -0700
> Subject: Re: [MarkLogic Dev General] Option to not hit cache
> List cache and expanded-tree cache have to be large enough for the queries
> you are running or you'll just get CACHEFULL errors. You can set
> compressed-tree to 1, but the OS will just cache more of that data for you.
>
> Clearing the OS cache won't clear disk-level and controller-level caches.
> In my experience those will make a measurable difference.
>
> The best solution is to design the workload so that it represent the real
> application workload. A representative workload will use the various
> hardware and software caches to the same extent that the real application
> does, so no tricks will be needed. This is why database workloads are
> typically large: 3x memory is a good rule of thumb. At that point the
> access pattern and concurrency level will dictate cache utilization.
>
> Of course designing a good workload is hard, so folks look for shortcuts.
> But this shortcut ends in a ditch.
>
> -- Mike
>
> On 22 Aug 2012, at 07:21 , semerau at hotmail.com wrote:
>
> > What about setting the amounts for expanded and compressed tree caches
> to be really small? Would that work?
> >
> > Sent from my iPhone
> >
> > On Aug 22, 2012, at 7:01 AM, "Wayne Feick" <Wayne.Feick at marklogic.com>
> wrote:
> >
> >> No, there isn't. Your best bet would be to stop the server, clear OS
> caching from memory (e.g. unmount and remount the filesystem), and then
> restart the server again.
> >>
> >> Wayne
> >>
> >> Danny Sinang <
> >> d.sinang at gmail.com
> >> > wrote:
> >>
> >>
> >> Hi,
> >>
> >> Is there an option in xquery, cts:search, or search:search telling ML
> not to fetch results from the cache ?
> >>
> >> We need to test the performance of some queries and we want to see its
> actual speed not coming from the cache.
> >>
> >> Regards,
> >> Danny
> >>
> >> _______________________________________________
> >> General mailing list
> >> General at developer.marklogic.com
> >> http://developer.marklogic.com/mailman/listinfo/general
> > _______________________________________________
> > General mailing list
> > General at developer.marklogic.com
> > http://developer.marklogic.com/mailman/listinfo/general
>
>
>
> _______________________________________________
> General mailing list
> General at developer.marklogic.com
> http://developer.marklogic.com/mailman/listinfo/general
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://developer.marklogic.com/pipermail/general/attachments/20120822/52934e0d/attachment-0001.html 


More information about the General mailing list