[MarkLogic Dev General] parallel document insertion
Danny Sokolsky
Danny.Sokolsky at marklogic.com
Tue Oct 25 09:21:13 PDT 2011
Are you using a recent version of xcc? Or of MarkLogic? How busy was the server during these errors?
-Danny
-----Original Message-----
From: general-bounces at developer.marklogic.com [mailto:general-bounces at developer.marklogic.com] On Behalf Of Lee, David
Sent: Tuesday, October 25, 2011 9:20 AM
To: General MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] parallel document insertion
Never seen this myself.
I do massively parallel document uploads in xmlsh marklogic extension (ml:put http://www.xmlsh.org/MarkLogicPut )
I've had weird errors but not this one.
Strange.
----------------------------------------
David A. Lee
Senior Principal Software Engineer
Epocrates, Inc.
dlee at epocrates.com
812-482-5224
-----Original Message-----
From: general-bounces at developer.marklogic.com [mailto:general-bounces at developer.marklogic.com] On Behalf Of Mike Sokolov
Sent: Tuesday, October 25, 2011 10:40 AM
To: General Mark Logic Developer Discussion
Subject: [MarkLogic Dev General] parallel document insertion
I've been experimenting with a multithreaded document loader; I get a
substantial speedup, which is great. I'm inserting documents using the
java XCC API. Every now and then though, I get a
RequestPermissionException with the message
"Authorization failed for user 'xxxx'"
If I retry the insertion immediately, it invariably succeeds, although
the exception has isRetryAdvised() == false.
I'm sure the authentication is the same for all these requests. I get
this error even when none of the documents have the same uri; so there
shouldn't be any conflicts or race conditions related to which thread
wins, at least not anything obvious like trying to write the same
document twice. At least I'm pretty sure that's not it?
I'll send something to support I guess, but before doing the work to
wrap this up in a neat reproducible package I thought I'd see if anyone
had run into this before - anyone?
--
Michael Sokolov
Engineering Director
www.ifactory.com
_______________________________________________
General mailing list
General at developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general
_______________________________________________
General mailing list
General at developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general
More information about the General
mailing list