[MarkLogic Dev General] parallel document insertion

Danny Sokolsky Danny.Sokolsky at marklogic.com
Tue Oct 25 09:21:13 PDT 2011


Are you using a recent version of xcc?  Or of MarkLogic?  How busy was the server during these errors?

-Danny 

-----Original Message-----
From: general-bounces at developer.marklogic.com [mailto:general-bounces at developer.marklogic.com] On Behalf Of Lee, David
Sent: Tuesday, October 25, 2011 9:20 AM
To: General MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] parallel document insertion

Never seen this myself.
I do massively parallel document uploads in xmlsh marklogic extension (ml:put  http://www.xmlsh.org/MarkLogicPut )
I've had weird errors but not this one.

Strange.


----------------------------------------
David A. Lee
Senior Principal Software Engineer
Epocrates, Inc.
dlee at epocrates.com
812-482-5224

-----Original Message-----
From: general-bounces at developer.marklogic.com [mailto:general-bounces at developer.marklogic.com] On Behalf Of Mike Sokolov
Sent: Tuesday, October 25, 2011 10:40 AM
To: General Mark Logic Developer Discussion
Subject: [MarkLogic Dev General] parallel document insertion

I've been experimenting with a multithreaded document loader; I get a 
substantial speedup, which is great.  I'm inserting documents using the 
java XCC API. Every now and then though, I get a 
RequestPermissionException with the message

"Authorization failed for user 'xxxx'"

If I retry the insertion immediately, it invariably succeeds, although 
the exception has isRetryAdvised() == false.

I'm sure the authentication is the same for all these requests.  I get 
this error even when none of the documents have the same uri; so there 
shouldn't be any conflicts or race conditions related to which thread 
wins, at least not anything obvious like trying to write the same 
document twice.  At least I'm pretty sure that's not it?

I'll send something to support I guess, but before doing the work to 
wrap this up in a neat reproducible package I thought I'd see if anyone 
had run into this before - anyone?

-- 
Michael Sokolov
Engineering Director
www.ifactory.com

_______________________________________________
General mailing list
General at developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general
_______________________________________________
General mailing list
General at developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general


More information about the General mailing list