[MarkLogic Dev General] Reprocessing error documents in CPF

Danny Sokolsky Danny.Sokolsky at marklogic.com
Thu Oct 24 13:13:14 PDT 2013


I don't think so; "done" is just a state like "error".  The pipeline responds to events which are triggered on the document (like an update), and the pipeline defines what occurs when the event is triggered (typically running some action that, when complete, moves the document to a different state).

-Danny

From: general-bounces at developer.marklogic.com [mailto:general-bounces at developer.marklogic.com] On Behalf Of Geert Josten
Sent: Thursday, October 24, 2013 12:18 PM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] Reprocessing error documents in CPF

I thought that once no action is found for a document state (error or other), it reaches 'done' status, which can't be flushed with just touching it. But I can be mistaken..

Van: general-bounces at developer.marklogic.com<mailto:general-bounces at developer.marklogic.com> [mailto:general-bounces at developer.marklogic.com<mailto:general-bounces at developer.marklogic.com>] Namens Danny Sokolsky
Verzonden: donderdag 24 oktober 2013 19:50
Aan: MarkLogic Developer Discussion
Onderwerp: Re: [MarkLogic Dev General] Reprocessing error documents in CPF

Or, if you have an update action on your pipeline, you can just do an update to the documents that are in the error state (after corrected the error state, if appropriate).  CPF is fired by triggers, and you can configure it to be triggered by create and/or update.

So if you have an update action, you can, for example, to a node replace of a node on the document and replace it with the same contents.  This is sort of like touch in a UNIX world.

-Danny

From: general-bounces at developer.marklogic.com<mailto:general-bounces at developer.marklogic.com> [mailto:general-bounces at developer.marklogic.com] On Behalf Of Geert Josten
Sent: Thursday, October 24, 2013 7:46 AM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] Reprocessing error documents in CPF

Hi Karthik,

I guess the simplest, and safest way is to re-ingest the original file. If your pipelines do a lot of transformation, how do you know how and where to continue processing?

But if necessary, you could simply change or flush the CPF-related (state/status/etc) properties of that document. You could simply use xdmp:document-set-properties for that purpose..

Cheers,
Geert

Van: general-bounces at developer.marklogic.com<mailto:general-bounces at developer.marklogic.com> [mailto:general-bounces at developer.marklogic.com<mailto:general-bounces at developer.marklogic.com>] Namens Karthik.Nagarajan2 at cognizant.com<mailto:Karthik.Nagarajan2 at cognizant.com>
Verzonden: donderdag 24 oktober 2013 16:14
Aan: general at developer.marklogic.com<mailto:general at developer.marklogic.com>
Onderwerp: [MarkLogic Dev General] Reprocessing error documents in CPF

Hi,

How to reprocess error documents in CPF from the state where it erred out?
For ex: a document can go to error state due to some configuration issues in my pipeline file or I can explicitly throw an error from my xqy code.
In those scenarios, how to reprocess the document?

Thanks,
Karthik

This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient(s), please reply to the sender and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or any action taken in reliance on the contents of this e-mail is strictly prohibited and may be unlawful.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://developer.marklogic.com/pipermail/general/attachments/20131024/7e83622a/attachment-0001.html 


More information about the General mailing list