[MarkLogic Dev General] [XQSync] WARNING: unknown key: skipping URI_PREFIX_STRIP

Fri Sep 10 19:06:47 PDT 2010

Looks like that latest version works. It must have been a regression in the
other jar I was using.

Thanks!

On Fri, Sep 10, 2010 at 1:16 PM, Michael Blakeley <
michael.blakeley at marklogic.com> wrote:

> I'm glad you were able to rule that out. I'm running out of ideas, but I
> just noticed that the xqsync.jar you are using is a little old:
>
>
> INFO: XQSync starting: version 2009-11-07.1 on 1.6.0_21 (Java(TM) SE
> Runtime Environment)
>
> I don't recall any bugs like this in the past few months, but it's worth
> trying the latest jar.
>
> http://marklogic.github.com/xqsync/xqsync.jar
>
> -- Mike
>
>
> On 2010-09-10 10:19, Curtis Wilde wrote:
>
>> Agreed that it could be a windows only issue, but I've re-authored the
>> file in eclipse, setting the file type to UTF-8 and line endings to Unix,
>> and I still get the same error.
>>
>> Displaying whitespace shows no hidden characters.
>>
>> [cid:ii_12afc583ff1e0ed0]
>>
>>
>> Same with Cygwin
>>
>> $ od -c localdown.properties
>> 0000000   #  \r  \n   I   N   P   U   T   _   C   O   N   N   E   C   T
>> 0000020   I   O   N   _   S   T   R   I   N   G   =   x   c   c   :   /
>> 0000040   /   a   d   m   i   n   :   r   o   o   t   @   l   o   c   a
>> 0000060   l   h   o   s   t   :   8   0   3   0   /   C   r   e   a   t
>> 0000100   i   o   n  \r  \n   I   N   P   U   T   _   D   I   R   E   C
>> 0000120   T   O   R   Y   _   U   R   I   =   /   p   r   e   v   i   e
>> 0000140   w   /   s   h   a   r   e   d   /   c   o   n   t   e   n   t
>> 0000160   /   e   n   g   l   i   s   h   /  \r  \n   I   N   P   U   T
>> 0000200   _   B   A   T   C   H   _   S   I   Z   E   =   1  \r  \n   O
>> 0000220   U   T   P   U   T   _   P   A   C   K   A   G   E   =   m   y
>> 0000240   C   o   n   t   e   n   t   .   z   i   p  \r  \n   Q   U   E
>> 0000260   U   E   _   S   I   Z   E   =   1   0   0   0  \r  \n   T   H
>> 0000300   R   E   A   D   S   =   1  \r  \n   U   R   I   _   P   R   E
>> 0000320   F   I   X   _   S   T   R   I   P   =   /   p   r   e   v   i
>> 0000340   e   w   /   s   h   a   r   e   d   /   c   o   n   t   e   n
>> 0000360   t   /   e   n   g   l   i   s   h   /  \r  \n
>> 0000374
>>
>>
>> On Thu, Sep 9, 2010 at 7:11 PM, Michael Blakeley<
>> michael.blakeley at marklogic.com<mailto:michael.blakeley at marklogic.com>>
>>  wrote:
>>
>> This line makes me think you have some non-printable characters in your
>> property file:
>>
>> WARNING: unknown key: skipping ├»┬╗┬┐#
>>
>> That's probably a BOM on line 1. This is a common problem with several
>> Windows editors. Given that hint, it wouldn't surprise me to find another
>> invisible character of some kind on the line where URI_PREFIX_STRIP occurs.
>>
>> I don't use Windows regularly, myself. But I know that vim is available
>> for Windows. Maybe editing the file with vim would show you what's really in
>> there? You might also try 'od -c' in a cygwin shell.
>>
>> -- Mike
>>
>>
>> On 2010-09-09 16:54, Curtis Wilde wrote:
>> Sorry about that.
>>
>> Properties:
>>
>> #
>> OUTPUT_CONNECTION_STRING=xcc://admin:root@localhost:8030/Creation
>> URI_PREFIX=/preview/shared/content/english/
>> ALLOW_EMPTY_METADATA=true
>> INPUT_PACKAGE=magazines.zip
>> QUEUE_SIZE=1000
>> REPAIR_INPUT_XML=true
>> SKIP_EXISTING=true
>> THREADS=2
>>
>> Output:
>>
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.SimpleLogger configureLogger
>> INFO: setting up com.marklogic.ps.SimpleLogger at c17164 for:
>> com.marklogic.ps<http://com.marklogic.ps><http://com.marklogic.ps>
>>
>>
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using OUTPUT_PACKAGE=myContent.zip
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> WARNING: unknown key: skipping URI_PREFIX_STRIP
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using INPUT_BATCH_SIZE=1
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using THREADS=1
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using INPUT_DIRECTORY_URI=/preview/shared/content/english/
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> WARNING: unknown key: skipping ├»┬╗┬┐#
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using INPUT_CONNECTION_STRING=xcc://admin:root@localhost
>> :8030/Creation
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> WARNING: unknown key: skipping awt.toolkit
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using QUEUE_SIZE=1000
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.Configuration
>> configureInput
>> INFO: input from connection: xcc://admin:root@localhost:8030/Creation
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.Configuration
>> configureOutput
>> INFO: output to package: myContent.zip
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSync main
>> INFO: XQSync starting: version 2009-11-07.1 on 1.6.0_21 (Java(TM) SE
>> Runtime Environment)
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSync main
>> INFO: XCC version = 4.1-6
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager run
>> INFO: starting pool of 1 threads, queue size = 1000
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.TaskFactory<init>
>> INFO: creating 1 writer(s)
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.Monitor run
>> INFO: starting
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager run
>> INFO: input version info: client 4.1-6, server 4.1-6
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager
>> queueFromInputConnection
>> INFO: buffer size = 0, caching = false
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager
>> getDirectoryRequest
>> INFO: listing directory /preview/shared/content/english/
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager
>> queueFromInputConnection
>> INFO: queuing first task:
>> /preview/shared/content/english/magazines/ensign/1971/03001_000_000.xml
>> Sep 9, 2010 5:49:22 PM com.marklogic.ps.xqsync.OutputPackage
>> newOutputStream
>> INFO: new output package C:\xqsync\myContent.zip -0
>> Sep 9, 2010 5:49:22 PM com.marklogic.ps.xqsync.Monitor monitor
>> INFO: 1/963, 3 events/s, 1055 kB/s,
>> /preview/shared/content/english/magazines/ensign/1971/03001_000_000.xml
>> Sep 9, 2010 5:49:24 PM com.marklogic.ps.xqsync.XQSyncManager run
>> INFO: queued 38641 items
>>
>> On Thu, Sep 9, 2010 at 3:52 PM, Michael Blakeley<
>> michael.blakeley at marklogic.com<mailto:michael.blakeley at marklogic.com
>> ><mailto:michael.blakeley at marklogic.com<mailto:
>> michael.blakeley at marklogic.com>>>   wrote:
>>
>> My guess is that it's a subtle typo, but all I can say from this info is
>> "works for me". You've omitted the the output, which might help.
>>
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.SimpleLogger configureLogger
>> INFO: setting up com.marklogic.ps.SimpleLogger at afa7e74 for:
>> com.marklogic.ps<http://com.marklogic.ps><http://com.marklogic.ps>
>>
>>
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.XQSync main
>> INFO: XQSync starting: version 2010-08-24.1 on 1.6.0_18 (OpenJDK Runtime
>> Environment)
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.XQSync main
>> INFO: XCC version = 4.1-6
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.SimpleLogger configureLogger
>> INFO: setting up com.marklogic.ps.SimpleLogger at afa7e74 for:
>> com.marklogic.ps<http://com.marklogic.ps><http://com.marklogic.ps>
>>
>>
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.Configuration setProperties
>> INFO: first-time setup
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.SimpleLogger configureLogger
>> INFO: setting up com.marklogic.ps.SimpleLogger at afa7e74 for:
>> com.marklogic.ps<http://com.marklogic.ps><http://com.marklogic.ps>
>>
>>
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using URI_PREFIX_STRIP=/input/
>> ...
>>
>> -- Mike
>>
>>
>> On 2010-09-09 12:45, Curtis Wilde wrote:
>> It seems XQSync either doesn't understand this key, or I'm using it
>> improperly. The contents of my properties file are below:
>>
>> Windows 7x64
>> Java 6 update 21 (32-bit)
>>
>> #begin properties
>> INPUT_CONNECTION_STRING=xcc://user:pass@localhost:8080/Database
>> INPUT_DIRECTORY_URI=/input/directory/
>> OUTPUT_PACKAGE=myContent.zip
>> QUEUE_SIZE=1000
>> THREADS=1
>> URI_PREFIX_STRIP=/input/
>>
>>
>>
>>
>>
>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://developer.marklogic.com/pipermail/general/attachments/20100910/6a802818/attachment-0001.html 