[MarkLogic Dev General] [XQSync] WARNING: unknown key: skipping URI_PREFIX_STRIP

Fri Sep 10 12:16:03 PDT 2010

I'm glad you were able to rule that out. I'm running out of ideas, but I 
just noticed that the xqsync.jar you are using is a little old:

INFO: XQSync starting: version 2009-11-07.1 on 1.6.0_21 (Java(TM) SE 
Runtime Environment)

I don't recall any bugs like this in the past few months, but it's worth 
trying the latest jar.

http://marklogic.github.com/xqsync/xqsync.jar

-- Mike

On 2010-09-10 10:19, Curtis Wilde wrote:
> Agreed that it could be a windows only issue, but I've re-authored the file in eclipse, setting the file type to UTF-8 and line endings to Unix, and I still get the same error.
>
> Displaying whitespace shows no hidden characters.
>
> [cid:ii_12afc583ff1e0ed0]
>
> Same with Cygwin
>
> $ od -c localdown.properties
> 0000000   #  \r  \n   I   N   P   U   T   _   C   O   N   N   E   C   T
> 0000020   I   O   N   _   S   T   R   I   N   G   =   x   c   c   :   /
> 0000040   /   a   d   m   i   n   :   r   o   o   t   @   l   o   c   a
> 0000060   l   h   o   s   t   :   8   0   3   0   /   C   r   e   a   t
> 0000100   i   o   n  \r  \n   I   N   P   U   T   _   D   I   R   E   C
> 0000120   T   O   R   Y   _   U   R   I   =   /   p   r   e   v   i   e
> 0000140   w   /   s   h   a   r   e   d   /   c   o   n   t   e   n   t
> 0000160   /   e   n   g   l   i   s   h   /  \r  \n   I   N   P   U   T
> 0000200   _   B   A   T   C   H   _   S   I   Z   E   =   1  \r  \n   O
> 0000220   U   T   P   U   T   _   P   A   C   K   A   G   E   =   m   y
> 0000240   C   o   n   t   e   n   t   .   z   i   p  \r  \n   Q   U   E
> 0000260   U   E   _   S   I   Z   E   =   1   0   0   0  \r  \n   T   H
> 0000300   R   E   A   D   S   =   1  \r  \n   U   R   I   _   P   R   E
> 0000320   F   I   X   _   S   T   R   I   P   =   /   p   r   e   v   i
> 0000340   e   w   /   s   h   a   r   e   d   /   c   o   n   t   e   n
> 0000360   t   /   e   n   g   l   i   s   h   /  \r  \n
> 0000374
>
>
> On Thu, Sep 9, 2010 at 7:11 PM, Michael Blakeley<michael.blakeley at marklogic.com<mailto:michael.blakeley at marklogic.com>>  wrote:
> This line makes me think you have some non-printable characters in your property file:
>
> WARNING: unknown key: skipping ├»┬╗┬┐#
>
> That's probably a BOM on line 1. This is a common problem with several Windows editors. Given that hint, it wouldn't surprise me to find another invisible character of some kind on the line where URI_PREFIX_STRIP occurs.
>
> I don't use Windows regularly, myself. But I know that vim is available for Windows. Maybe editing the file with vim would show you what's really in there? You might also try 'od -c' in a cygwin shell.
>
> -- Mike
>
>
> On 2010-09-09 16:54, Curtis Wilde wrote:
> Sorry about that.
>
> Properties:
>
> #
> OUTPUT_CONNECTION_STRING=xcc://admin:root@localhost:8030/Creation
> URI_PREFIX=/preview/shared/content/english/
> ALLOW_EMPTY_METADATA=true
> INPUT_PACKAGE=magazines.zip
> QUEUE_SIZE=1000
> REPAIR_INPUT_XML=true
> SKIP_EXISTING=true
> THREADS=2
>
> Output:
>
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.SimpleLogger configureLogger
> INFO: setting up com.marklogic.ps.SimpleLogger at c17164 for: com.marklogic.ps<http://com.marklogic.ps><http://com.marklogic.ps>
>
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration validateProperties
> INFO: using OUTPUT_PACKAGE=myContent.zip
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration validateProperties
> WARNING: unknown key: skipping URI_PREFIX_STRIP
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration validateProperties
> INFO: using INPUT_BATCH_SIZE=1
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration validateProperties
> INFO: using THREADS=1
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration validateProperties
> INFO: using INPUT_DIRECTORY_URI=/preview/shared/content/english/
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration validateProperties
> WARNING: unknown key: skipping ├»┬╗┬┐#
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration validateProperties
> INFO: using INPUT_CONNECTION_STRING=xcc://admin:root@localhost:8030/Creation
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration validateProperties
> WARNING: unknown key: skipping awt.toolkit
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration validateProperties
> INFO: using QUEUE_SIZE=1000
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.Configuration configureInput
> INFO: input from connection: xcc://admin:root@localhost:8030/Creation
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.Configuration configureOutput
> INFO: output to package: myContent.zip
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSync main
> INFO: XQSync starting: version 2009-11-07.1 on 1.6.0_21 (Java(TM) SE Runtime Environment)
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSync main
> INFO: XCC version = 4.1-6
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager run
> INFO: starting pool of 1 threads, queue size = 1000
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.TaskFactory<init>
> INFO: creating 1 writer(s)
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.Monitor run
> INFO: starting
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager run
> INFO: input version info: client 4.1-6, server 4.1-6
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager queueFromInputConnection
> INFO: buffer size = 0, caching = false
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager getDirectoryRequest
> INFO: listing directory /preview/shared/content/english/
> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager queueFromInputConnection
> INFO: queuing first task: /preview/shared/content/english/magazines/ensign/1971/03001_000_000.xml
> Sep 9, 2010 5:49:22 PM com.marklogic.ps.xqsync.OutputPackage newOutputStream
> INFO: new output package C:\xqsync\myContent.zip -0
> Sep 9, 2010 5:49:22 PM com.marklogic.ps.xqsync.Monitor monitor
> INFO: 1/963, 3 events/s, 1055 kB/s, /preview/shared/content/english/magazines/ensign/1971/03001_000_000.xml
> Sep 9, 2010 5:49:24 PM com.marklogic.ps.xqsync.XQSyncManager run
> INFO: queued 38641 items
>
> On Thu, Sep 9, 2010 at 3:52 PM, Michael Blakeley<michael.blakeley at marklogic.com<mailto:michael.blakeley at marklogic.com><mailto:michael.blakeley at marklogic.com<mailto:michael.blakeley at marklogic.com>>>   wrote:
>
> My guess is that it's a subtle typo, but all I can say from this info is "works for me". You've omitted the the output, which might help.
>
> Sep 9, 2010 2:52:19 PM com.marklogic.ps.SimpleLogger configureLogger
> INFO: setting up com.marklogic.ps.SimpleLogger at afa7e74 for: com.marklogic.ps<http://com.marklogic.ps><http://com.marklogic.ps>
>
> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.XQSync main
> INFO: XQSync starting: version 2010-08-24.1 on 1.6.0_18 (OpenJDK Runtime Environment)
> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.XQSync main
> INFO: XCC version = 4.1-6
> Sep 9, 2010 2:52:19 PM com.marklogic.ps.SimpleLogger configureLogger
> INFO: setting up com.marklogic.ps.SimpleLogger at afa7e74 for: com.marklogic.ps<http://com.marklogic.ps><http://com.marklogic.ps>
>
> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.Configuration setProperties
> INFO: first-time setup
> Sep 9, 2010 2:52:19 PM com.marklogic.ps.SimpleLogger configureLogger
> INFO: setting up com.marklogic.ps.SimpleLogger at afa7e74 for: com.marklogic.ps<http://com.marklogic.ps><http://com.marklogic.ps>
>
> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.AbstractConfiguration validateProperties
> INFO: using URI_PREFIX_STRIP=/input/
> ...
>
> -- Mike
>
>
> On 2010-09-09 12:45, Curtis Wilde wrote:
> It seems XQSync either doesn't understand this key, or I'm using it improperly. The contents of my properties file are below:
>
> Windows 7x64
> Java 6 update 21 (32-bit)
>
> #begin properties
> INPUT_CONNECTION_STRING=xcc://user:pass@localhost:8080/Database
> INPUT_DIRECTORY_URI=/input/directory/
> OUTPUT_PACKAGE=myContent.zip
> QUEUE_SIZE=1000
> THREADS=1
> URI_PREFIX_STRIP=/input/
>
>
>
>
>
>