[MarkLogic Dev General] [XQSync] WARNING: unknown key: skipping URI_PREFIX_STRIP

Fri Sep 10 10:19:39 PDT 2010

Agreed that it could be a windows only issue, but I've re-authored the file
in eclipse, setting the file type to UTF-8 and line endings to Unix, and I
still get the same error.

Displaying whitespace shows no hidden characters.

[image: properties.png]

Same with Cygwin

$ od -c localdown.properties
0000000   #  \r  \n   I   N   P   U   T   _   C   O   N   N   E   C   T
0000020   I   O   N   _   S   T   R   I   N   G   =   x   c   c   :   /
0000040   /   a   d   m   i   n   :   r   o   o   t   @   l   o   c   a
0000060   l   h   o   s   t   :   8   0   3   0   /   C   r   e   a   t
0000100   i   o   n  \r  \n   I   N   P   U   T   _   D   I   R   E   C
0000120   T   O   R   Y   _   U   R   I   =   /   p   r   e   v   i   e
0000140   w   /   s   h   a   r   e   d   /   c   o   n   t   e   n   t
0000160   /   e   n   g   l   i   s   h   /  \r  \n   I   N   P   U   T
0000200   _   B   A   T   C   H   _   S   I   Z   E   =   1  \r  \n   O
0000220   U   T   P   U   T   _   P   A   C   K   A   G   E   =   m   y
0000240   C   o   n   t   e   n   t   .   z   i   p  \r  \n   Q   U   E
0000260   U   E   _   S   I   Z   E   =   1   0   0   0  \r  \n   T   H
0000300   R   E   A   D   S   =   1  \r  \n   U   R   I   _   P   R   E
0000320   F   I   X   _   S   T   R   I   P   =   /   p   r   e   v   i
0000340   e   w   /   s   h   a   r   e   d   /   c   o   n   t   e   n
0000360   t   /   e   n   g   l   i   s   h   /  \r  \n
0000374

On Thu, Sep 9, 2010 at 7:11 PM, Michael Blakeley <
michael.blakeley at marklogic.com> wrote:

> This line makes me think you have some non-printable characters in your
> property file:
>
>  WARNING: unknown key: skipping ├»┬╗┬┐#
>>
>
> That's probably a BOM on line 1. This is a common problem with several
> Windows editors. Given that hint, it wouldn't surprise me to find another
> invisible character of some kind on the line where URI_PREFIX_STRIP occurs.
>
> I don't use Windows regularly, myself. But I know that vim is available for
> Windows. Maybe editing the file with vim would show you what's really in
> there? You might also try 'od -c' in a cygwin shell.
>
> -- Mike
>
>
> On 2010-09-09 16:54, Curtis Wilde wrote:
>
>> Sorry about that.
>>
>> Properties:
>>
>> #
>> OUTPUT_CONNECTION_STRING=xcc://admin:root@localhost:8030/Creation
>> URI_PREFIX=/preview/shared/content/english/
>> ALLOW_EMPTY_METADATA=true
>> INPUT_PACKAGE=magazines.zip
>> QUEUE_SIZE=1000
>> REPAIR_INPUT_XML=true
>> SKIP_EXISTING=true
>> THREADS=2
>>
>> Output:
>>
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.SimpleLogger configureLogger
>> INFO: setting up com.marklogic.ps.SimpleLogger at c17164 for:
>> com.marklogic.ps<http://com.marklogic.ps>
>>
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using OUTPUT_PACKAGE=myContent.zip
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> WARNING: unknown key: skipping URI_PREFIX_STRIP
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using INPUT_BATCH_SIZE=1
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using THREADS=1
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using INPUT_DIRECTORY_URI=/preview/shared/content/english/
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> WARNING: unknown key: skipping ├»┬╗┬┐#
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using INPUT_CONNECTION_STRING=xcc://admin:root@localhost
>> :8030/Creation
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> WARNING: unknown key: skipping awt.toolkit
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using QUEUE_SIZE=1000
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.Configuration
>> configureInput
>> INFO: input from connection: xcc://admin:root@localhost:8030/Creation
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.Configuration
>> configureOutput
>> INFO: output to package: myContent.zip
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSync main
>> INFO: XQSync starting: version 2009-11-07.1 on 1.6.0_21 (Java(TM) SE
>> Runtime Environment)
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSync main
>> INFO: XCC version = 4.1-6
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager run
>> INFO: starting pool of 1 threads, queue size = 1000
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.TaskFactory<init>
>> INFO: creating 1 writer(s)
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.Monitor run
>> INFO: starting
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager run
>> INFO: input version info: client 4.1-6, server 4.1-6
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager
>> queueFromInputConnection
>> INFO: buffer size = 0, caching = false
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager
>> getDirectoryRequest
>> INFO: listing directory /preview/shared/content/english/
>> Sep 9, 2010 5:49:21 PM com.marklogic.ps.xqsync.XQSyncManager
>> queueFromInputConnection
>> INFO: queuing first task:
>> /preview/shared/content/english/magazines/ensign/1971/03001_000_000.xml
>> Sep 9, 2010 5:49:22 PM com.marklogic.ps.xqsync.OutputPackage
>> newOutputStream
>> INFO: new output package C:\xqsync\myContent.zip -0
>> Sep 9, 2010 5:49:22 PM com.marklogic.ps.xqsync.Monitor monitor
>> INFO: 1/963, 3 events/s, 1055 kB/s,
>> /preview/shared/content/english/magazines/ensign/1971/03001_000_000.xml
>> Sep 9, 2010 5:49:24 PM com.marklogic.ps.xqsync.XQSyncManager run
>> INFO: queued 38641 items
>>
>> On Thu, Sep 9, 2010 at 3:52 PM, Michael Blakeley<
>> michael.blakeley at marklogic.com<mailto:michael.blakeley at marklogic.com>>
>>  wrote:
>>
>> My guess is that it's a subtle typo, but all I can say from this info is
>> "works for me". You've omitted the the output, which might help.
>>
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.SimpleLogger configureLogger
>> INFO: setting up com.marklogic.ps.SimpleLogger at afa7e74 for:
>> com.marklogic.ps<http://com.marklogic.ps>
>>
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.XQSync main
>> INFO: XQSync starting: version 2010-08-24.1 on 1.6.0_18 (OpenJDK Runtime
>> Environment)
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.XQSync main
>> INFO: XCC version = 4.1-6
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.SimpleLogger configureLogger
>> INFO: setting up com.marklogic.ps.SimpleLogger at afa7e74 for:
>> com.marklogic.ps<http://com.marklogic.ps>
>>
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.Configuration setProperties
>> INFO: first-time setup
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.SimpleLogger configureLogger
>> INFO: setting up com.marklogic.ps.SimpleLogger at afa7e74 for:
>> com.marklogic.ps<http://com.marklogic.ps>
>>
>> Sep 9, 2010 2:52:19 PM com.marklogic.ps.xqsync.AbstractConfiguration
>> validateProperties
>> INFO: using URI_PREFIX_STRIP=/input/
>> ...
>>
>> -- Mike
>>
>>
>> On 2010-09-09 12:45, Curtis Wilde wrote:
>> It seems XQSync either doesn't understand this key, or I'm using it
>> improperly. The contents of my properties file are below:
>>
>> Windows 7x64
>> Java 6 update 21 (32-bit)
>>
>> #begin properties
>> INPUT_CONNECTION_STRING=xcc://user:pass@localhost:8080/Database
>> INPUT_DIRECTORY_URI=/input/directory/
>> OUTPUT_PACKAGE=myContent.zip
>> QUEUE_SIZE=1000
>> THREADS=1
>> URI_PREFIX_STRIP=/input/
>>
>>
>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://developer.marklogic.com/pipermail/general/attachments/20100910/df71c08c/attachment-0001.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 14732 bytes
Desc: not available
Url : http://developer.marklogic.com/pipermail/general/attachments/20100910/df71c08c/attachment-0001.png 