[MarkLogic Dev General] ingest log files?

Jason Hunter jhunter at marklogic.com
Wed May 20 15:13:34 PDT 2009


Hi Jakob,

I'd recommend using a Java program (or .NET, depends on your  
preference) to parse the file and construct basic XML out of each  
line, and pass that XML to MarkLogic via XCC.

-jh-

On May 20, 2009, at 1:38 AM, Jakob Fix wrote:

> Hello,
>
> here's another question from a MarkLogic newbie.  I was thinking of
> indexing Apache log files (or any other line-based log files, for this
> matter) for later exploitation.  I was thinking of feeding  this XML
> to some kind of dashboard application which would be able to create
> nice graphs and buckets etc.
>
> Is it possible and does it make sense at all to create a CPF pipeline
> that will parse and enrich each line to create an XML representation?
> Is something like this already worked on? Another approach?
>
> -- 
> cheers,
> Jakob.


More information about the General mailing list