MarkLogic Content Pump (MLCP) is an open-source, Java-based command-line tool. MLCP provides the fastest way to import, export, and copy data to or from MarkLogic databases. It is designed for integration and automation in existing workflows and scripts.


Downloads

MARKLOGIC CONTENT PUMP ON GITHUB ›


Major Features

  • Bulk load local files
  • Split and load large, aggregate XML files or delimited text
  • Bulk load triples or quads from RDF files
  • Archive and restore database contents across environments
  • Copy subsets of data between databases
  • Load documents from HDFS, including Hadoop sequence files

Getting Started

Tutorials and Examples
Requirements

To get started moving data with MLCP, download and unpack the binaries. For those interested in hacking or look at the internals, you can also download the Apache 2.0 licensed source.

Installation

To create your first import script, make sure you have an XDBC server attached to your database (running on port 8006, for example, below). From the command line, run the following, substituting your particulars:

mlcp.sh import \
 -host localhost \
 -port 8006 \
 -username user \
 -password ******* \
 -input_file_path /data/latest

To export a subset of that same database into a platform-independent archive:

mlcp.sh export \
 -host localhost \
 -port 8006 \
 -username user \
 -password ******* \
 -output_type archive \
 -output_file_path /out/collections \
 -compress true

To import all triples from an N-Triples formatted file named example.nt:

mlcp.sh import \
 -host localhost \
 -port 8006 \
 -username user \
 -password ******* \
 -input_file_path example.nt \
 -mode local \
 -input_file_type RDF

This is a small sampling of the rich set of capabilities MLCP provides. For much information, sample code, and examples, explore its documentation.


Documentation


Other Versions

MarkLogic 9
Maven
Dependencies
<dependency>
  <groupId>com.marklogic</groupId>
  <artifactId>mlcp</artifactId>
  <version>9.0.10</version>
</dependency>
MarkLogic 8
Maven
Dependencies
<dependency>
  <groupId>com.marklogic</groupId>
  <artifactId>mlcp</artifactId>
  <version>8.0.9</version>
</dependency>
This website uses cookies.

By continuing to use this website you are giving consent to cookies being used in accordance with the MarkLogic Privacy Statement.