A component of Hadoop Secure Mode feature set. Each user and service requires authentication before accessing the HDFS filesystem.
By default, Hadoop runs in non-secure mode, where no user authentication is required. Hadoop Secure Mode enforces authentication for each user and service by Kerberos in order to use Hadoop services.
All three of MarkLogic’s Hadoop integration points support Kerberos authentication:
Cloudera 5.8, Hortonworks 2.4, MapR 5.1 (only MapR-FS is supported).
MarkLogic does not need a native Spark connector. MarkLogic integrates directly with HDFS and the Hadoop Connector can read and write Hadoop-compatible datasets. As part of the Apache universe, Spark is also able to read and write Hadoop-compatible datasets. This common language can we exploited without the need for a native connector.
By continuing to use this website you are giving consent to cookies being used in accordance with the MarkLogic Privacy Statement.