Hello,
I would like to build Apache Flink with Hadoop version “2.4.0.2.1.10.0-881″. This is a HDP-specific Hadoop version, used by HDP 2.1.
A user of Apache Flink is using this version in production and he is facing issues with HDFS due to version incompatibilities between 2.4.0.2.1.10.0-881 and vanilla Hadoop 2.2.0
Building Flink against that version fails with the following maven error:
Failed to execute goal on project flink-shaded-include-yarn-tests: Could not resolve dependencies for project org.apache.flink:flink-shaded-include-yarn-tests:jar:0.10-SNAPSHOT: The following artifacts could not be resolved: org.mortbay.jetty:jetty:jar:6.1.26.hwx, org.mortbay.jetty:jetty-util:jar:6.1.26.hwx: Failure to find org.mortbay.jetty:jetty:jar:6.1.26.hwx in https://repository.cloudera.com/artifactory/cloudera-repos was cached in the local repository, resolution will not be reattempted until the update interval of cloudera-releases has elapsed or updates are forced -> [Help 1]
The problem is that Hadoop is referencing “org.mortbay.jetty:jetty:jar:6.1.26.hwx”, a Jetty version not publicly available. Not even in the Hortonworks maven repository.
Steps to reproduce
git clone https://github.com/apache/flink.git cd flink mvn clean install -DskipTests -Dhadoop.version=2.4.0.2.1.10.0-881 -Pvendor-repos