Packaging GlusterFS Hadoop

Matthew Farrellee matt at redhat.com
Wed Aug 28 10:58:10 UTC 2013


On 08/28/2013 05:04 AM, Mikolaj Izdebski wrote:
> There is no need to CC me as I am subscribed to the ML.
>
> On 08/27/2013 09:07 PM, Matthew Farrellee wrote:
>> I'm starting to package glusterfs-hadoop, a shim on top of GlusterFS
>> that allows applications written for HDFS to run on GlusterFS.
>>
>> The SRPM and spec are -
>>
>> http://matt.fedorapeople.org/pkg/0/glusterfs-hadoop-2.1.2-1.src.rpm
>> http://matt.fedorapeople.org/pkg/0/glusterfs-hadoop.spec
>>
>> I'm trying to get it to build in an F20 mock environment before
>> submitting a review request. However, I'm running into a problem...
>>
>> [ERROR] Failed to execute goal on project glusterfs: Could not resolve
>> dependencies for project
>> org.apache.hadoop.fs.glusterfs:glusterfs:jar:2.0-SNAPSHOT: Could not
>> find artifact com.sun:tools:jar:1.6 at specified path
>> /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.25-2.3.12.3.fc20.x86_64/jre/../lib/tools.jar
>> -> [Help 1]
>>
>> com.sun:tools is coming in from...
>>
>> [DEBUG] Loading depmap file:
>> /usr/share/maven-fragments/javapackages-depmap.xml
>> [DEBUG] Added mapping [com.sun:tools] => [JAVA_HOME:../lib/tools]
>> ...
>> [DEBUG]       org.apache.hadoop:hadoop-annotations:jar:2.0.5-alpha:compile
>> [DEBUG]          com.sun:tools:jar:1.6:system
>
> I didn't see dependency on com.sun:tools in the attached SRPM.  The POM
> has no parent, so the com.sun:tools is probably a transitive dependency.
> This would mean that one of your dependency packages has a bug.  Try
> checking which packages POM declares dependency on tools and report a bug.

Thanks. I think I found it in the hadoop package...

hadoop-fedora-integration.patch -
...
+++ b/hadoop-common-project/hadoop-annotations/pom.xml
@@ -48,8 +48,8 @@
        </activation>
        <dependencies>
          <dependency>
-          <groupId>jdk.tools</groupId>
-          <artifactId>jdk.tools</artifactId>
+          <groupId>com.sun</groupId>
+          <artifactId>tools</artifactId>
            <version>1.6</version>
            <scope>system</scope>
            <systemPath>${java.home}/../lib/tools.jar</systemPath>
...

Rob, will you update hadoop to also remove the version, scope and 
systemPath from that pom and send me a new hadoop SRPM to somehow 
build&test?

Best,


matt


More information about the bigdata mailing list