Packaging GlusterFS Hadoop

Matthew Farrellee matt at redhat.com
Wed Aug 28 13:15:16 UTC 2013


That worked like a charm, thanks!

+1 to that update when it comes out, just let me know where to send it.

Best,


matt

On 08/28/2013 09:13 AM, Robert Rati wrote:
> The scratch build just completed.  The result can be found here:
> http://koji.fedoraproject.org/koji/taskinfo?taskID=5864327
>
> Rob
>
> On 08/28/2013 09:07 AM, Matthew Farrellee wrote:
>> Have a build in koji I can try out?
>>
>> Best,
>>
>>
>> matt
>>
>> On 08/28/2013 08:57 AM, Robert Rati wrote:
>>> I'm building hadoop-2.0.5-8 now which should fix this.  I removed the
>>> version, scope, and systemPath definitions from the tools.jar
>>> dependency.
>>>
>>> Rob
>>>
>>> On 08/28/2013 06:58 AM, Matthew Farrellee wrote:
>>>> On 08/28/2013 05:04 AM, Mikolaj Izdebski wrote:
>>>>> There is no need to CC me as I am subscribed to the ML.
>>>>>
>>>>> On 08/27/2013 09:07 PM, Matthew Farrellee wrote:
>>>>>> I'm starting to package glusterfs-hadoop, a shim on top of GlusterFS
>>>>>> that allows applications written for HDFS to run on GlusterFS.
>>>>>>
>>>>>> The SRPM and spec are -
>>>>>>
>>>>>> http://matt.fedorapeople.org/pkg/0/glusterfs-hadoop-2.1.2-1.src.rpm
>>>>>> http://matt.fedorapeople.org/pkg/0/glusterfs-hadoop.spec
>>>>>>
>>>>>> I'm trying to get it to build in an F20 mock environment before
>>>>>> submitting a review request. However, I'm running into a problem...
>>>>>>
>>>>>> [ERROR] Failed to execute goal on project glusterfs: Could not
>>>>>> resolve
>>>>>> dependencies for project
>>>>>> org.apache.hadoop.fs.glusterfs:glusterfs:jar:2.0-SNAPSHOT: Could not
>>>>>> find artifact com.sun:tools:jar:1.6 at specified path
>>>>>> /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.25-2.3.12.3.fc20.x86_64/jre/../lib/tools.jar
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> -> [Help 1]
>>>>>>
>>>>>> com.sun:tools is coming in from...
>>>>>>
>>>>>> [DEBUG] Loading depmap file:
>>>>>> /usr/share/maven-fragments/javapackages-depmap.xml
>>>>>> [DEBUG] Added mapping [com.sun:tools] => [JAVA_HOME:../lib/tools]
>>>>>> ...
>>>>>> [DEBUG]
>>>>>> org.apache.hadoop:hadoop-annotations:jar:2.0.5-alpha:compile
>>>>>> [DEBUG]          com.sun:tools:jar:1.6:system
>>>>>
>>>>> I didn't see dependency on com.sun:tools in the attached SRPM.  The
>>>>> POM
>>>>> has no parent, so the com.sun:tools is probably a transitive
>>>>> dependency.
>>>>> This would mean that one of your dependency packages has a bug.  Try
>>>>> checking which packages POM declares dependency on tools and report a
>>>>> bug.
>>>>
>>>> Thanks. I think I found it in the hadoop package...
>>>>
>>>> hadoop-fedora-integration.patch -
>>>> ...
>>>> +++ b/hadoop-common-project/hadoop-annotations/pom.xml
>>>> @@ -48,8 +48,8 @@
>>>>         </activation>
>>>>         <dependencies>
>>>>           <dependency>
>>>> -          <groupId>jdk.tools</groupId>
>>>> -          <artifactId>jdk.tools</artifactId>
>>>> +          <groupId>com.sun</groupId>
>>>> +          <artifactId>tools</artifactId>
>>>>             <version>1.6</version>
>>>>             <scope>system</scope>
>>>>             <systemPath>${java.home}/../lib/tools.jar</systemPath>
>>>> ...
>>>>
>>>> Rob, will you update hadoop to also remove the version, scope and
>>>> systemPath from that pom and send me a new hadoop SRPM to somehow
>>>> build&test?
>>>>
>>>> Best,
>>>>
>>>>
>>>> matt
>>> _______________________________________________
>>> bigdata mailing list
>>> bigdata at lists.fedoraproject.org
>>> https://admin.fedoraproject.org/mailman/listinfo/bigdata
>>
> _______________________________________________
> bigdata mailing list
> bigdata at lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/bigdata



More information about the bigdata mailing list