Datanode not starting

[Matthew Farrellee]

If you're only interested in HDFS then you don't need all of them (just 
hadoop-hdfs). If you want to run MapReduce jobs over your data in HDFS 
then you do (add hadoop-mapreduce hadoop-yarn).

I just checked w/ -

$ docker run -i -t mattdm/fedora /bin/bash
# yum install -y hadoop-hdfs
# hdfs namenode -format
# haddop namenode & (only because app container has no systemd)
# hadoop datanode & (only because app container has no systemd)
# hadoop fs -touchz /hello
# hadoop fs -ls /
Found 1 items
-rw-r--r--   1 root supergroup          0 2013-12-19 12:10 /hello

You should check 
/var/log/hadoop-hdfs/hadoop-hdfs-datanode-DreamCatcher.out and 
/var/log/hadoop-hdfs/hadoop-hdfs-datanode-DreamCatcher.log to see what 
error is being reported.

Best,


matt

On 12/18/2013 11:20 PM, M. Edward (Ed) Borasky wrote:
> P.S.: You're installing quite a few more packages than what's given on
> the wiki - do all of those really need to be there?
>
> On Wed, Dec 18, 2013 at 8:19 PM, M. Edward (Ed) Borasky <znmeb at znmeb.net> wrote:
>> I did a search and found your blog post already. ;-) I did try
>> formatting the namenode but it didn't help. I can try your process
>> from scratch on another machine and see if that works. Has anyone else
>> gone down this path? Yours was the only posting Google turned up.
>>
>> On Wed, Dec 18, 2013 at 7:04 PM, Tim St Clair <tstclair at redhat.com> wrote:
>>> You may need to format 1st:
>>> http://timothysc.github.io/blog/2013/09/14/hadoop-mapreduce/
>>>
>>>
>>> ----- Original Message -----
>>>> From: "M. Edward (Ed) Borasky" <znmeb at znmeb.net>
>>>> To: bigdata at lists.fedoraproject.org
>>>> Sent: Wednesday, December 18, 2013 7:01:46 PM
>>>> Subject: Datanode not starting
>>>>
>>>> I've got a Fedora 20 system - just fresh installed and updated. I
>>>> built a script following the instructions on the wiki:
>>>>
>>>> https://fedoraproject.org/wiki/Changes/Hadoop#How_To_Test
>>>>
>>>> The datanode is not starting:
>>>>
>>>> $ sudo systemctl start hadoop-namenode hadoop-datanode
>>>> hadoop-nodemanager hadoop-resourcemanager
>>>> Job for hadoop-datanode.service failed. See 'systemctl status
>>>> hadoop-datanode.service' and 'journalctl -xn' for details.
>>>> $ systemctl status -l hadoop-datanode.service
>>>> hadoop-datanode.service - The Hadoop datanode daemon
>>>>     Loaded: loaded (/usr/lib/systemd/system/hadoop-datanode.service; enabled)
>>>>     Active: failed (Result: exit-code) since Wed 2013-12-18 16:34:51
>>>> PST; 9min ago
>>>>    Process: 1358 ExecStop=/usr/sbin/hadoop-daemon.sh stop datanode
>>>> (code=exited, status=0/SUCCESS)
>>>>    Process: 4240 ExecStart=/usr/sbin/hadoop-daemon.sh start datanode
>>>> (code=exited, status=1/FAILURE)
>>>>   Main PID: 1205 (code=exited, status=1/FAILURE)
>>>>
>>>> Dec 18 16:34:47 DreamCatcher hadoop-daemon.sh[4240]: starting
>>>> datanode, logging to
>>>> /var/log/hadoop-hdfs/hadoop-hdfs-datanode-DreamCatcher.out
>>>> Dec 18 16:34:51 DreamCatcher systemd[1]: hadoop-datanode.service:
>>>> control process exited, code=exited status=1
>>>> Dec 18 16:34:51 DreamCatcher systemd[1]: Failed to start The Hadoop
>>>> datanode daemon.
>>>> Dec 18 16:34:51 DreamCatcher systemd[1]: Unit hadoop-datanode.service
>>>> entered failed state.
>>>>
>>>>
>>>>
>>>> --
>>>> Twitter: http://twitter.com/znmeb; Computational Journalism Publishers
>>>> Workbench
>>>> http://j.mp/CompJournBench/
>>>>
>>>> Get out of the building - and don't come back till you have the order!
>>>> _______________________________________________
>>>> bigdata mailing list
>>>> bigdata at lists.fedoraproject.org
>>>> https://admin.fedoraproject.org/mailman/listinfo/bigdata
>>>>
>>>
>>> --
>>> Cheers,
>>> Tim
>>> _______________________________________________
>>> bigdata mailing list
>>> bigdata at lists.fedoraproject.org
>>> https://admin.fedoraproject.org/mailman/listinfo/bigdata
>>
>>
>>
>> --
>> Twitter: http://twitter.com/znmeb; Computational Journalism Publishers Workbench
>> http://j.mp/CompJournBench/
>>
>> Get out of the building - and don't come back till you have the order!
>
>
>