Datanode not starting

[M. Edward (Ed) Borasky]

Ah ... the Wiki didn't say where the log files are! I found out what
was happening. The Java code is looking for stuff via the host name,
'DreamCatcher', but that wasn't equated to 127.0.0.1 in /etc/hosts. I
added that and it's working.

On Thu, Dec 19, 2013 at 4:14 AM, Matthew Farrellee <matt at redhat.com> wrote:
> If you're only interested in HDFS then you don't need all of them (just
> hadoop-hdfs). If you want to run MapReduce jobs over your data in HDFS then
> you do (add hadoop-mapreduce hadoop-yarn).
>
> I just checked w/ -
>
> $ docker run -i -t mattdm/fedora /bin/bash
> # yum install -y hadoop-hdfs
> # hdfs namenode -format
> # haddop namenode & (only because app container has no systemd)
> # hadoop datanode & (only because app container has no systemd)
> # hadoop fs -touchz /hello
> # hadoop fs -ls /
> Found 1 items
> -rw-r--r--   1 root supergroup          0 2013-12-19 12:10 /hello
>
> You should check /var/log/hadoop-hdfs/hadoop-hdfs-datanode-DreamCatcher.out
> and /var/log/hadoop-hdfs/hadoop-hdfs-datanode-DreamCatcher.log to see what
> error is being reported.
>
> Best,
>
>
> matt
>
>
> On 12/18/2013 11:20 PM, M. Edward (Ed) Borasky wrote:
>>
>> P.S.: You're installing quite a few more packages than what's given on
>> the wiki - do all of those really need to be there?
>>
>> On Wed, Dec 18, 2013 at 8:19 PM, M. Edward (Ed) Borasky <znmeb at znmeb.net>
>> wrote:
>>>
>>> I did a search and found your blog post already. ;-) I did try
>>> formatting the namenode but it didn't help. I can try your process
>>> from scratch on another machine and see if that works. Has anyone else
>>> gone down this path? Yours was the only posting Google turned up.
>>>
>>> On Wed, Dec 18, 2013 at 7:04 PM, Tim St Clair <tstclair at redhat.com>
>>> wrote:
>>>>
>>>> You may need to format 1st:
>>>> http://timothysc.github.io/blog/2013/09/14/hadoop-mapreduce/
>>>>
>>>>
>>>> ----- Original Message -----
>>>>>
>>>>> From: "M. Edward (Ed) Borasky" <znmeb at znmeb.net>
>>>>> To: bigdata at lists.fedoraproject.org
>>>>> Sent: Wednesday, December 18, 2013 7:01:46 PM
>>>>> Subject: Datanode not starting
>>>>>
>>>>> I've got a Fedora 20 system - just fresh installed and updated. I
>>>>> built a script following the instructions on the wiki:
>>>>>
>>>>> https://fedoraproject.org/wiki/Changes/Hadoop#How_To_Test
>>>>>
>>>>> The datanode is not starting:
>>>>>
>>>>> $ sudo systemctl start hadoop-namenode hadoop-datanode
>>>>> hadoop-nodemanager hadoop-resourcemanager
>>>>> Job for hadoop-datanode.service failed. See 'systemctl status
>>>>> hadoop-datanode.service' and 'journalctl -xn' for details.
>>>>> $ systemctl status -l hadoop-datanode.service
>>>>> hadoop-datanode.service - The Hadoop datanode daemon
>>>>>     Loaded: loaded (/usr/lib/systemd/system/hadoop-datanode.service;
>>>>> enabled)
>>>>>     Active: failed (Result: exit-code) since Wed 2013-12-18 16:34:51
>>>>> PST; 9min ago
>>>>>    Process: 1358 ExecStop=/usr/sbin/hadoop-daemon.sh stop datanode
>>>>> (code=exited, status=0/SUCCESS)
>>>>>    Process: 4240 ExecStart=/usr/sbin/hadoop-daemon.sh start datanode
>>>>> (code=exited, status=1/FAILURE)
>>>>>   Main PID: 1205 (code=exited, status=1/FAILURE)
>>>>>
>>>>> Dec 18 16:34:47 DreamCatcher hadoop-daemon.sh[4240]: starting
>>>>> datanode, logging to
>>>>> /var/log/hadoop-hdfs/hadoop-hdfs-datanode-DreamCatcher.out
>>>>> Dec 18 16:34:51 DreamCatcher systemd[1]: hadoop-datanode.service:
>>>>> control process exited, code=exited status=1
>>>>> Dec 18 16:34:51 DreamCatcher systemd[1]: Failed to start The Hadoop
>>>>> datanode daemon.
>>>>> Dec 18 16:34:51 DreamCatcher systemd[1]: Unit hadoop-datanode.service
>>>>> entered failed state.
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Twitter: http://twitter.com/znmeb; Computational Journalism Publishers
>>>>> Workbench
>>>>> http://j.mp/CompJournBench/
>>>>>
>>>>> Get out of the building - and don't come back till you have the order!
>>>>> _______________________________________________
>>>>> bigdata mailing list
>>>>> bigdata at lists.fedoraproject.org
>>>>> https://admin.fedoraproject.org/mailman/listinfo/bigdata
>>>>>
>>>>
>>>> --
>>>> Cheers,
>>>> Tim
>>>> _______________________________________________
>>>> bigdata mailing list
>>>> bigdata at lists.fedoraproject.org
>>>> https://admin.fedoraproject.org/mailman/listinfo/bigdata
>>>
>>>
>>>
>>>
>>> --
>>> Twitter: http://twitter.com/znmeb; Computational Journalism Publishers
>>> Workbench
>>> http://j.mp/CompJournBench/
>>>
>>> Get out of the building - and don't come back till you have the order!
>>
>>
>>
>>
>
> _______________________________________________
> bigdata mailing list
> bigdata at lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/bigdata



-- 
Twitter: http://twitter.com/znmeb; Computational Journalism Publishers Workbench
http://j.mp/CompJournBench/

Get out of the building - and don't come back till you have the order!