How to install hadoop cluster/multi node on ubuntu server 18.04

Ambar Hasbiyatmoko
Ambar Hasbiyatmoko
18.9 هزار بار بازدید - 5 سال پیش - how to install hadoop cluster/multi
how to install hadoop cluster/multi node on ubuntu server 18.04

requirements:
- hadoop 3.2.1
- java 8 (MUST java 8 for hadoop 3.x.x)
- 3 server
- master server (192.168.56.101/ubuntu18_svr_01, hostname:moko)
- slave server (192.168.56.102/ubuntu18_svr_02, hostname:moko2)
- slave server (192.168.56.103/ubuntu18_svr_03, hostname: moko-3)

steps:
- install java 8 on each server
- download hadoop 3.2.1 https://www-eu.apache.org/dist/hadoop... and extract
- copy hadoop-3.2.1.tar.gz folder to each slave server with scp and extract
- add hostname in /etc/hosts/
- move folder: hadoop-3.2.1 to /usr/local/hadoop/
- add PATH /etc/environment
JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
- create user: hadoop
- create ssh keygen from master server and copy to slave server
- Configuring the Hadoop Master
- Copy the configuration files to each of your Hadoop Nodes from your Hadoop Master.
- Format the HDFS file system on master server
- Now you can start HDFS
- open master server : http://192.168.56.101:9870
- .......

see this video for details

https://dzone.com/articles/install-a-...
5 سال پیش در تاریخ 1398/07/15 منتشر شده است.
18,902 بـار بازدید شده
... بیشتر