Youtor
Installation of Hadoop Solved problem JAVAHOME 2019
>> YOUR LINK HERE: ___ http://youtube.com/watch?v=HF8AOjoegVU
USE • left angle bracket inplace of { • • right angle bracket inplace of } • ______________________________________________________ • Installation Procedure of JAVA • 0. $sudo apt-get update • 1. $java -version • 2. $sudo apt-get autoremove openjdk* • or • 2. $sudo apt-get autoremove default-jdk* • 3. $sudo apt install openjdk-8-jdk • 4. $readlink -f /usr/bin/javac • [This will tells you javac path, from this path extract java • path which will be required at later stage] • This is the result for command 4 • /usr/lib/jvm/java-8-openjdk-amd64/bin/javac • we require only /usr/lib/jvm/java-8-openjdk-amd64 • • Installation Procedure for HADOOP • 1. $which ssh • 2. $which sshd • [Run 3 only if 2 output blank on terminal] • 3. $sudo apt-get install openssh-server • 4. $ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa • 5. $cat ~/.ssh/id_rsa.pub two_right_angle_bracket ~/.ssh/authorized_keys • 6. $ssh localhost • [Do yes if ask] • 7. $wget https://archive.apache.org/dist/hadoo... • [Go to https://archive.apache.org/dist/hadoo... • and check for latest version and copy location from there] • 7. $tar -xzvf hadoop-3.1.2.tar.gz • 8. $sudo chown -R nitish:nitish hadoop-3.1.2 • 11 $sudo gedit ~/.bashrc • Add the following at the end of the file • export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 • export HADOOP_HOME=/home/nitish/hadoop-3.1.2 • export PATH=$PATH:$JAVA_HOME/bin • export PATH=$PATH:$HADOOP_HOME/bin • export PATH=$PATH:$HADOOP_HOME/sbin • • 12 $source ~/.bashrc • 13. Let's configure Path and add some properties • 13.1 $gedit /home/nitish/hadoop-3.1.2/etc/hadoop/core-site.xml • add following Tags within congiguration tags • {property} • {name}fs.default.name{/name} • {value}hdfs://localhost:9000{/value} • {/property} • {property} • {name}hadoop.tmp.dir{/name} • {value}/home/nitish/hadoop-3.1.2/etc/hadoop/hadooptmp{/value} • {/property} • 13.2 $gedit /home/nitish/hadoop-3.1.2/etc/hadoop/hadoop-env.sh • Find export JAVA_HOME and write following. Note this home location extracted • while installing JAVA , command 4 • export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 • 13.3 $gedit /home/nitish/hadoop-3.1.2/etc/hadoop/hdfs-site.xml • {property} • {name}dfs.replication{/name} • {value}1{/value} • {/property} • {property} • {name}dfs.block.size{/name} • {value}128000000{/value} • {/property} • 13.4 $gedit /home/nitish/hadoop-3.1.2/etc/hadoop/mapred-site.xml • {property} • {name}mapreduce.framework.name{/name} • {value}yarn{/value} • {/property} • 13.5 $gedit /home/nitish/hadoop-3.1.2/etc/hadoop/yarn-site.xml • • {property} • {name}yarn.nodemanager.aux-services{/name} • {value}mapreduce_shuffle{/value} • {/property} • {property} • {name}yarn.nodemanager.aux-services.mapreduce.shuffle.class{/name} • {value}org.apache.hadoop.mapred.ShuffleHandler{/value} • {/property} • • 14. hdfs namenode -format • [Do it only once after installtion] • 15. start-dfs.sh • 16. start-yarn.sh
#############################
