Today I told you how Hadoop was founded.
First of all, you will need to download Hadoop. You can install it to the terminal from the address below or with the command index.
https://downloads.apache.org/hadoop/core/
To install in the terminal;
Code:
cd /usr/local
Code:
sudo wget https://www.apache.org/dist/hadoop/core/hadoop-2.7.3/hadoop-2.6.0.tar.gz
Code:
sudo tar xzf hadoop-2.7.3.tar.gz
Code:
sudo mv hadoop-2.7.3 hadoop
Code:
sudo chown -R hduser:hadoop hadoop
Hadoop Commands
We write the below code to the terminal to access the Hadoop commands.
Code:
sudo nano $HOME/.bashrc
We need to add the below commands to the end of the file to be opened.
Code:
export JAVA_HOME=/usr/lib/jvm/java-8-oracle
Code:
export HADOOP_HOME=/usr/local/hadoop
hadoop-env.sh Setting
For the Hadoop env.sh setting, we are entering the below code directories.
Code:
sudo nano /usr/local/hadoop/etc/hadoop/hadoop-env.sh
We export the Java_home index in the opened file.
Code:
export JAVA_HOME=/usr/lib/jvm/java-8-oracle
Perfection the Hadoop Global Settings
We write the following code index to our terminal to make the general settings. By writing this code, we actually open the core-site.xml file which we will make the general settings.
Code:
sudo nano /usr/local/hadoop/etc/core-site.xml
Code:
<configuration></configuration>
We are pasting the below codes between these tags.
Code:
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
Hadoop HDFS settings
First of all, we write this code index to our terminal. By writing this code index, we run our file named hdfs-site.xml.
Code:
sudo nano /usr/local/hadoop/etc/hdfs-site.xml
In the open indexes, you need to make the settings that I show with blue below.
Code:
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:/usr/local/hadoop_tmp/hdfs/namenode</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>file:/usr/local/hadoop_tmp/hdfs/datanode</value>
</property>
</configuration>
Hadoop MapReduce settings
First of all, we are pasting the below code into the terminal. With this code, we load mapred-site.xml.
Code:
sudo nano /usr/local/hadoop/etc/mapred-site.xml
Then we are making the edits I show with blue.
Code:
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>
Then we are uploading the yarn-site.xml file.
Code:
sudo nano /usr/local/hadoop/etc/yarn-site.xml
We are making the below blue edits.
Code:
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
Hadoop NameNode Formatting
We are entering the following command in the terminal and enter the index where Hadoop is.
Code:
cd /usr/local/hadoop
Then we are doing the reset by entering the below command.
Code:
./bin/hdfs namenode -format
How to run Hadoop?
After opening our terminal, we are writing the below code directory.
Code:
/usr/local/hadoop/sbin/start-all.sh
After running this command, we will direct localhost: 8088 to this address and access in the panel.
Panel example will prelude
Source:https://www.turkhackteam.org/hadoop/1978730-hadoop-nasil-kurulur-baslatilir.html
First of all, you will need to download Hadoop. You can install it to the terminal from the address below or with the command index.
https://downloads.apache.org/hadoop/core/
To install in the terminal;
Code:
cd /usr/local
Code:
sudo wget https://www.apache.org/dist/hadoop/core/hadoop-2.7.3/hadoop-2.6.0.tar.gz
Code:
sudo tar xzf hadoop-2.7.3.tar.gz
Code:
sudo mv hadoop-2.7.3 hadoop
Code:
sudo chown -R hduser:hadoop hadoop
Hadoop Commands
We write the below code to the terminal to access the Hadoop commands.
Code:
sudo nano $HOME/.bashrc
We need to add the below commands to the end of the file to be opened.
Code:
export JAVA_HOME=/usr/lib/jvm/java-8-oracle
Code:
export HADOOP_HOME=/usr/local/hadoop
hadoop-env.sh Setting
For the Hadoop env.sh setting, we are entering the below code directories.
Code:
sudo nano /usr/local/hadoop/etc/hadoop/hadoop-env.sh
We export the Java_home index in the opened file.
Code:
export JAVA_HOME=/usr/lib/jvm/java-8-oracle
Perfection the Hadoop Global Settings
We write the following code index to our terminal to make the general settings. By writing this code, we actually open the core-site.xml file which we will make the general settings.
Code:
sudo nano /usr/local/hadoop/etc/core-site.xml
Code:
<configuration></configuration>
We are pasting the below codes between these tags.
Code:
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
Hadoop HDFS settings
First of all, we write this code index to our terminal. By writing this code index, we run our file named hdfs-site.xml.
Code:
sudo nano /usr/local/hadoop/etc/hdfs-site.xml
In the open indexes, you need to make the settings that I show with blue below.
Code:
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:/usr/local/hadoop_tmp/hdfs/namenode</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>file:/usr/local/hadoop_tmp/hdfs/datanode</value>
</property>
</configuration>
Hadoop MapReduce settings
First of all, we are pasting the below code into the terminal. With this code, we load mapred-site.xml.
Code:
sudo nano /usr/local/hadoop/etc/mapred-site.xml
Then we are making the edits I show with blue.
Code:
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>
Then we are uploading the yarn-site.xml file.
Code:
sudo nano /usr/local/hadoop/etc/yarn-site.xml
We are making the below blue edits.
Code:
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
Hadoop NameNode Formatting
We are entering the following command in the terminal and enter the index where Hadoop is.
Code:
cd /usr/local/hadoop
Then we are doing the reset by entering the below command.
Code:
./bin/hdfs namenode -format
How to run Hadoop?
After opening our terminal, we are writing the below code directory.
Code:
/usr/local/hadoop/sbin/start-all.sh
After running this command, we will direct localhost: 8088 to this address and access in the panel.
Panel example will prelude
Source:https://www.turkhackteam.org/hadoop/1978730-hadoop-nasil-kurulur-baslatilir.html
Son düzenleme: