Sedeks

Continued from Part 1 Step 7: Create temp directory for hadoop userhdp@ubuntu:~$ sudo mkdir -p /app/hadoop/tmp userhdp@ubuntu:~$ sudo chmod 777 /app/hadoop/tmp Make sure you give required persmissions to tmp folder Step 8: This step will show you how to configure hadoop related configuration files  conf/core-site.xml,  conf/hdfs-site.xml, conf/mapred-site.xml. Add following lines to conf/core-site.xml: <property> <name>hadoop.tmp.dir</name>   <value>/app/hadoop/tmp</value>   <description>A base for other temporary directories.</description> </property> <property>   <name>fs.default.name</name>   <value>hdfs://localhost:54310</value>   <description>The name of the default file system.  A URI whose   scheme and authority determine the FileSystem implementation.  The   uri's scheme determines the config property (fs.SCHEME.impl) naming   the FileSystem implement

Installing hadoop on Single node Cluster. Let us start installing and configuring Hadoop in single node  cluster. Pre-requisites: OS: Ubuntu linux 10 and above Java: Java 6 and above Hadoop Version: 1.2 and above Step 1: Install Java. Assuming installation is done as already. Check Java version. dills@ubuntu:~# java -version java version "1.6.0_20" Java(TM) SE Runtime Environment (build 1.6.0_20-b02) Java HotSpot(TM) Client VM (build 16.3-b01, mixed mode, sharing) If you get above response then your java installed correctly. Java JDK should be placed in below path. /usr/lib/jvm/java-6-sun Step 2:  [Optional] Add hadoop system user: Below commands add userhdp and group hadoop to local machine. dills@ubuntu:~$ sudo addgroup hadoop dills@ubuntu:~$ sudo adduser --ingroup hadoop userhdp Step 3: Configuring  SSH. SSH configuration is mandatory to manage hadoop nodes. We configure SSH access to our local system (localhost)