Posts

Showing posts from November, 2013

Name node

PIG Error message "org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. name"

Problem: Error when try to load a file in Apache PIG grunt> Data = LOAD 'MyTest.csv' using PigStorage(','); 2013-11-05 14:14:57,699 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. name 2013-11-05 14:14:57,699 [main] WARN  org.apache.pig.tools.grunt.Grunt - There is no log file to write to. 2013-11-05 14:14:57,699 [main] ERROR org.apache.pig.tools.grunt.Grunt - java.lang.NoSuchFieldError: name     at org.apache.pig.parser.QueryParserStringStream. (QueryParserStringStream.java:32)     at org.apache.pig.parser.QueryParserDriver.tokenize(QueryParserDriver.java:200)     at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:168)     at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1574)     at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1547)     at org.apache.pig.PigServer.registerQuery(PigServer.java:549)     at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:9

How to run MapReduce job in hadoop

Image
Guys, Here I am gonna show how we can run  Map  Reduce program in ubuntu linux. Pre-requisites: 1. Hadoop should be installed successfully. 2. Hadoop is in running mode. (bin/hadoop start-all.sh) Here we go: 1. Create a Any directory in Ubuntu as below: admin@admin-G31M-ES2L:/usr$ mkdir testjars 2. Now change the directory to newly created one. admin@admin-G31M-ES2L:/usr$ cd testjars 3. Create Input File as Input.txt and copy paste some Text into it. admin@admin-G31M-ES2L:/usr/testjars$ vi input.txt  4. Now Move this directory to Hadoop HDFS. admin@admin-G31M-ES2L: /usr/local/hadoop $ bin/hadoop dfs -put /usr/testjars/ /usr/testjar 5. So we have moved a directory which is having input file to process by map reduce job to Hadoop HDFS. Note: In order to run word count map reduce job the input file needs to be placed in HDFS. So we have done this just now. 6. Word count jar is available in "hadoop-examples-1.0.4.jar" under hadoop installation direc