Hi Guys,
I have some problems when running Pig(HDP 2.2).
Im doing the tutorial at:http://hortonworks.com/hadoop-tutorial/hello-world-an-introduction-to-hadoop-hcatalog-hive-and-pig/
I have tryed everything that i know. Could someone tell me what im doing wrong?
This is the code that im trying to write:
a = LOAD ‘default.nyse_stocks’ USING org.apache.hive.hcatalog.pig.HCatLoader()
b = FILTER a BY stock_symbol == ‘IBM';
c = group b ALL;
d = FOREACH c GENERATE AVG(b.stock_volume);
dump d;
Im using the UseHCatalog as a pig argument.
Im getting this Messege:
ls: cannot access /hadoop/yarn/local/usercache/hue/appcache/application_1425380153290_0010/container_1425380153290_0010_01_000002/hive.tar.gz/hive/lib/slf4j-api-*.jar: No such file or directory
ls: cannot access /hadoop/yarn/local/usercache/hue/appcache/application_1425380153290_0010/container_1425380153290_0010_01_000002/hive.tar.gz/hive/lib/commons-lang3-*.jar: No such file or directory
ls: cannot access /hadoop/yarn/local/usercache/hue/appcache/application_1425380153290_0010/container_1425380153290_0010_01_000002/hive.tar.gz/hive/hcatalog/lib/*hbase-storage-handler-*.jar: No such file or directory
15/03/03 14:15:47 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
15/03/03 14:15:47 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
15/03/03 14:15:47 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2015-03-03 14:15:47,968 [main] INFO org.apache.pig.Main – Apache Pig version 0.14.0.2.2.0.0-2041 (rexported) compiled Nov 19 2014, 15:24:46
2015-03-03 14:15:47,969 [main] INFO org.apache.pig.Main – Logging error messages to: /hadoop/yarn/local/usercache/hue/appcache/application_1425380153290_0010/container_1425380153290_0010_01_000002/pig_1425392147966.log
2015-03-03 14:15:51,721 [main] INFO org.apache.pig.impl.util.Utils – Default bootup file /home/yarn/.pigbootup not found
2015-03-03 14:15:52,322 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine – Connecting to hadoop file system at: hdfs://sandbox.hortonworks.com:8020
<file script.pig, line 1, column 9> Unexpected character ‘‘’
2015-03-03 14:16:22,027 [main] ERROR org.apache.pig.PigServer – exception during parsing: Error during parsing. <file script.pig, line 1, column 9> Unexpected character ‘‘’
Failed to parse: <file script.pig, line 1, column 9> Unexpected character ‘‘’
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:246)
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:182)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1735)
at org.apache.pig.PigServer$Graph.access$000(PigServer.java:1443)
at org.apache.pig.PigServer.parseAndBuild(PigServer.java:387)
at org.apache.pig.PigServer.executeBatch(PigServer.java:412)
at org.apache.pig.PigServer.executeBatch(PigServer.java:398)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:171)
at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:741)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:372)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
at org.apache.pig.Main.run(Main.java:495)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
2015-03-03 14:16:22,085 [main] ERROR org.apache.pig.tools.grunt.Grunt – ERROR 1200: <file script.pig, line 1, column 9> Unexpected character ‘‘’
Details at logfile: /hadoop/yarn/local/usercache/hue/appcache/application_1425380153290_0010/container_1425380153290_0010_01_000002/pig_1425392147966.log
2015-03-03 14:16:22,961 [main] INFO org.apache.pig.Main – Pig script completed in 35 seconds and 266 milliseconds (35266 ms)