hadoop - AvroStorage with mapreduce and java.lang.RuntimeException: could not instantiate -
i have simple pig script,
sensitiveset = load 'hdfs:///data/customerdata-20160128-1501807.avro' using org.apache.pig.piggybank.storage.avro.avrostorage(); dump sensitiveset;
when code executed in pig -x local mode runs smoothly, when executed in mapreduce mode got error below:
2016-01-28 21:44:39,644 [main] info org.apache.hadoop.mapred.clientservicedelegate - application state completed. finalapplicationstatus=failed. redirecting job history server 2016-01-28 21:44:56,492 [main] warn org.apache.pig.backend.hadoop.executionengine.launcher - there no log file write to. 2016-01-28 21:44:56,493 [main] error org.apache.pig.backend.hadoop.executionengine.launcher - backend error message error: java.lang.runtimeexception: not instantiate 'org.apache.pig.piggybank.storage.avro.avrostorage' arguments 'null' @ org.apache.pig.impl.pigcontext.instantiatefuncfromspec(pigcontext.java:772) @ org.apache.pig.backend.hadoop.executionengine.mapreducelayer.piginputformat.getloadfunc(piginputformat.java:149) @ org.apache.pig.backend.hadoop.executionengine.mapreducelayer.piginputformat.createrecordreader(piginputformat.java:97) @ org.apache.hadoop.mapred.maptask$newtrackingrecordreader.<init>(maptask.java:515) @ org.apache.hadoop.mapred.maptask.runnewmapper(maptask.java:758)
input(s): failed read data " hdfs:///data/customerdata-20160128-1501807.avro"
any idea should problem?
thanks
Comments
Post a Comment