I have a mapreduce job that worked under HDP 2.2/Hive 0.13 that is now failing under HDP 2.4/Hive 0.14. I’m getting an error
Error: java.io.IOException: No callback registered for TaskAttemptID:attempt_<id>
at org.apache.hive.hcatalog.mapreduce.TaskCommitContextRegistry.commitTask(TaskCommitContextRegistry.java:74)
at org.apache.hive.hcatalog.mapreduce.FileOutputCommitterContainer.commitTask(FileOutputCommitterContainer.java:139)
at org.apache.hadoop.mapred.Task.commit(Task.java:1163)
at org.apache.hadoop.mapred.Task.done(Task:1025)
In my job I’m using HCatInputFormat and HCatOutputFormat. I’ve been trying to track down the cause and noticed that there were changes in Hive 0.14 related to this TaskCommitContextRegistry in November 2014. I just can’t figure out how to register a TaskCommitterProxy or if this is something that should be handled for me by the platform.
Has anyone else encountered this? More importantly, does anyone know how I can fix this?