20/05/17 00:57:21 INFO mapreduce.Job: map 50% reduce 0%
20/05/17 00:57:26 INFO mapreduce.Job: map 58% reduce 0%
20/05/17 00:57:29 INFO mapreduce.Job: map 60% reduce 0%
20/05/17 00:57:29 INFO mapreduce.Job: Task Id : attempt_1589647746660_0003_m_000000_1, Status : FAILED
Error: java.lang.RuntimeException: native-lzo library not available
at com.hadoop.compression.lzo.LzopCodec.getDecompressorType(LzopCodec.java:156)
at org.apache.hadoop.io.compress.CodecPool.getDecompressor(CodecPool.java:178)
at org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:90)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:548)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:786)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
20/05/17 00:57:31 INFO mapreduce.Job: map 60% reduce 17%
20/05/17 00:57:32 INFO mapreduce.Job: map 62% reduce 17%
20/05/17 00:57:35 INFO mapreduce.Job: map 65% reduce 17%
20/05/17 00:57:38 INFO mapreduce.Job: map 68% reduce 17%
20/05/17 00:57:41 INFO mapreduce.Job: map 72% reduce 17%
20/05/17 00:57:44 INFO mapreduce.Job: map 75% reduce 17%
20/05/17 00:57:44 INFO mapreduce.Job: Task Id : attempt_1589647746660_0003_m_000000_2, Status : FAILED
Error: java.lang.RuntimeException: native-lzo library not available
at com.hadoop.compression.lzo.LzopCodec.getDecompressorType(LzopCodec.java:156)
at org.apache.hadoop.io.compress.CodecPool.getDecompressor(CodecPool.java:178)
at org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:90)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:548)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:786)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
uj5u.com熱心網友回復：
我也有同樣的問題，環境變數都設定了，還是不行uj5u.com熱心網友回復：
缺少hadoop-lzo的jar包，下載解壓安裝后，需要修改相應的組態檔core-site.xml轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/24796.html
標籤：分布式計算/Hadoop