目錄
問題1：
問題2：
問題3：
問題4：
問題1：使用CDC執行flink任務時報錯
flink Can''t call rollback when autocommit=true解決：可能是kafka的topic沒有資料，判空就可以了，
問題2：集群上執行flink任務
per-job模式運行報例外，global limit =2; local limit is =1解決：代碼參考的依賴和集群上的hadoop環境沖突，
問題3：資料量大的時候執行per-job模式報錯
Caused by: java.lang.Exception: [2021-08-17 18:42:50.353]Exception from container-launch.
Container id: container_e11_1627612938926_0154_01_000004
Exit code: 239
[2021-08-17 18:42:50.354]Container exited with a non-zero exit code 239. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
[2021-08-17 18:42:50.355]Container exited with a non-zero exit code 239. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :解決：這種情況是其他例外導致的Container例外，目前的解決方案是資料量太大，處理不過來，任務掛掉之后從最新位置開始讀取資料就可以了，會導致丟失任務失敗的間隔段，
問題4：執行per-job模式報錯
Caused by: java.lang.RuntimeException: org.apache.flink.runtime.client.JobInitializationException: Could not instantiate JobManager.
at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:309)
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedFunction$2(FunctionUtils.java:76)
at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602)
at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577)
at java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:443)
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:157)
Caused by: org.apache.flink.runtime.client.JobInitializationException: Could not instantiate JobManager.
at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$5(Dispatcher.java:463)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to create checkpoint storage at checkpoint coordinator side.解決：
問題5：執行任務控制臺出現很多例外
一般都是jar包日志突然，下載個maven-helper插件，把突然的都去掉，只留一個就OK了，
轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/294896.html
標籤：其他
上一篇：快速了解HIVE檔案存盤格式