[INFO] 2022-03-09 00:55:34.227 - [taskAppId=TASK-122-55596-532256]:[138] - -> FAILED: Execution Error, return code 30041 from org.apache.hadoop.hive.ql.exec.spark.SparkTask. Failed to create Spark client for Spark session 1c5c0ae6-d56d-47b3-ae5a-d85fd941b14e_0: java.util.concurrent.TimeoutException: Client '1c5c0ae6-d56d-47b3-ae5a-d85fd941b14e_0' timed out waiting for connection from the Remote Spark Driver
Client '1c5c0ae6-d56d-47b3-ae5a-d85fd941b14e_0' timed out waiting for connection from the Remote Spark Driver
报错的原因是连接5分钟超时
解决方案:
调整的参数:
hive.spark.client.server.connect.timeout=300000
hive.spark.client.connect.timeout=30000
hive.spark.client.future.timeout=1200
调整后调整中的任务无报错。