Cloudformation 設定下面的行為不像我預期的那樣。 以下變數未使用以下模板設定。手動設定變數時，作業成功運行。
- IAM 角色
- 型別
- 語
Description: "AWS Glue Job Test"
Resources:
MyJobRole:
Type: AWS::IAM::Role
Properties:
AssumeRolePolicyDocument:
Version: "2012-10-17"
Statement:
-
Effect: "Allow"
Principal:
Service:
- "glue.amazonaws.com"
Action:
- "sts:AssumeRole"
Path: "/"
Policies:
-
PolicyName: "root"
PolicyDocument:
Version: "2012-10-17"
Statement:
-
Effect: "Allow"
Action: "*"
Resource: "*"
MyJob:
Type: AWS::Glue::Job
Properties:
Name: cf-job1
Command:
Name: test-etl1
ScriptLocation: "s3://project_bucket/releases/latest/mixpanel_job.py"
PythonVersion: "3"
Description: "Testing setup config"
ExecutionProperty:
MaxConcurrentRuns: 2
MaxRetries: 2
GlueVersion: "3.0"
WorkerType: "G.1X"
NumberOfWorkers: 2
Timeout: 2880
DefaultArguments:
"--class": "GlueApp"
"--enable-continuous-cloudwatch-log": "true"
"--enable-job-insights": "true"
"--enable-metrics": "true"
"--enable-spark-ui": "true"
"--extra-jars": "s3://project_bucket/releases/latest/jars/delta-core_2.12-1.0.1.jar"
"--extra-py-files": "s3://project_bucket/releases/latest/lib.zip"
"--job-bookmark-option": "job-bookmark-disable"
"--job-language": "python"
"--spark-event-logs-path": "s3://project_bucket/logs/"
Role: !Ref MyJobRole
堆疊結果
uj5u.com熱心網友回復：
這是 Glue 團隊中 AWS Cloudformation 的一個已知問題。
只能使用指向另一個 ROLE 的物理 ARN 字串值來設定運行作業的默認 IAM 角色
--job-language 引數設定不正確，這是一個已知問題。這必須通過 Glue 控制臺手動完成
控制臺中的型別引數仍然沒有 cloudformation 引數，必須手動設定。
此時無法實作真正??的自動化。
轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/494565.html
標籤：Python 亚马逊网络服务 阿帕奇火花 亚马逊云形成 aws胶水