Question

I could find many examples of invoking SQL script on Redshift using Lambda inside Step Function (ex: this works well), however I could not figured out how to execute SQL script using AWS Fargate in Step Functions. I could not figured out how to pass the Redshift credentials to execute the queries. In the lambda case it was easy as below. How to passing the credentials to Fargate Task probably is the same, however what are the commands to execute the SQL scripts?

"States": {
    "loadJob": {
      "Type": "Pass",
      "Next": "loadJobETL",
      "Result": {
        "input": {
          "redshift_cluster_id": "<RS_CLUSTER>",
          "redshift_database": "<MY_DB>",
          "redshift_user": "<MY_DB>root",
          "redshift_schema": "MY_SCHEMA",
          "action": "load_customer_address",
          "sql_statement": [
            "begin transaction;",
            "MY_SQL_STATEMENT",
            "end transaction;"
          ]
        }
      }
    },
    "loadJobETL": {
      "Type": "Task",
      "Resource": "arn:aws:lambda:us-east-1:XXXXXXXXXXX:function:SOME_FUNCTION",
      "TimeoutSeconds": 180,
      "HeartbeatSeconds": 60,
      "InputPath": "$",
      "ResultPath": "$",
      "Next": "checkStatus"
    }
}

Answer 1

您可使用Step Functions rel=“nofollow noreferer”>。这可能像以下一点。至于该守则在贵方位集装箱中将如何看待,这将取决于你选定的语言,但我预计会使用阿拉伯妇女论坛,并非常类似于你在拉宾达法典中的内容。

{
  "StartAt": "loadJob",
  "States": {
    "loadJob": {
      "Type": "Pass",
      "Next": "loadJobETL",
      "Result": {
        "input": {
          "redshift_cluster_id": "<RS_CLUSTER>",
          "redshift_database": "<MY_DB>",
          "redshift_user": "<MY_DB>root",
          "redshift_schema": "MY_SCHEMA",
          "action": "load_customer_address",
          "sql_statement": [
            "begin transaction;",
            "MY_SQL_STATEMENT",
            "end transaction;"
          ]
        }
      }
    },
    "loadJobETL": {
      "Type": "Task",
      "Resource": "arn:aws:states:::ecs:runTask.sync",
      "Parameters": {
        "LaunchType": "FARGATE",
        "Cluster": "arn:aws:ecs:REGION:ACCOUNT_ID:cluster/MyECSCluster",
        "TaskDefinition": "arn:aws:ecs:REGION:ACCOUNT_ID:task-definition/MyTaskDefinition:1",
        "Overrides": {
          "ContainerOverrides": [
            {
              "Name": "container-name",
              "Command.$": "$"
            }
          ]
        }
      },
      "End": true
    }
  }
}

或者,根据产出的规模,您可以直接从使用<代码>arn:aws:states:aws-sdk:redpaddata:executeStatement的职等职能中操作。

友情链接