Automation TODO

TODO:

• triggering processes in Redshift, Glue, instantiating EC2 instances, etc

• Logging of multi-resource workflows to debug problems - may be simple, but any tips would be appreciated

Notes to be Organized and Completed

Automation

• Initiate a stored procedure in Redshift and pass it a parameters

• Billing and Cost management - Cost Explorer

  • Need permissions for that

• https://aws.amazon.com/blogs/big-data/building-an-event-driven-application-with-aws-lambda-and-the-amazon-redshift-data-api/

Logging

• Cloudtrail monitoring - can do your work, then it will tell you what permissions you’ve been using, control - log in , log out, authentication, administrative, action, role that allowed action

• Cloudwatch - app logs and performance , can install cloudwatch agent, have it write logs to a log

• https://docs.aws.amazon.com/secretsmanager/latest/userguide/monitoring-cloudtrail.html