Question 1

How to pass arguments to EMR bootstrap actions?

Accepted Answer

You can pass arguments using the Args parameter in the AWS CLI create-cluster command, as shown in the README example with 'Args=arg1,arg2'. This allows dynamic customization of scripts stored in S3.

Question 2

What is the difference between EMR bootstrap actions and EC2 user data?

Accepted Answer

EMR bootstrap actions run after boot and before application provisioning on all cluster nodes, while EC2 user data executes only at instance launch. Bootstrap actions are specific to EMR for Hadoop ecosystem setup, offering more control over cluster initialization.

Question 3

How to troubleshoot a failed bootstrap action in Amazon EMR?

Accepted Answer

Check EMR cluster logs in Amazon CloudWatch or SSH into nodes to inspect script output. The samples may lack robust error handling, so you'll need to add logging and validate dependencies manually during adaptation.

Question 4

Can I use configuration management tools like Ansible with EMR bootstrap actions?

Accepted Answer

Yes, but it requires extra setup; you can write a bootstrap script that installs and runs Ansible, though the samples don't include this. This adds complexity compared to using native EMR features or IaC tools.

Question 5

What are best practices for making EMR bootstrap actions idempotent?

Accepted Answer

Design scripts to check for existing installations or configurations before making changes, using conditionals in shell code. The provided samples may not demonstrate this, so you'll need to implement it for production use.

Question 6

How to install custom Python packages on EMR using bootstrap actions?

Accepted Answer

Write a script that uses pip or conda to install packages, referencing S3 for dependencies if needed. The repository includes examples for common setups, but you must tailor them to your environment and handle version conflicts.

emr-bootstrap-actions

What is emr-bootstrap-actions?

Overview

Use Cases

Best For

Found a gem we're missing?

Not Ideal For

Pros & Cons

Pros

Cons

Frequently Asked Questions