Installing MySQL Connector & MySQL on an AWS EMR Cluster

🚨 I'm writing this blog as a reference to myself regarding all things related to databases. If you find the content a bit unstructured or if it doesn't make sense that's the reason why.

Installing MySQL Connector on AWS

You will need to install MySQL connector before starting with Apache Sqoop to use Sqoop with MySQL tables.

wget https://de-mysql-connector.s3.amazonaws.com/mysql-connector-java-8.0.25.tar.gz
tar -xvf mysql-connector-java-8.0.25.tar.gz
cd mysql-connector-java-8.0.25/
sudo cp mysql-connector-java-8.0.25.jar /usr/lib/sqoop/lib/

Apache Sqoop MySQL Installation

mysql_secure_installation

Enter current password:

Set root password: Y

New password: 123 Re-enter new password: 123

Remove anonymous users: Y

Disallow root login remotely: n

Remove test database and access to it: Y

Reload privilege tables now: Y

mysql -u root -p

Enter password: 123

GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' identified by '123' WITH GRANT OPTION;
flush privileges;
exit;

sudo service mariadb restart