aws-mon-pgsql

Bash script that reports custom metric data about PostgreSQL(RDS) performance to Amazon CloudWatch

This script is intended for use with Amazon EC2 instances running Linux operating systems for monitoring Amazon RDS for PostgreSQL instances.

The scripts have been tested on the following Amazon Machine Images (AMIs) for both 32-bit and 64-bit versions:

• Amazon Linux 2014.9
• Red Hat Enterprise Linux 6.4
• Ubuntu Server 13.10

The scripts have been tested on the following RDS engines:

• PostgreSQL 9.3.5

The script is written in simple Bash, so you can use it very easily.

Metrics of This Script

This script can report the following metrics:

• status
• cache hit
• session
• transaction
• lock
• tupple read
• tupple write
• block read
• buffer write

Prerequisites

This script requires AWS Command Line Interface.

Amazon Linux

Instances that you launch using the Amazon Linux AMI already include the CLI tools.

All you have to do is to install git and postgresql-client.

yum install git postgresql

RHEL, Ubuntu

RHEL

Install git and postgresql-client.

yum install git postgresql

Ubuntu

Install git, unzip, jre and postgresql-client.

apt-get install git unzip default-jre postgresql-client

RHEL, Ubuntu

You can install AWS Command Line Interface with following steps:

pip install awscli

Getting Started

Download "aws-mon-pgsql.sh" or clone repository:

git clone https://github.com/moomindani/aws-mon-pgsql.git
cd aws-mon-pgsql

Make ".pgpass" in order to connect postgres without password:

echo "postgres.xxx.ap-northeast-1.rds.amazonaws.com:5432:postgres:postgres:password" > ~/.pgpass
chmod 600 ~/.pgpass

Use the script:

./aws-mon-pgsql.sh --help

Using the Script

This script collects status, cache hit, session, transaction, lock, tupple read, tupple write, block read, buffer write data on the target RDS. It then makes a remote call to Amazon CloudWatch to report the collected data as custom metrics.

Option

Examples

The following examples assume that you have already configured awscli with "aws configure".

To perform a simple test run without posting data to CloudWatch

• Run the following command:

./aws-mon-pgsql.sh --id postgres -h postgres.xxx.ap-northeast-1.rds.amazonaws.com -p 5432 -U postgres -d postgres --status-check-failed --verify --verbose

To collect the status and send them to CloudWatch

• Run the following command:

./aws-mon-pgsql.sh --id postgres -h postgres.xxx.ap-northeast-1.rds.amazonaws.com -p 5432 -U postgres -d postgres --status-check-failed  --verbose

To collect all available session metrics and send them to CloudWatch

• Run the following command:

./aws-mon-pgsql.sh --id postgres -h postgres.xxx.ap-northeast-1.rds.amazonaws.com -p 5432 -U postgres -d postgres --session-active --session-idle --session-wait --verbose

To collect the cache hit ratio and send them to CloudWatch

• Run the following command:

./aws-mon-pgsql.sh --id postgres -h postgres.xxx.ap-northeast-1.rds.amazonaws.com -p 5432 -U postgres -d postgres --cache-hit --verbose

To collect all available tupple metrics and send them to CloudWatch

• Run the following command:

./aws-mon-pgsql.sh --id postgres -h postgres.xxx.ap-northeast-1.rds.amazonaws.com -p 5432 -U postgres -d postgres --tup-inserted --tup-updated --tup-deleted --tup-returned --tup-fetched --verbose
(wait a few seconds...)
./aws-mon-pgsql.sh --id postgres -h postgres.xxx.ap-northeast-1.rds.amazonaws.com -p 5432 -U postgres -d postgres --tup-inserted --tup-updated --tup-deleted --tup-returned --tup-fetched --verbose

To set a cron schedule for metrics reported to CloudWatch

1. Start editing the crontab using the following command:

crontab -e

2. Add the following command to report all items to CloudWatch every five minutes:

*/5 * * * *  ~/aws-mon-pgsql/aws-mon-pgsql.sh --id postgres -h postgres.xxx.ap-northeast-1.rds.amazonaws.com -p 5432 -U postgres -d postgres --all-items --from-cron