sensu-plugins-aws
sensu-plugins-aws copied to clipboard
sensu-plugins
Installing plugin takes a long time and sometimes errors out when installing the aws dependencies
@majormoses So I've been trying to install this plugin during acceptance testing and even pipeline builds and it always causes a HUGE bottleneck for the install. So in taking your advice (https://github.com/sensu-plugins/community/blob/master/best_practices/production_deployments/plugins/WITHOUT_COMPILERS.md) and (https://github.com/sensu/sensu-puppet/issues/908) I compiled unf_ext and nokogiri, uploaded to artifactory and installed prior to installing this gem and it's not helping (Maybe the document or this plugins README should be updated to handle the compiled dependencies in order to avoid needing compiler to be installed on the resulting client machine.
I took centos:7 image and preinstalled sensu to save me a step and here is the resulting output. As you can see the time it took to install this plugin took 6 minutes alone even after the dependency gems were installed. In our CI systems they don't have much memory or cpu and I've seen them take > 50 minutes for this step for some reason... (< 7m for full build if I remove just this plugin).
There has to be a better way to speed up this install.
~ » date
Fri Sep 7 13:35:27 EDT 2018
~ » docker run --rm -ti 089982837c4f bash
[root@88c43b3d21a8 /]# yum install which -y
Loaded plugins: fastestmirror, ovl
Loading mirror speeds from cached hostfile
epel/x86_64/metalink | 17 kB 00:00:00
* base: mirror.cc.columbia.edu
* epel: mirror.umd.edu
* extras: mirrors.advancedhosters.com
* updates: mirror.trouble-free.net
base | 3.6 kB 00:00:00
epel | 3.2 kB 00:00:00
extras | 3.4 kB 00:00:00
sensu | 2.5 kB 00:00:00
updates | 3.4 kB 00:00:00
Resolving Dependencies
--> Running transaction check
---> Package which.x86_64 0:2.20-7.el7 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
=========================================================================================================================================================================================
Package Arch Version Repository Size
=========================================================================================================================================================================================
Installing:
which x86_64 2.20-7.el7 base 41 k
Transaction Summary
=========================================================================================================================================================================================
Install 1 Package
Total download size: 41 k
Installed size: 75 k
Downloading packages:
which-2.20-7.el7.x86_64.rpm | 41 kB 00:00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing : which-2.20-7.el7.x86_64 1/1
install-info: No such file or directory for /usr/share/info/which.info.gz
Verifying : which-2.20-7.el7.x86_64 1/1
Installed:
which.x86_64 0:2.20-7.el7
Complete!
[root@88c43b3d21a8 /]# gem install unf_ext --source https://artifactory.domain.com/api/gems/ap-rubygems-local-ruby24
Fetching: unf_ext-0.0.7.5-x86_64-linux.gem (100%)
Successfully installed unf_ext-0.0.7.5-x86_64-linux
Parsing documentation for unf_ext-0.0.7.5-x86_64-linux
Installing ri documentation for unf_ext-0.0.7.5-x86_64-linux
Done installing documentation for unf_ext after 0 seconds
1 gem installed
[root@88c43b3d21a8 /]# gem install nokogiri --source https://artifactory.domain.com/api/gems/ap-rubygems-local-ruby24
Fetching: mini_portile2-2.3.0.gem (100%)
Successfully installed mini_portile2-2.3.0
Fetching: nokogiri-1.8.4-x86_64-linux.gem (100%)
Successfully installed nokogiri-1.8.4-x86_64-linux
Parsing documentation for mini_portile2-2.3.0
Installing ri documentation for mini_portile2-2.3.0
Parsing documentation for nokogiri-1.8.4-x86_64-linux
Installing ri documentation for nokogiri-1.8.4-x86_64-linux
Done installing documentation for mini_portile2, nokogiri after 9 seconds
2 gems installed
[root@88c43b3d21a8 /]# date
Fri Sep 7 17:36:27 UTC 2018
[root@88c43b3d21a8 /]# /opt/sensu/bin/sensu-install -p aws
[SENSU-INSTALL] installing Sensu plugins ...
[SENSU-INSTALL] determining if Sensu gem 'sensu-plugins-aws' is already installed ...
false
[SENSU-INSTALL] Sensu plugin gems to be installed: ["sensu-plugins-aws"]
[SENSU-INSTALL] installing Sensu gem 'sensu-plugins-aws'
Fetching: aws-sigv4-1.0.3.gem (100%)
Successfully installed aws-sigv4-1.0.3
Fetching: aws-eventstream-1.0.1.gem (100%)
Successfully installed aws-eventstream-1.0.1
Fetching: aws-partitions-1.103.0.gem (100%)
Successfully installed aws-partitions-1.103.0
Fetching: jmespath-1.4.0.gem (100%)
Successfully installed jmespath-1.4.0
Fetching: aws-sdk-core-3.27.0.gem (100%)
Successfully installed aws-sdk-core-3.27.0
Fetching: aws-sdk-acm-1.11.0.gem (100%)
Successfully installed aws-sdk-acm-1.11.0
Fetching: aws-sdk-acmpca-1.4.0.gem (100%)
Successfully installed aws-sdk-acmpca-1.4.0
Fetching: aws-sdk-apigateway-1.16.0.gem (100%)
Successfully installed aws-sdk-apigateway-1.16.0
Fetching: aws-sdk-alexaforbusiness-1.9.0.gem (100%)
Successfully installed aws-sdk-alexaforbusiness-1.9.0
Fetching: aws-sdk-appstream-1.15.0.gem (100%)
Successfully installed aws-sdk-appstream-1.15.0
Fetching: aws-sdk-appsync-1.6.0.gem (100%)
Successfully installed aws-sdk-appsync-1.6.0
Fetching: aws-sdk-applicationautoscaling-1.13.0.gem (100%)
Successfully installed aws-sdk-applicationautoscaling-1.13.0
Fetching: aws-sdk-applicationdiscoveryservice-1.5.0.gem (100%)
Successfully installed aws-sdk-applicationdiscoveryservice-1.5.0
Fetching: aws-sdk-athena-1.3.0.gem (100%)
Successfully installed aws-sdk-athena-1.3.0
Fetching: aws-sdk-autoscaling-1.9.0.gem (100%)
Successfully installed aws-sdk-autoscaling-1.9.0
Fetching: aws-sdk-autoscalingplans-1.5.0.gem (100%)
Successfully installed aws-sdk-autoscalingplans-1.5.0
Fetching: aws-sdk-batch-1.7.0.gem (100%)
Successfully installed aws-sdk-batch-1.7.0
Fetching: aws-sdk-budgets-1.10.0.gem (100%)
Successfully installed aws-sdk-budgets-1.10.0
Fetching: aws-sdk-cloud9-1.4.0.gem (100%)
Successfully installed aws-sdk-cloud9-1.4.0
Fetching: aws-sdk-clouddirectory-1.7.0.gem (100%)
Successfully installed aws-sdk-clouddirectory-1.7.0
Fetching: aws-sdk-cloudformation-1.8.0.gem (100%)
Successfully installed aws-sdk-cloudformation-1.8.0
Fetching: aws-sdk-cloudfront-1.7.0.gem (100%)
Successfully installed aws-sdk-cloudfront-1.7.0
Fetching: aws-sdk-cloudhsm-1.6.0.gem (100%)
Successfully installed aws-sdk-cloudhsm-1.6.0
Fetching: aws-sdk-cloudhsmv2-1.5.0.gem (100%)
Successfully installed aws-sdk-cloudhsmv2-1.5.0
Fetching: aws-sdk-cloudsearch-1.3.0.gem (100%)
Successfully installed aws-sdk-cloudsearch-1.3.0
Fetching: aws-sdk-cloudsearchdomain-1.3.0.gem (100%)
Successfully installed aws-sdk-cloudsearchdomain-1.3.0
Fetching: aws-sdk-cloudtrail-1.3.0.gem (100%)
Successfully installed aws-sdk-cloudtrail-1.3.0
Fetching: aws-sdk-cloudwatch-1.8.0.gem (100%)
Successfully installed aws-sdk-cloudwatch-1.8.0
Fetching: aws-sdk-cloudwatchevents-1.7.0.gem (100%)
Successfully installed aws-sdk-cloudwatchevents-1.7.0
Fetching: aws-sdk-cloudwatchlogs-1.7.0.gem (100%)
Successfully installed aws-sdk-cloudwatchlogs-1.7.0
Fetching: aws-sdk-codebuild-1.17.0.gem (100%)
Successfully installed aws-sdk-codebuild-1.17.0
Fetching: aws-sdk-codecommit-1.7.0.gem (100%)
Successfully installed aws-sdk-codecommit-1.7.0
Fetching: aws-sdk-codedeploy-1.8.0.gem (100%)
Successfully installed aws-sdk-codedeploy-1.8.0
Fetching: aws-sdk-codepipeline-1.7.0.gem (100%)
Successfully installed aws-sdk-codepipeline-1.7.0
Fetching: aws-sdk-codestar-1.4.0.gem (100%)
Successfully installed aws-sdk-codestar-1.4.0
Fetching: aws-sdk-cognitoidentity-1.3.0.gem (100%)
Successfully installed aws-sdk-cognitoidentity-1.3.0
Fetching: aws-sdk-cognitoidentityprovider-1.8.0.gem (100%)
Successfully installed aws-sdk-cognitoidentityprovider-1.8.0
Fetching: aws-sdk-cognitosync-1.3.0.gem (100%)
Successfully installed aws-sdk-cognitosync-1.3.0
Fetching: aws-sdk-comprehend-1.5.0.gem (100%)
Successfully installed aws-sdk-comprehend-1.5.0
Fetching: aws-sdk-configservice-1.15.0.gem (100%)
Successfully installed aws-sdk-configservice-1.15.0
Fetching: aws-sdk-connect-1.4.0.gem (100%)
Successfully installed aws-sdk-connect-1.4.0
Fetching: aws-sdk-costexplorer-1.9.0.gem (100%)
Successfully installed aws-sdk-costexplorer-1.9.0
Fetching: aws-sdk-costandusagereportservice-1.3.0.gem (100%)
Successfully installed aws-sdk-costandusagereportservice-1.3.0
Fetching: aws-sdk-dax-1.5.0.gem (100%)
Successfully installed aws-sdk-dax-1.5.0
Fetching: aws-sdk-dlm-1.3.0.gem (100%)
Successfully installed aws-sdk-dlm-1.3.0
Fetching: aws-sdk-datapipeline-1.3.0.gem (100%)
Successfully installed aws-sdk-datapipeline-1.3.0
Fetching: aws-sdk-databasemigrationservice-1.9.0.gem (100%)
Successfully installed aws-sdk-databasemigrationservice-1.9.0
Fetching: aws-sdk-devicefarm-1.10.0.gem (100%)
Successfully installed aws-sdk-devicefarm-1.10.0
Fetching: aws-sdk-directconnect-1.5.0.gem (100%)
Successfully installed aws-sdk-directconnect-1.5.0
Fetching: aws-sdk-directoryservice-1.5.0.gem (100%)
Successfully installed aws-sdk-directoryservice-1.5.0
Fetching: aws-sdk-dynamodb-1.13.0.gem (100%)
Successfully installed aws-sdk-dynamodb-1.13.0
Fetching: aws-sdk-dynamodbstreams-1.3.0.gem (100%)
Successfully installed aws-sdk-dynamodbstreams-1.3.0
Fetching: aws-sdk-ec2-1.45.0.gem (100%)
Successfully installed aws-sdk-ec2-1.45.0
Fetching: aws-sdk-ecr-1.6.0.gem (100%)
Successfully installed aws-sdk-ecr-1.6.0
Fetching: aws-sdk-ecs-1.19.0.gem (100%)
Successfully installed aws-sdk-ecs-1.19.0
Fetching: aws-sdk-efs-1.4.0.gem (100%)
Successfully installed aws-sdk-efs-1.4.0
Fetching: aws-sdk-eks-1.4.0.gem (100%)
Successfully installed aws-sdk-eks-1.4.0
Fetching: aws-sdk-emr-1.5.0.gem (100%)
Successfully installed aws-sdk-emr-1.5.0
Fetching: aws-sdk-elasticache-1.6.0.gem (100%)
Successfully installed aws-sdk-elasticache-1.6.0
Fetching: aws-sdk-elasticbeanstalk-1.11.0.gem (100%)
Successfully installed aws-sdk-elasticbeanstalk-1.11.0
Fetching: aws-sdk-elasticloadbalancing-1.5.0.gem (100%)
Successfully installed aws-sdk-elasticloadbalancing-1.5.0
Fetching: aws-sdk-elasticloadbalancingv2-1.14.0.gem (100%)
Successfully installed aws-sdk-elasticloadbalancingv2-1.14.0
Fetching: aws-sdk-elastictranscoder-1.3.0.gem (100%)
Successfully installed aws-sdk-elastictranscoder-1.3.0
Fetching: aws-sdk-elasticsearchservice-1.10.0.gem (100%)
Successfully installed aws-sdk-elasticsearchservice-1.10.0
Fetching: aws-sdk-fms-1.3.0.gem (100%)
Successfully installed aws-sdk-fms-1.3.0
Fetching: aws-sdk-firehose-1.6.0.gem (100%)
Successfully installed aws-sdk-firehose-1.6.0
Fetching: aws-sdk-gamelift-1.7.0.gem (100%)
Successfully installed aws-sdk-gamelift-1.7.0
Fetching: aws-sdk-glacier-1.11.0.gem (100%)
Successfully installed aws-sdk-glacier-1.11.0
Fetching: aws-sdk-glue-1.16.0.gem (100%)
Successfully installed aws-sdk-glue-1.16.0
Fetching: aws-sdk-greengrass-1.7.0.gem (100%)
Successfully installed aws-sdk-greengrass-1.7.0
Fetching: aws-sdk-guardduty-1.7.0.gem (100%)
Successfully installed aws-sdk-guardduty-1.7.0
Fetching: aws-sdk-health-1.5.0.gem (100%)
Successfully installed aws-sdk-health-1.5.0
Fetching: aws-sdk-iam-1.8.0.gem (100%)
Successfully installed aws-sdk-iam-1.8.0
Fetching: aws-sigv2-1.0.1.gem (100%)
Successfully installed aws-sigv2-1.0.1
Fetching: aws-sdk-importexport-1.3.0.gem (100%)
Successfully installed aws-sdk-importexport-1.3.0
Fetching: aws-sdk-inspector-1.8.0.gem (100%)
Successfully installed aws-sdk-inspector-1.8.0
Fetching: aws-sdk-iot-1.15.0.gem (100%)
Successfully installed aws-sdk-iot-1.15.0
Fetching: aws-sdk-iot1clickdevicesservice-1.3.0.gem (100%)
Successfully installed aws-sdk-iot1clickdevicesservice-1.3.0
Fetching: aws-sdk-iot1clickprojects-1.3.0.gem (100%)
Successfully installed aws-sdk-iot1clickprojects-1.3.0
Fetching: aws-sdk-iotanalytics-1.7.0.gem (100%)
Successfully installed aws-sdk-iotanalytics-1.7.0
Fetching: aws-sdk-iotdataplane-1.3.0.gem (100%)
Successfully installed aws-sdk-iotdataplane-1.3.0
Fetching: aws-sdk-iotjobsdataplane-1.3.0.gem (100%)
Successfully installed aws-sdk-iotjobsdataplane-1.3.0
Fetching: aws-sdk-kms-1.9.0.gem (100%)
Successfully installed aws-sdk-kms-1.9.0
Fetching: aws-sdk-kinesis-1.6.0.gem (100%)
Successfully installed aws-sdk-kinesis-1.6.0
Fetching: aws-sdk-kinesisanalytics-1.5.0.gem (100%)
Successfully installed aws-sdk-kinesisanalytics-1.5.0
Fetching: aws-sdk-kinesisvideo-1.4.0.gem (100%)
Successfully installed aws-sdk-kinesisvideo-1.4.0
Fetching: aws-sdk-kinesisvideoarchivedmedia-1.4.0.gem (100%)
Successfully installed aws-sdk-kinesisvideoarchivedmedia-1.4.0
Fetching: aws-sdk-kinesisvideomedia-1.3.0.gem (100%)
Successfully installed aws-sdk-kinesisvideomedia-1.3.0
Fetching: aws-sdk-lambda-1.10.0.gem (100%)
Successfully installed aws-sdk-lambda-1.10.0
Fetching: aws-sdk-lambdapreview-1.3.0.gem (100%)
Successfully installed aws-sdk-lambdapreview-1.3.0
Fetching: aws-sdk-lex-1.6.0.gem (100%)
Successfully installed aws-sdk-lex-1.6.0
Fetching: aws-sdk-lexmodelbuildingservice-1.9.0.gem (100%)
Successfully installed aws-sdk-lexmodelbuildingservice-1.9.0
Fetching: aws-sdk-lightsail-1.7.0.gem (100%)
Successfully installed aws-sdk-lightsail-1.7.0
Fetching: aws-sdk-mq-1.4.0.gem (100%)
Successfully installed aws-sdk-mq-1.4.0
Fetching: aws-sdk-mturk-1.6.0.gem (100%)
Successfully installed aws-sdk-mturk-1.6.0
Fetching: aws-sdk-machinelearning-1.3.0.gem (100%)
Successfully installed aws-sdk-machinelearning-1.3.0
Fetching: aws-sdk-macie-1.3.0.gem (100%)
Successfully installed aws-sdk-macie-1.3.0
Fetching: aws-sdk-marketplacecommerceanalytics-1.3.0.gem (100%)
Successfully installed aws-sdk-marketplacecommerceanalytics-1.3.0
Fetching: aws-sdk-marketplaceentitlementservice-1.3.0.gem (100%)
Successfully installed aws-sdk-marketplaceentitlementservice-1.3.0
Fetching: aws-sdk-marketplacemetering-1.3.0.gem (100%)
Successfully installed aws-sdk-marketplacemetering-1.3.0
Fetching: aws-sdk-mediaconvert-1.12.0.gem (100%)
Successfully installed aws-sdk-mediaconvert-1.12.0
Fetching: aws-sdk-medialive-1.11.0.gem (100%)
Successfully installed aws-sdk-medialive-1.11.0
Fetching: aws-sdk-mediapackage-1.6.0.gem (100%)
Successfully installed aws-sdk-mediapackage-1.6.0
Fetching: aws-sdk-mediastore-1.4.0.gem (100%)
Successfully installed aws-sdk-mediastore-1.4.0
Fetching: aws-sdk-mediastoredata-1.4.0.gem (100%)
Successfully installed aws-sdk-mediastoredata-1.4.0
Fetching: aws-sdk-mediatailor-1.4.0.gem (100%)
Successfully installed aws-sdk-mediatailor-1.4.0
Fetching: aws-sdk-migrationhub-1.5.0.gem (100%)
Successfully installed aws-sdk-migrationhub-1.5.0
Fetching: aws-sdk-mobile-1.3.0.gem (100%)
Successfully installed aws-sdk-mobile-1.3.0
Fetching: aws-sdk-neptune-1.4.0.gem (100%)
Successfully installed aws-sdk-neptune-1.4.0
Fetching: aws-sdk-opsworks-1.6.0.gem (100%)
Successfully installed aws-sdk-opsworks-1.6.0
Fetching: aws-sdk-opsworkscm-1.5.0.gem (100%)
Successfully installed aws-sdk-opsworkscm-1.5.0
Fetching: aws-sdk-organizations-1.12.0.gem (100%)
Successfully installed aws-sdk-organizations-1.12.0
Fetching: aws-sdk-pi-1.3.0.gem (100%)
Successfully installed aws-sdk-pi-1.3.0
Fetching: aws-sdk-pinpoint-1.9.0.gem (100%)
Successfully installed aws-sdk-pinpoint-1.9.0
Fetching: aws-sdk-polly-1.10.0.gem (100%)
Successfully installed aws-sdk-polly-1.10.0
Fetching: aws-sdk-pricing-1.3.0.gem (100%)
Successfully installed aws-sdk-pricing-1.3.0
Fetching: aws-sdk-rds-1.29.0.gem (100%)
Successfully installed aws-sdk-rds-1.29.0
Fetching: aws-sdk-redshift-1.10.0.gem (100%)
Successfully installed aws-sdk-redshift-1.10.0
Fetching: aws-sdk-rekognition-1.9.0.gem (100%)
Successfully installed aws-sdk-rekognition-1.9.0
Fetching: aws-sdk-resourcegroups-1.4.0.gem (100%)
Successfully installed aws-sdk-resourcegroups-1.4.0
Fetching: aws-sdk-resourcegroupstaggingapi-1.3.0.gem (100%)
Successfully installed aws-sdk-resourcegroupstaggingapi-1.3.0
Fetching: aws-sdk-route53-1.12.0.gem (100%)
Successfully installed aws-sdk-route53-1.12.0
Fetching: aws-sdk-route53domains-1.5.0.gem (100%)
Successfully installed aws-sdk-route53domains-1.5.0
Fetching: aws-sdk-s3-1.19.0.gem (100%)
Successfully installed aws-sdk-s3-1.19.0
Fetching: aws-sdk-ses-1.10.0.gem (100%)
Successfully installed aws-sdk-ses-1.10.0
Fetching: aws-sdk-sms-1.3.0.gem (100%)
Successfully installed aws-sdk-sms-1.3.0
Fetching: aws-sdk-sns-1.5.0.gem (100%)
Successfully installed aws-sdk-sns-1.5.0
Fetching: aws-sdk-sqs-1.6.0.gem (100%)
Successfully installed aws-sdk-sqs-1.6.0
Fetching: aws-sdk-ssm-1.25.0.gem (100%)
Successfully installed aws-sdk-ssm-1.25.0
Fetching: aws-sdk-swf-1.3.0.gem (100%)
Successfully installed aws-sdk-swf-1.3.0
Fetching: aws-sdk-sagemaker-1.18.0.gem (100%)
Successfully installed aws-sdk-sagemaker-1.18.0
Fetching: aws-sdk-sagemakerruntime-1.4.0.gem (100%)
Successfully installed aws-sdk-sagemakerruntime-1.4.0
Fetching: aws-sdk-secretsmanager-1.14.0.gem (100%)
Successfully installed aws-sdk-secretsmanager-1.14.0
Fetching: aws-sdk-serverlessapplicationrepository-1.6.0.gem (100%)
Successfully installed aws-sdk-serverlessapplicationrepository-1.6.0
Fetching: aws-sdk-servicecatalog-1.8.0.gem (100%)
Successfully installed aws-sdk-servicecatalog-1.8.0
Fetching: aws-sdk-servicediscovery-1.5.0.gem (100%)
Successfully installed aws-sdk-servicediscovery-1.5.0
Fetching: aws-sdk-shield-1.5.0.gem (100%)
Successfully installed aws-sdk-shield-1.5.0
Fetching: aws-sdk-signer-1.2.0.gem (100%)
Successfully installed aws-sdk-signer-1.2.0
Fetching: aws-sdk-simpledb-1.3.0.gem (100%)
Successfully installed aws-sdk-simpledb-1.3.0
Fetching: aws-sdk-snowball-1.7.0.gem (100%)
Successfully installed aws-sdk-snowball-1.7.0
Fetching: aws-sdk-states-1.5.0.gem (100%)
Successfully installed aws-sdk-states-1.5.0
Fetching: aws-sdk-storagegateway-1.9.0.gem (100%)
Successfully installed aws-sdk-storagegateway-1.9.0
Fetching: aws-sdk-support-1.3.0.gem (100%)
Successfully installed aws-sdk-support-1.3.0
Fetching: aws-sdk-transcribeservice-1.6.0.gem (100%)
Successfully installed aws-sdk-transcribeservice-1.6.0
Fetching: aws-sdk-translate-1.4.0.gem (100%)
Successfully installed aws-sdk-translate-1.4.0
Fetching: aws-sdk-waf-1.8.0.gem (100%)
Successfully installed aws-sdk-waf-1.8.0
Fetching: aws-sdk-wafregional-1.8.0.gem (100%)
Successfully installed aws-sdk-wafregional-1.8.0
Fetching: aws-sdk-workdocs-1.4.0.gem (100%)
Successfully installed aws-sdk-workdocs-1.4.0
Fetching: aws-sdk-workmail-1.4.0.gem (100%)
Successfully installed aws-sdk-workmail-1.4.0
Fetching: aws-sdk-workspaces-1.5.0.gem (100%)
Successfully installed aws-sdk-workspaces-1.5.0
Fetching: aws-sdk-xray-1.6.0.gem (100%)
Successfully installed aws-sdk-xray-1.6.0
Fetching: aws-sdk-resources-3.25.0.gem (100%)
Successfully installed aws-sdk-resources-3.25.0
Fetching: aws-sdk-3.0.1.gem (100%)
Successfully installed aws-sdk-3.0.1
Fetching: aws-sdk-v1-1.66.0.gem (100%)
Successfully installed aws-sdk-v1-1.66.0
Fetching: erubis-2.7.0.gem (100%)
Successfully installed erubis-2.7.0
Fetching: builder-3.2.3.gem (100%)
Successfully installed builder-3.2.3
Fetching: excon-0.62.0.gem (100%)
Successfully installed excon-0.62.0
Fetching: formatador-0.2.5.gem (100%)
Successfully installed formatador-0.2.5
Fetching: fog-core-1.43.0.gem (100%)
Successfully installed fog-core-1.43.0
Fetching: multi_json-1.13.1.gem (100%)
Successfully installed multi_json-1.13.1
Fetching: fog-json-1.2.0.gem (100%)
Successfully installed fog-json-1.2.0
Fetching: fog-xml-0.1.3.gem (100%)
Successfully installed fog-xml-0.1.3
Fetching: ipaddress-0.8.3.gem (100%)
Successfully installed ipaddress-0.8.3
Fetching: fog-atmos-0.1.0.gem (100%)
Successfully installed fog-atmos-0.1.0
Fetching: fog-aws-2.0.1.gem (100%)
Successfully installed fog-aws-2.0.1
Fetching: dry-inflector-0.1.2.gem (100%)
Successfully installed dry-inflector-0.1.2
Fetching: mime-types-2.99.3.gem (100%)
Successfully installed mime-types-2.99.3
Fetching: fog-brightbox-0.16.1.gem (100%)
Successfully installed fog-brightbox-0.16.1
Fetching: fog-ecloud-0.1.1.gem (100%)
Successfully installed fog-ecloud-0.1.1
Fetching: fog-google-0.6.0.gem (100%)
Successfully installed fog-google-0.6.0
Fetching: fog-local-0.5.0.gem (100%)
Successfully installed fog-local-0.5.0
Fetching: fog-powerdns-0.2.0.gem (100%)
Successfully installed fog-powerdns-0.2.0
Fetching: fog-profitbricks-4.1.1.gem (100%)
Successfully installed fog-profitbricks-4.1.1
Fetching: fog-radosgw-0.0.5.gem (100%)
Successfully installed fog-radosgw-0.0.5
Fetching: fog-riakcs-0.1.0.gem (100%)
Successfully installed fog-riakcs-0.1.0
Fetching: fog-sakuracloud-1.7.5.gem (100%)
Successfully installed fog-sakuracloud-1.7.5
Fetching: fog-serverlove-0.1.2.gem (100%)
Successfully installed fog-serverlove-0.1.2
Fetching: fog-softlayer-1.1.4.gem (100%)
Successfully installed fog-softlayer-1.1.4
Fetching: fog-storm_on_demand-0.1.1.gem (100%)
Successfully installed fog-storm_on_demand-0.1.1
Fetching: fog-terremark-0.1.0.gem (100%)
Successfully installed fog-terremark-0.1.0
Fetching: CFPropertyList-2.3.6.gem (100%)
Successfully installed CFPropertyList-2.3.6
Fetching: fission-0.5.0.gem (100%)
Successfully installed fission-0.5.0
Fetching: fog-vmfusion-0.1.0.gem (100%)
Successfully installed fog-vmfusion-0.1.0
Fetching: fog-voxel-0.1.0.gem (100%)
Successfully installed fog-voxel-0.1.0
Fetching: fog-1.32.0.gem (100%)
Successfully installed fog-1.32.0
Fetching: unf-0.1.4.gem (100%)
Successfully installed unf-0.1.4
Fetching: domain_name-0.5.20180417.gem (100%)
Successfully installed domain_name-0.5.20180417
Fetching: http-cookie-1.0.3.gem (100%)
Successfully installed http-cookie-1.0.3
Fetching: netrc-0.11.0.gem (100%)
Successfully installed netrc-0.11.0
Fetching: rest-client-1.8.0.gem (100%)
Successfully installed rest-client-1.8.0
Fetching: right_http_connection-1.5.0.gem (100%)
Successfully installed right_http_connection-1.5.0
Fetching: right_aws-3.1.0.gem (100%)
Successfully installed right_aws-3.1.0
Fetching: sensu-plugins-aws-12.1.0.gem (100%)
You can use the embedded Ruby by setting EMBEDDED_RUBY=true in /etc/default/sensu
Successfully installed sensu-plugins-aws-12.1.0
193 gems installed
[SENSU-INSTALL] successfully installed Sensu plugins: ["sensu-plugins-aws"]
[root@88c43b3d21a8 /]# date
Fri Sep 7 17:42:56 UTC 2018
[root@88c43b3d21a8 /]#
What kind of resources does your CI system have? On my laptop It takes a little more than a minute even with compilation: https://gist.github.com/majormoses/871cd3dbad9639b66813d5427b4d00a0
My laptop has 16GB of RAM and a Intel(R) Core(TM) i7-7600U CPU @ 2.80GHz I can run some tests with more limited resources if I know the profile.
I attempted to replicate again restricting the docker container to a single CPU and 512m of RAM and saw about the same time.
During the CI build is there any indicator which resources are potentially a bottleneck? I would check:
-
CPU -
Memory -
Disk IO -
Network IO
It seems there's a problem with the latest versions of the aws-sdk gem and Rubygems, that makes installing the Sensu plugin verrrryyyy slow also for me.
Hmm I will have to look into it more this weekend and try to reproduce this.
Installing on t3.mediums in AWS took ~15 mins on average. Tested on 3 different Centos 7 instances
Interesting I will try it on an aws instance some time next week at work to see if its different but again locally I can not reproduce any install failures or installs that take more than 2 minutes, I tested this in and outside of docker. I read through the upstream issues and rubygems has no intention of solving it at this time and the aws gem maintainers suggest something that is not exactly trivial or convenient for this use case. The recommendation is to only require the components you need rather than aws-sdk which includes everything. Trying to figure out what each script needs will be a non trivial task and will likely result in several broken builds (bug reports) but that is the only suggestion that seems to make sense and could have an impact. If someone would like to start working on that and can show a meaningful improvement I am open to a change.
@robert-put in the case of aws t[1-3].* instances they have in my experience suffered from poor performance due to lack of CPU credits and noisy neighbors, can you replicate on say an m[4-5].* instance? I am trying to understand if there is some kind of threshold where under a certain amount of cpu, ram, network, etc surface the issue or at least more clearly.
Was finally able to reproduce it in vagrant: https://gist.github.com/majormoses/871cd3dbad9639b66813d5427b4d00a0#file-timed-logs-install-aws-plugin-vagrant-txt using 1 GB and 1 core, I will try to see if above some threshold it becomes a quick install as I see locally on my machine. Apologies in advance as I will be traveling for work this week and may not respond in a timely manner.
I doubt it will make it much better but we did finally remove the aws-sdk-v1 gem from our dependencies. Use version 16.0.0 to test.
Is there any update on this? Installation is still very slow using latest version. Thanks for assisting.
I have so far only been able to replicate this on servers with very few resources and I only install this plugin on a handful of servers so I have not had a personal need to work on this. Essentially what we need to do is rather than pull in all of aws-sdk we need to pull in specific portions of it to reduce the number of dependencies during install. This will be something that will need a lot of help testing as it has a very high risk of accidentally leaving something out. We do have some test coverage but I am not confident that we have enough to where we can rely solely on automated testing. If someone wants to start taking a crack at it I am all for it I just don't have the bandwidth myself to undertake this.
Similar to the compiling of nokogiri and unf_ext, is there anything that can be done to speed up the aws-sdk? We’ve seen instances like t2.medium do puppet installs of sensu and plugins including this one and from time to time get OOM errors.
Building native extensions. This could take a while... ERROR: Error installing sensu-plugins-aws: ERROR: Failed to build gem native extension.
current directory: /opt/sensu/embedded/lib/ruby/gems/2.4.0/gems/nokogiri-1.8.5/ext/nokogiri /opt/sensu/embedded/bin/ruby -r ./siteconf20181119-26141-tabkmz.rb extconf.rb Cannot allocate memory - /opt/sensu/embedded/bin/ruby -r ./siteconf20181119-26141-tabkmz.rb extconf.rb 2>&1 On Wed, Nov 21, 2018 at 1:20 AM Ben Abrams [email protected] wrote:
I have so far only been able to replicate this on servers with very few resources and I only install this plugin on a handful of servers so I have not had a personal need to work on this. Essentially what we need to do is rather than pull in all of aws-sdk we need to pull in specific portions of it to reduce the number of dependencies during install. This will be something that will need a lot of help testing as it has a very high risk of accidentally leaving something out. We do have some test coverage but I am not confident that we have enough to where we can rely solely on automated testing. If someone wants to start taking a crack at it I am all for it I just don't have the bandwidth myself to undertake this.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/sensu-plugins/sensu-plugins-aws/issues/293#issuecomment-440548751, or mute the thread https://github.com/notifications/unsubscribe-auth/AAr84V5h3OFKKFyM15twbzOc01U80HMiks5uxPCwgaJpZM4WfOZ_ .
The problem I think is less with compiling and more an issue of dependency explosion by simply including aws-sdk it pulls in every official aws-sdk-* gem. The solution like I stated here is to identify which gems we need and only install those gems. It will take effort and I am happy to review and provide guidance but as I previously stated I do not have a need as this can be mitigated by using instances with more resources. At my current org (as well as my last one) we never used t family instances because they end costing more in engineering support than simply using an m class instance.
Also seeing this issue today on a slow machine 1 core (Intel(R) Xeon(R) CPU E5-2676 v3 @ 2.40GHz ) and 2GB RAM.
Is there a fix or workaround for this? I will attempt to only install the needed gems. Do you have an example on how to install just the aws rds sensu plugin checks?
@zeninfinity if you can pull the code from https://github.com/sensu-plugins/sensu-plugins-aws/pull/342 and run gem build sensu-plugins-aws.gemspec and then /opt/sensu/embedded/bin/gem install PATH_TO_LOCAL_GEM_FILE and report back if there is any improvement performance wise. If it seems like it helps the next step is to test each check, metric, and handler scripts to make sure we did not miss anything (which would break existing setups). If all goes well with all the testing I would love to accept the contribution and push out a "fix" as I know its a real pain point out there for people.
Ok, so I get the following input:
`# /opt/sensu/embedded/bin/gem install ./sensu-plugins-aws-18.0.0.gem Fetching: right_http_connection-1.5.0.gem (100%) GemWrappers: Can not wrap missing file: c_rehash GemWrappers: Can not wrap missing file: makedepend GemWrappers: Can not wrap missing file: check-banner.rb GemWrappers: Can not wrap missing file: rake-compiler GemWrappers: Can not wrap missing file: sensu-translator GemWrappers: Can not wrap missing file: check-uptime.rb GemWrappers: Can not wrap missing file: metrics-uptime.rb GemWrappers: Can not wrap missing file: aws.rb GemWrappers: Can not wrap missing file: check-head-redirect.rb GemWrappers: Can not wrap missing file: metrics-http-json.rb GemWrappers: Can not wrap missing file: check-last-modified.rb GemWrappers: Can not wrap missing file: check-http.rb GemWrappers: Can not wrap missing file: metrics-curl.rb GemWrappers: Can not wrap missing file: check-http-cors.rb GemWrappers: Can not wrap missing file: metrics-http-json-deep.rb GemWrappers: Can not wrap missing file: check-https-cert.rb GemWrappers: Can not wrap missing file: check-http-json.rb GemWrappers: Can not wrap missing file: check-checksums.rb GemWrappers: Can not wrap missing file: check-dir-count.rb GemWrappers: Can not wrap missing file: check-dir-size.rb GemWrappers: Can not wrap missing file: check-file-exists.rb GemWrappers: Can not wrap missing file: check-file-size.rb GemWrappers: Can not wrap missing file: check-fs-writable.rb GemWrappers: Can not wrap missing file: check-mtime.rb GemWrappers: Can not wrap missing file: check-tail.rb GemWrappers: Can not wrap missing file: metrics-dirsize.rb GemWrappers: Can not wrap missing file: metrics-filesize.rb GemWrappers: Can not wrap missing file: metrics-nfsstat.rb GemWrappers: Can not wrap missing file: dnsbl-client GemWrappers: Can not wrap missing file: whoisrb GemWrappers: Can not wrap missing file: check-jsonwhois-domain-expiration.rb GemWrappers: Can not wrap missing file: check-mtu.rb GemWrappers: Can not wrap missing file: check-multicast-groups.rb GemWrappers: Can not wrap missing file: check-netfilter-conntrack.rb GemWrappers: Can not wrap missing file: check-netstat-tcp.rb GemWrappers: Can not wrap missing file: check-ping.rb GemWrappers: Can not wrap missing file: check-ports-bind.rb GemWrappers: Can not wrap missing file: check-ports-nmap.rb GemWrappers: Can not wrap missing file: check-ports.rb GemWrappers: Can not wrap missing file: check-rbl.rb GemWrappers: Can not wrap missing file: check-socat.rb GemWrappers: Can not wrap missing file: check-whois-domain-expiration-multi.rb GemWrappers: Can not wrap missing file: check-whois-domain-expiration.rb GemWrappers: Can not wrap missing file: metrics-interface.rb GemWrappers: Can not wrap missing file: metrics-net.rb GemWrappers: Can not wrap missing file: metrics-netif.rb GemWrappers: Can not wrap missing file: metrics-netstat-tcp.rb GemWrappers: Can not wrap missing file: metrics-ping.rb GemWrappers: Can not wrap missing file: metrics-sockstat.rb Successfully installed right_http_connection-1.5.0
...
GemWrappers: Can not wrap missing file: metrics-netstat-tcp.rb GemWrappers: Can not wrap missing file: metrics-ping.rb GemWrappers: Can not wrap missing file: metrics-sockstat.rb Successfully installed sensu-plugins-aws-18.0.0 Parsing documentation for right_http_connection-1.5.0 Installing ri documentation for right_http_connection-1.5.0 Parsing documentation for right_aws-3.1.0 Installing ri documentation for right_aws-3.1.0 Parsing documentation for formatador-0.2.5 Installing ri documentation for formatador-0.2.5 Parsing documentation for excon-0.64.0 Installing ri documentation for excon-0.64.0 Parsing documentation for fog-core-1.43.0 Installing ri documentation for fog-core-1.43.0 Parsing documentation for multi_json-1.13.1 Installing ri documentation for multi_json-1.13.1 Parsing documentation for fog-json-1.2.0 Installing ri documentation for fog-json-1.2.0 Parsing documentation for nokogiri-1.10.3 Installing ri documentation for nokogiri-1.10.3 Parsing documentation for fog-xml-0.1.3 Installing ri documentation for fog-xml-0.1.3 Parsing documentation for fog-atmos-0.1.0 Installing ri documentation for fog-atmos-0.1.0 Parsing documentation for fog-aws-2.0.1 Installing ri documentation for fog-aws-2.0.1 Parsing documentation for dry-inflector-0.1.2 Installing ri documentation for dry-inflector-0.1.2 Parsing documentation for fog-brightbox-0.16.1 Installing ri documentation for fog-brightbox-0.16.1 Parsing documentation for fog-ecloud-0.1.1 Installing ri documentation for fog-ecloud-0.1.1 Parsing documentation for fog-google-0.6.0 Installing ri documentation for fog-google-0.6.0 Parsing documentation for fog-local-0.6.0 Installing ri documentation for fog-local-0.6.0 Parsing documentation for fog-powerdns-0.2.0 Installing ri documentation for fog-powerdns-0.2.0 Parsing documentation for fog-profitbricks-4.1.1 Installing ri documentation for fog-profitbricks-4.1.1 Parsing documentation for fog-radosgw-0.0.5 Installing ri documentation for fog-radosgw-0.0.5 Parsing documentation for fog-riakcs-0.1.0 Installing ri documentation for fog-riakcs-0.1.0 Parsing documentation for fog-sakuracloud-1.7.5 Installing ri documentation for fog-sakuracloud-1.7.5 Parsing documentation for fog-serverlove-0.1.2 Installing ri documentation for fog-serverlove-0.1.2 Parsing documentation for fog-softlayer-1.1.4 Installing ri documentation for fog-softlayer-1.1.4 Parsing documentation for fog-storm_on_demand-0.1.1 Installing ri documentation for fog-storm_on_demand-0.1.1 Parsing documentation for fog-terremark-0.1.0 Installing ri documentation for fog-terremark-0.1.0 Parsing documentation for CFPropertyList-2.3.6 Installing ri documentation for CFPropertyList-2.3.6 Parsing documentation for fission-0.5.0 Installing ri documentation for fission-0.5.0 Parsing documentation for fog-vmfusion-0.1.0 Installing ri documentation for fog-vmfusion-0.1.0 Parsing documentation for fog-voxel-0.1.0 Installing ri documentation for fog-voxel-0.1.0 Parsing documentation for fog-1.32.0 Installing ri documentation for fog-1.32.0 Parsing documentation for sensu-plugins-aws-18.0.0 Installing ri documentation for sensu-plugins-aws-18.0.0 Done installing documentation for right_http_connection, right_aws, formatador, excon, fog-core, multi_json, fog-json, nokogiri, fog-xml, fog-atmos, fog-aws, dry-inflector, fog-brightbox, fog-ecloud, fog-google, fog-local, fog-powerdns, fog-profitbricks, fog-radosgw, fog-riakcs, fog-sakuracloud, fog-serverlove, fog-softlayer, fog-storm_on_demand, fog-terremark, CFPropertyList, fission, fog-vmfusion, fog-voxel, fog, sensu-plugins-aws after 122 seconds 31 gems installed #`
Hmm I will take a closer look when I have some time. Does it actually fail or are those just warnings?
Was A LOT quicker...like 3 minutes vs. hanging for more than 25 minutes. Though still not 100% sure what to do next.
@majormoses - Just warnings. Seems to have installed the gems.
Was A LOT quicker...like 3 minutes vs. hanging for more than 25 minutes.
excellent
Though still not 100% sure what to do next.
Do you use any of the existing resources/checks? If so just try running your checks as you would and report back if any of them start breaking. If not you can start defining some checks and report back which ones you tested and their status.
Just warnings. Seems to have installed the gems.
cool, we can look into the warnings, want to focus on verification of existing functionality and unblocking people, we can then work through the warnings.
Actually I was really trying to run /opt/sensu/embedded/bin/gem install sensu-plugins-aws or sensu-install -p aws and thought I would get the binaries in /opt/sensu/embedded/bin (like check-rds.rb) but they are not there.
# ls /opt/sensu/embedded/bin/*rds* ls: cannot access /opt/sensu/embedded/bin/*rds*: No such file or directory #
Actually I was really trying to run
/opt/sensu/embedded/bin/gem install sensu-plugins-awsorsensu-install -p awsand thought I would get the binaries in /opt/sensu/embedded/bin (like check-rds.rb) but they are not there.
gotcha ya those wrapped things are not warnings then. I will take a closer look when I have the time. Can you please comment to this on the PR so the author of the PR knows that what is currently proposed does not work.
gotcha ya those wrapped things are not warnings then. I will take a closer look when I have the time. Can you please comment to this on the PR so the author of the PR knows that what is currently proposed does not work.
Yep, can do.
its gonna be more like check-rds.rb
# ls /opt/sensu/embedded/bin/*rds* ls: cannot access /opt/sensu/embedded/bin/*rds*: No such file or directory #
its gonna be more like check-rds.rb the scripts should be prefixed with (check|metric|handler)-
Yep. Nothing in the /opt/sensu/embedded/bin directory with rds in the name.
So is there a version of sensu-plugins-aws that is a working version?
[root@thatoneserver bin]# ls *rds*
ls: cannot access *rds*: No such file or directory
[root@thatoneserver bin]# /opt/sensu/embedded/bin/gem list | grep sensu-plugins-aws
sensu-plugins-aws (18.0.0)
[root@thatoneserver bin]# ls /opt/sensu/embedded/bin/check-rds.rb
ls: cannot access /opt/sensu/embedded/bin/check-rds.rb: No such file or directory
[root@thatoneserver bin]#
Ok...just an FYI so people don't get down the wrong rabbit hole. It looks like it is installing these in my rvm ruby location. Pre-installation I get:
[root@thatoneserver embedded]# find / | grep check-rds.rb
/root/sensu-plugins-aws/bin/check-rds.rb
[root@thatoneserver embedded]#
which is the repo I pulled down. Post installation I get:
[root@thatoneserver embedded]# find / | grep check-rds.rb
find: ‘/proc/24438’: No such file or directory
/usr/local/rvm/gems/ruby-2.1.10/bin/check-rds.rb
/usr/local/rvm/gems/ruby-2.1.10/wrappers/check-rds.rb
/usr/local/rvm/gems/ruby-2.1.10/gems/sensu-plugins-aws-18.0.0/bin/check-rds.rb
/root/sensu-plugins-aws/bin/check-rds.rb
[root@thatoneserver embedded]#
So my ruby isn't setup to install them in /opt/sensu/embedded/bin/ ... though 109 checks/metrics are in that location.
So is there a version of sensu-plugins-aws that is a working version?
[root@thatoneserver bin]# ls *rds* ls: cannot access *rds*: No such file or directory [root@thatoneserver bin]# /opt/sensu/embedded/bin/gem list | grep sensu-plugins-aws sensu-plugins-aws (18.0.0) [root@thatoneserver bin]# ls /opt/sensu/embedded/bin/check-rds.rb ls: cannot access /opt/sensu/embedded/bin/check-rds.rb: No such file or directory [root@thatoneserver bin]#
The latest released version should be working but it does require some non trivial resources to install at the moment in a timely manner.
Ok, that makes sense. When I put /usr/local/rvm/gems/ruby-2.1.10/bin/metrics-rds.rb in a sensu check (which runs fine as the sensu and root user) I get the following error:
/opt/sensu/embedded/lib/ruby/site_ruby/2.4.0/rubygems.rb:270:in `find_spec_for_exe': can't find gem sensu-plugins-aws (>= 0.a) (Gem::GemNotFoundException)\n\tfrom /opt/sensu/embedded/lib/ruby/site_ruby/2.4.0/rubygems.rb:298:in `activate_bin_path'\n\tfrom /usr/local/rvm/gems/ruby-2.1.10/bin/metrics-rds.rb:22:in `<main>'\n\tfrom /usr/local/rvm/gems/ruby-2.1.10/bin/ruby_executable_hooks:24:in `eval'\n\tfrom /usr/local/rvm/gems/ruby-2.1.10/bin/ruby_executable_hooks:24:in `<main>'\n
I'm battling an rvm vs embedded ruby issue. /etc/default/sensu is:
EMBEDDED_RUBY=true
PATH=/opt/sensu/embedded/bin:/usr/local/rvm/gems/ruby-2.1.10/bin:/usr/local/rvm/gems/ruby-2.1.10@global/bin:/usr/local/rvm/rubies/ruby-2.1.10/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/local/rvm/bin
Is there another way I can install this to have sensu be able to run this metrics-rds.rb?
Digging deeper I was able to install sensu-plugins-aws via GEM_PATH=/opt/sensu/embedded/lib/ruby/gems/2.4.0/ /opt/sensu/embedded/bin/gem install sensu-plugins-aws but now getting the error:
/opt/sensu/embedded/lib/ruby/site_ruby/2.4.0/rubygems/core_ext/kernel_require.rb:55:in `require': cannot load such file -- sensu-plugins-aws (LoadError)\n\tfrom /opt/sensu/embedded/lib/ruby/site_ruby/2.4.0/rubygems/core_ext/kernel_require.rb:55:in `require'\n\tfrom /usr/local/rvm/gems/ruby-2.1.10/gems/sensu-plugins-aws-18.2.0/bin/metrics-rds.rb:30:in `<main>'\n