magpie icon indicating copy to clipboard operation
magpie copied to clipboard

Difficulties running magpie

Open ErnestoDPS opened this issue 10 months ago • 0 comments

I went through the readme file but I guess I am missing something.

  1. Build successfully magpie
  2. Unzip magpie-cli build magpie-0.10.3-SNAPSHOT.zip
  3. I created permanent access keys of a read-only account. Therefore, I guess I do not need to provide to my .aws/credentials file the line for aws_session_token
  4. Modified my config.yaml and provided the regions for AWS
  5. Run ./magpie-discovery (using a mac) and I got this result:

What am I doing wrong or missing?

09:44:21,885 |-INFO in ch.qos.logback.classic.LoggerContext[default] - This is logback-classic version ?
09:44:21,886 |-INFO in ch.qos.logback.classic.util.ContextInitializer@55b0dcab - No custom configurators were discovered as a service.
09:44:21,886 |-INFO in ch.qos.logback.classic.util.ContextInitializer@55b0dcab - Trying to configure with ch.qos.logback.classic.joran.SerializedModelConfigurator
09:44:21,887 |-INFO in ch.qos.logback.classic.util.ContextInitializer@55b0dcab - Constructed configurator of type class ch.qos.logback.classic.joran.SerializedModelConfigurator
09:44:21,890 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.scmo]
09:44:21,891 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.scmo]
09:44:21,899 |-INFO in ch.qos.logback.classic.util.ContextInitializer@55b0dcab - ch.qos.logback.classic.joran.SerializedModelConfigurator.configure() call lasted 4 milliseconds. ExecutionStatus=INVOKE_NEXT_IF_ANY
09:44:21,899 |-INFO in ch.qos.logback.classic.util.ContextInitializer@55b0dcab - Trying to configure with ch.qos.logback.classic.util.DefaultJoranConfigurator
09:44:21,899 |-INFO in ch.qos.logback.classic.util.ContextInitializer@55b0dcab - Constructed configurator of type class ch.qos.logback.classic.util.DefaultJoranConfigurator
09:44:21,904 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logging.xml] at [file:/Users/edp/magpie/logging.xml]
09:44:21,961 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - Processing appender named [STDERR]
09:44:21,961 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
09:44:21,967 |-INFO in ch.qos.logback.core.model.processor.ImplicitModelHandler - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
09:44:21,985 |-WARN in ch.qos.logback.core.model.processor.AppenderModelHandler - Appender named [STDOUT] not referenced. Skipping further processing.
09:44:21,987 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [software.amazon.awssdk] to WARN
09:44:21,987 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [software.amazon.awssdk.request] to WARN
09:44:21,987 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.apache.http] to WARN
09:44:21,987 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [com.datastax] to ERROR
09:44:21,987 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [io.netty] to WARN
09:44:21,987 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.apache.kafka] to WARN
09:44:21,987 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.apache.zookeeper] to WARN
09:44:21,987 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.apache.curator] to WARN
09:44:21,987 |-INFO in ch.qos.logback.classic.model.processor.RootLoggerModelHandler - Setting level of ROOT logger to INFO
09:44:21,987 |-INFO in ch.qos.logback.core.model.processor.AppenderRefModelHandler - Attaching appender named [STDERR] to Logger[ROOT]
09:44:21,987 |-INFO in ch.qos.logback.core.model.processor.DefaultProcessor@38afe297 - End of configuration.
09:44:21,988 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2df3b89c - Registering current configuration as safe fallback point
09:44:21,988 |-INFO in ch.qos.logback.classic.util.ContextInitializer@55b0dcab - ch.qos.logback.classic.util.DefaultJoranConfigurator.configure() call lasted 89 milliseconds. ExecutionStatus=DO_NOT_INVOKE_NEXT_IF_ANY

09:44:22.119 [main] INFO  io.openraven.magpie.cli.Discovery - OSS Discovery. Classpath=magpie-cli.jar:plugins/magpie-policy-output-text-0.10.3-SNAPSHOT.jar:plugins/magpie-aws-0.10.3-SNAPSHOT.jar:plugins/magpie-policy-output-csv-0.10.3-SNAPSHOT.jar:plugins/magpie-gcp-0.10.3-SNAPSHOT.jar:plugins/magpie-azure-0.10.3-SNAPSHOT.jar:plugins/magpie-policy-output-json-0.10.3-SNAPSHOT.jar:plugins/magpie-persist-0.10.3-SNAPSHOT.jar:plugins/magpie-json-0.10.3-SNAPSHOT.jar
09:44:22.195 [main] WARN  i.o.m.p.a.d.AWSDiscoveryPlugin - Could not initialize Sentry: DSN is required. Use empty string to disable SDK.
09:44:28.093 [pool-2-thread-1] WARN  i.o.magpie.core.layers.OriginLayer - Plugin exception: magpie.aws.discovery
software.amazon.awssdk.core.exception.SdkClientException: Unable to load region from any of the providers in the chain software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@70be3b9e: [software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@2414f333: Unable to load region from system settings. Region must be specified either via environment variable (AWS_REGION) or  system property (aws.region)., software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@2f54cf00: No region provided in profile: default, software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@460c1b72: Unable to contact EC2 metadata service.]
	at software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:98)
	at software.amazon.awssdk.regions.providers.AwsRegionProviderChain.getRegion(AwsRegionProviderChain.java:70)
	at software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.regionFromDefaultProvider(AwsDefaultClientBuilder.java:217)
	at software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.resolveRegion(AwsDefaultClientBuilder.java:199)
	at software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.finalizeChildConfiguration(AwsDefaultClientBuilder.java:145)
	at software.amazon.awssdk.core.client.builder.SdkDefaultClientBuilder.syncClientConfiguration(SdkDefaultClientBuilder.java:161)
	at software.amazon.awssdk.services.sts.DefaultStsClientBuilder.buildClient(DefaultStsClientBuilder.java:27)
	at software.amazon.awssdk.services.sts.DefaultStsClientBuilder.buildClient(DefaultStsClientBuilder.java:22)
	at software.amazon.awssdk.core.client.builder.SdkDefaultClientBuilder.build(SdkDefaultClientBuilder.java:133)
	at software.amazon.awssdk.services.sts.StsClient.create(StsClient.java:79)
	at io.openraven.magpie.plugins.aws.discovery.AWSDiscoveryPlugin.discover(AWSDiscoveryPlugin.java:98)
	at io.openraven.magpie.core.layers.OriginLayer.lambda$exec$0(OriginLayer.java:68)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1541)
	at io.openraven.magpie.core.layers.OriginLayer.exec(OriginLayer.java:65)
	at io.openraven.magpie.core.Orchestrator$LayerCallable.call(Orchestrator.java:59)
	at io.openraven.magpie.core.Orchestrator$LayerCallable.call(Orchestrator.java:45)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)
[]09:44:31.217 [main] INFO  io.openraven.magpie.cli.Discovery - Discovery completed in 9.149625s

Many thanks for your support.

ErnestoDPS avatar Apr 09 '24 07:04 ErnestoDPS