We're seeing this when we start Priam on an EC2 instance; S3 bucket create is fine and SimpleDB table creation is happening too. For the purposes of testing getting Priam working the Cassandra instance we're trying to manage is on the same machine as Priam.
Is there an expectation that we have to create some data into the SimpleDB before running Priam? It's not clea from the docs whether I am to expect Priam to discover all the nodes and data it will be using, or if we are supposed to seed something.
pr 21, 2012 12:02:34 AM org.apache.catalina.startup.TaglibUriRule body
INFO: TLD skipped. URI: urn:com:sun:jersey:api:view is already defined
log4j: Parsing for [root] with value=[INFO, R, stdout].
log4j: Level token is [INFO].
log4j: Category root set to INFO
log4j: Parsing appender named "R".
log4j: Parsing layout options for "R".
log4j: Setting property [conversionPattern] to [%d{yyyy-MM-dd HH:mm:ss.SSSS} %p %t %c %m%n].
log4j: End of parsing for "R".
log4j: Setting property [file] to [/usr/share/tomcat7/logs/tomcat.log].
log4j: Setting property [maxFileSize] to [5MB].
log4j: Setting property [maxBackupIndex] to [5].
log4j: setFile called: /usr/share/tomcat7/logs/tomcat.log, true
log4j: setFile ended
log4j: Parsed "R" options.
log4j: Parsing appender named "stdout".
log4j: Parsing layout options for "stdout".
log4j: Setting property [conversionPattern] to [%5p %d{HH:mm:ss,SSS} %m%n].
log4j: End of parsing for "stdout".
log4j: Parsed "stdout" options.
log4j: Finished configuring.
INFO 00:02:35,046 Calling URL API: http://169.254.169.254/latest/meta-data/placement/availability-zone returns: us-west-2b
INFO 00:02:35,051 Calling URL API: http://169.254.169.254/latest/meta-data/hostname returns: ip-10-10-3-101
INFO 00:02:35,060 Calling URL API: http://169.254.169.254/latest/meta-data/local-ipv4 returns: 10.10.3.101
INFO 00:02:35,061 Calling URL API: http://169.254.169.254/latest/meta-data/instance-id returns: i-4aaa937a
INFO 00:02:35,062 Calling URL API: http://169.254.169.254/latest/meta-data/instance-type returns: m1.large
INFO 00:02:35,573 REGION set to us-west-2, ASG Name (nnnnn-uswest2)
INFO 00:02:36,551 Job execution threads will use class loader of thread: http-bio-8080-exec-66
INFO 00:02:36,568 Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
INFO 00:02:36,569 Quartz Scheduler v.1.7.3 created.
INFO 00:02:36,571 RAMJobStore initialized.
INFO 00:02:36,572 Quartz scheduler 'DefaultQuartzScheduler' initialized from default resource file in Quartz package: 'quartz.properties'
INFO 00:02:36,572 Quartz scheduler version: 1.7.3
INFO 00:02:36,572 JobFactory set to: com.netflix.priam.scheduler.GuiceJobFactory@7e49a1c5
INFO 00:02:36,712 New update(s) found: 1.8.5 [http://www.terracotta.org/kit/reflector?kitID=default&pageID=QuartzChangeLog]
INFO 00:02:38,279 Querying Amazon returned following instance in the ASG: us-west-2b -->
INFO 00:03:02,438 Query on ASG returning 0 instances
ERROR 00:03:02,438 Retry #1 for: size must be > 0
INFO 00:03:13,295 Query on ASG returning 0 instances
ERROR 00:03:13,296 Retry #2 for: size must be > 0
INFO 00:03:29,377 Query on ASG returning 0 instances
ERROR 00:03:29,378 Retry #3 for: size must be > 0
INFO 00:03:42,704 Query on ASG returning 0 instances
ERROR 00:03:42,705 Retry #4 for: size must be > 0
INFO 00:03:47,227 Query on ASG returning 0 instances
ERROR 00:03:47,227 Retry #5 for: size must be > 0
INFO 00:03:51,786 Query on ASG returning 0 instances
ERROR 00:03:51,787 Retry #6 for: size must be > 0
INFO 00:04:06,667 Query on ASG returning 0 instances
ERROR 00:04:06,668 Retry #7 for: size must be > 0
INFO 00:04:19,150 Query on ASG returning 0 instances
ERROR 00:04:19,151 Retry #8 for: size must be > 0
INFO 00:04:34,354 Query on ASG returning 0 instances
ERROR 00:04:34,355 Retry #9 for: size must be > 0
INFO 00:04:37,139 Query on ASG returning 0 instances
ERROR 00:04:37,140 Retry #10 for: size must be > 0
INFO 00:04:40,728 Query on ASG returning 0 instances
ERROR 00:04:40,728 Retry #11 for: size must be > 0
INFO 00:04:48,434 Query on ASG returning 0 instances
ERROR 00:04:48,435 Retry #12 for: size must be > 0
INFO 00:05:04,548 Query on ASG returning 0 instances
ERROR 00:05:04,549 Retry #13 for: size must be > 0
INFO 00:05:13,591 Query on ASG returning 0 instances
ERROR 00:05:13,591 Retry #14 for: size must be > 0
INFO 00:05:22,577 Query on ASG returning 0 instances
ERROR 00:05:23,117 Guice provision errors:
- Error injecting constructor, java.lang.IllegalArgumentException: size must be > 0
at com.netflix.priam.identity.InstanceIdentity.(InstanceIdentity.java:46)
at com.netflix.priam.identity.InstanceIdentity.class(InstanceIdentity.java:25)
while locating com.netflix.priam.identity.InstanceIdentity
for parameter 2 at com.netflix.priam.PriamServer.(PriamServer.java:31)
at com.netflix.priam.PriamServer.class(PriamServer.java:31)
while locating com.netflix.priam.PriamServer
1 error
com.google.inject.ProvisionException: Guice provision errors:
- Error injecting constructor, java.lang.IllegalArgumentException: size must be > 0
at com.netflix.priam.identity.InstanceIdentity.(InstanceIdentity.java:46)
at com.netflix.priam.identity.InstanceIdentity.class(InstanceIdentity.java:25)
while locating com.netflix.priam.identity.InstanceIdentity
for parameter 2 at com.netflix.priam.PriamServer.(PriamServer.java:31)
at com.netflix.priam.PriamServer.class(PriamServer.java:31)
while locating com.netflix.priam.PriamServer
1 error
at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:987)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1013)
at com.netflix.priam.defaultimpl.InjectedWebListener.getInjector(InjectedWebListener.java:36)
at com.google.inject.servlet.GuiceServletContextListener.contextInitialized(GuiceServletContextListener.java:45)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4779)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5273)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
at org.apache.catalina.manager.ManagerServlet.start(ManagerServlet.java:1247)
at org.apache.catalina.manager.HTMLManagerServlet.start(HTMLManagerServlet.java:747)
at org.apache.catalina.manager.HTMLManagerServlet.doPost(HTMLManagerServlet.java:222)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:641)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.filters.CsrfPreventionFilter.doFilter(CsrfPreventionFilter.java:187)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:108)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:581)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.lang.IllegalArgumentException: size must be > 0
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
at com.netflix.priam.utils.TokenManager.initialToken(TokenManager.java:26)
at com.netflix.priam.utils.TokenManager.createToken(TokenManager.java:53)
at com.netflix.priam.identity.InstanceIdentity$GetNewToken.retriableCall(InstanceIdentity.java:158)
at com.netflix.priam.identity.InstanceIdentity$GetNewToken.retriableCall(InstanceIdentity.java:137)
at com.netflix.priam.utils.RetryableCallable.call(RetryableCallable.java:42)
at com.netflix.priam.identity.InstanceIdentity.init(InstanceIdentity.java:91)
at com.netflix.priam.identity.InstanceIdentity.(InstanceIdentity.java:51)
at com.netflix.priam.identity.InstanceIdentity$$FastClassByGuice$$8fae8df.newInstance()
at com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
at com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:60)
at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)
at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031)
at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
at com.google.inject.Scopes$1$1.get(Scopes.java:65)
at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:40)
at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:84)
at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)
at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031)
at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
at com.google.inject.Scopes$1$1.get(Scopes.java:65)
at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:40)
at com.google.inject.internal.InjectorImpl$4$1.call(InjectorImpl.java:978)
at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1024)
at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:974)
... 33 more
Apr 21, 2012 12:05:23 AM org.apache.catalina.core.StandardContext startInternal
SEVERE: Error listenerStart
Apr 21, 2012 12:05:23 AM org.apache.catalina.core.StandardContext startInternal
SEVERE: Context [/Priam] startup failed due to previous errors
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [com.google.inject.internal.util.$Finalizer] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_Worker-1] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_Worker-2] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_Worker-3] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_Worker-4] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_Worker-5] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_Worker-6] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_Worker-7] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_Worker-8] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_Worker-9] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_Worker-10] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [Timer-1] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/Priam] appears to have started a thread named [DefaultQuartzScheduler_QuartzSchedulerThread] but has failed to stop it. This is very likely to create a memory leak.
Apr 21, 2012 12:05:23 AM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
SEVERE: The web application [/Priam] created a ThreadLocal with key of type [com.google.inject.internal.InjectorImpl$1](value [com.google.inject.internal.InjectorImpl$1@313c7b52]) and a value of type [java.lang.Object[]](value [[Ljava.lang.Object;@79c45dbe]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.