Activiti configuration with AWS Elasticsearch

[vsangal]

Hello,  I have spin up a new AWS Elstcsearch service but is not able to connect it to Activiti running on EC2 instance.

This is what I have configured

# ##################
# ES General settings
# ##################
elastic-search.cluster.name=activiti-dev-es

# Must be a unique name in the elastic search cluster
elastic-search.node.name=activiti

elastic-search.default.index.name=activiti
elastic-search.tenant.index.prefix=activiti_tenant_

# Enable/disable the REST API of the embedded ES node
elastic-search.enable.http=false
elastic-search.enable.http.cors=false

# ES disovery settings using unicast
elastic-search.discovery.type=unicast
elastic-search.discovery.hosts=search-activiti-dev-es-idgdfddsfsdfdfds-us-west-2.es.amazonaws.com

# #################################
# Client setup (example)
# #################################

elastic-search.server.type=client

I got following error...

2:35:27,176 [localhost-startStop-1] INFO  com.activiti.conf.ContentStorageConfiguration  - Using file-system based content storage (/home/vishal.sangal/alfresco/process-services-1.6.2/act_data/data)
02:35:27,177 [localhost-startStop-1] INFO  com.activiti.conf.ContentStorageConfiguration  - File system root : /home/vishal.sangal/alfresco/process-services-1.6.2/act_data/data
02:35:27,245 [localhost-startStop-1] INFO  com.activiti.conf.ElasticSearchConfiguration  - Using unicast discovery for Elasticsearch
02:35:27,245 [localhost-startStop-1] INFO  com.activiti.conf.ElasticSearchConfiguration  - Hosts = search-activiti-dev-es-idgdfddsfsdfdfds.us-west-2.es.amazonaws.com
02:35:27,399 [localhost-startStop-1] INFO  org.elasticsearch.node  - [activiti-client] version[1.7.3], pid[26309], build[05d4530/2015-10-15T09:14:17Z]
02:35:27,399 [localhost-startStop-1] INFO  org.elasticsearch.node  - [activiti-client] initializing ...
02:35:27,514 [localhost-startStop-1] INFO  org.elasticsearch.plugins  - [activiti-client] loaded [cloud-aws], sites []
02:35:28,904 [localhost-startStop-1] WARN  org.elasticsearch.bootstrap  - JNA not found. native methods will be disabled.
02:35:29,543 [localhost-startStop-1] INFO  org.elasticsearch.node  - [activiti-client] initialized
02:35:29,543 [localhost-startStop-1] INFO  org.elasticsearch.node  - [activiti-client] starting ...
02:35:29,608 [localhost-startStop-1] INFO  org.elasticsearch.transport  - [activiti-client] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/10.204.17.171:9300]}
02:35:29,619 [localhost-startStop-1] INFO  org.elasticsearch.discovery  - [activiti-client] activiti-dev-es/cbO7960ITgCU6RU25--yxw
02:35:59,620 [localhost-startStop-1] WARN  org.elasticsearch.discovery  - [activiti-client] waited for 30s and no initial state was set by the discovery
02:35:59,622 [localhost-startStop-1] INFO  org.elasticsearch.node  - [activiti-client] started
02:36:00,253 [localhost-startStop-1] WARN  org.hibernate.hql.internal.ast.HqlSqlWalker  - [DEPRECATION] Encountered positional parameter near line 1, column 94.  Positional parameter are considered deprecated; use named parameters or JPA-style positional parameters instead.
02:36:00,575 [localhost-startStop-1] WARN  org.hibernate.hql.internal.ast.HqlSqlWalker  - [DEPRECATION] Encountered positional parameter near line 1, column 96.  Positional parameter are considered deprecated; use named parameters or JPA-style positional parameters instead.
02:36:00,695 [localhost-startStop-1] WARN  org.hibernate.hql.internal.ast.HqlSqlWalker  - [DEPRECATION] Encountered positional parameter near line 1, column 80.  Positional parameter are considered deprecated; use named parameters or JPA-style positional parameters instead.
02:36:01,050 [localhost-startStop-1] WARN  org.hibernate.hql.internal.ast.HqlSqlWalker  - [DEPRECATION] Encountered positional parameter near line 1, column 86.  Positional parameter are considered deprecated; use named parameters or JPA-style positional parameters instead.
02:36:01,663 [localhost-startStop-1] INFO  com.activiti.conf.TransformationConfiguration  - Found valid Aspose license. Instantiating transformation services.
02:36:02,441 [localhost-startStop-1] WARN  org.hibernate.hql.internal.ast.HqlSqlWalker  - [DEPRECATION] Encountered positional parameter near line 1, column 86.  Positional parameter are considered deprecated; use named parameters or JPA-style positional parameters instead.
02:36:02,488 [localhost-startStop-1] INFO  com.activiti.conf.ActivitiDmnEngineConfiguration  - Initializing DMN Rule Engine
02:36:02,500 [localhost-startStop-1] ERROR org.hibernate.ejb.Ejb3Configuration  - HHH000050: Container is providing a null PersistenceUnitRootUrl: discovery impossible
02:36:02,576 [localhost-startStop-1] INFO  com.activiti.dmn.engine.impl.DmnEngineImpl  - DmnEngine default created
02:36:03,772 [localhost-startStop-1] INFO  com.activiti.service.runtime.ActivitiEventProcessingService  - Event processing settings:
02:36:03,772 [localhost-startStop-1] INFO  com.activiti.service.runtime.ActivitiEventProcessingService  - event.processing.enabled : true
02:36:03,772 [localhost-startStop-1] INFO  com.activiti.service.runtime.ActivitiEventProcessingService  - event.processing.blocksize : 100
02:36:03,772 [localhost-startStop-1] INFO  com.activiti.service.runtime.ActivitiEventProcessingService  - event.processing.max.locktime : 600000
02:36:03,772 [localhost-startStop-1] INFO  com.activiti.service.runtime.ActivitiEventProcessingService  - event.processing.processed.events.action : move
02:36:03,772 [localhost-startStop-1] INFO  com.activiti.service.runtime.ActivitiEventProcessingService  - Unique processor UUID: bc7c609b-3b57-46b5-86a2-0c9fdd95c122
02:36:03,773 [localhost-startStop-1] INFO  com.activiti.service.runtime.ActivitiEventProcessingService  - Unique processor UUID for expired events: bc7c609b-3b57-46b5-86a2-0c9fdd95c122_expired
02:36:03,773 [localhost-startStop-1] INFO  com.activiti.service.runtime.ActivitiEventProcessingService  - Discovered 1 runtime event listeners.
02:36:05,202 [pool-1-thread-1] WARN  com.activiti.addon.cluster.AdminAppService  - Error posting events to Activiti Admin Application: Read timed out
02:36:33,787 [localhost-startStop-1] WARN  com.activiti.service.reporting.ReportingIndexManagerImpl  - createIndexIfNeeded() : Exception raised : class org.elasticsearch.discovery.MasterNotDiscoveredException
02:36:35,237 [pool-1-thread-1] WARN  com.activiti.addon.cluster.AdminAppService  - Error posting events to Activiti Admin Application: Read timed out
02:37:03,809 [localhost-startStop-1] WARN  org.springframework.web.context.support.AnnotationConfigWebApplicationContext  - Exception encountered during context initialization - cancelling refresh attempt
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'activitiEventProcessingService': Invocation of init method failed; nested exception is org.elasticsearch.discovery.MasterNotDiscoveredException: waited for [30s]
    at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:408)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1566)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:539)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:476)
    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:303)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:299)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:755)
    at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:757)
    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:480)
    at com.activiti.servlet.WebConfigurer.contextInitialized(WebConfigurer.java:98)
    at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4842)
    at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5303)
    at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
    at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:725)
    at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:701)
    at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:717)
    at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:940)
    at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1816)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: org.elasticsearch.discovery.MasterNotDiscoveredException: waited for [30s]
    at org.elasticsearch.action.support.master.TransportMasterNodeOperationAction$4.onTimeout(TransportMasterNodeOperationAction.java:164)
    at org.elasticsearch.cluster.ClusterStateObserver$ObserverClusterStateListener.onTimeout(ClusterStateObserver.java:231)
    at org.elasticsearch.cluster.service.InternalClusterService$NotifyTimeout.run(InternalClusterService.java:560)
    ... 3 more
02:37:03,853 [localhost-startStop-1] INFO  org.elasticsearch.node  - [activiti-client] stopping ...
02:37:05,268 [pool-1-thread-1] WARN  com.activiti.addon.cluster.AdminAppService  - Error posting events to Activiti Admin Application: Read timed out
02:37:29,868 [elasticsearch[activiti-client][[unicast_connect]][T#5]] WARN  org.elasticsearch.discovery.zen.ping.unicast  - [activiti-client] [2] failed send ping to [#zen_unicast_1#][activity-dev-prototype][inet[search-activiti-dev-es-ituegb2mk5lxtdzz3gybv5r7rq.us-west-2.es.amazonaws.com/52.43.59.85:9300]]
org.elasticsearch.ElasticsearchIllegalStateException: can't add nodes to a stopped transport
    at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:746)
    at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:726)
    at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:220)
    at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:373)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
02:37:29,869 [elasticsearch[activiti-client][[unicast_connect]][T#8]] WARN  org.elasticsearch.discovery.zen.ping.unicast  - [activiti-client] [3] failed send ping to [#zen_unicast_1#][activity-dev-prototype][inet[search-activiti-dev-es-ituegb2mk5lxtdzz3gybv5r7rq.us-west-2.es.amazonaws.com/52.43.59.85:9300]]
org.elasticsearch.ElasticsearchIllegalStateException: can't add nodes to a stopped transport
    at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:746)
    at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:726)
    at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:220)
    at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:373)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

[chakri408]

Apparently AWS elstisearch do not support native transport protocol (only support HTTP). Looks like Alfresco activiti do not support http protocol.
Acitviti team correct me if you have any workaround?

[vsangal]

Activiti does not support AWS Elasticsearch as a service. They are working on enabling this functionality