vizrt/ece-scripts

This fork is obsolete, the current one is at: https://github.com/escenic/ece-scripts

ece-scripts's Issues

ece-install :: add munin graphs for active TCP connections on different ports

ece-install installs software that listens on specific ports. When installing the munin node, it should add munin graphs for different TCP ports that it feels "are important"

I would say that the following ports should be monitoried:

• 80 — public facing HTTP ports
• 443 — public facing SSL port (
• 8080 — internal HTTP port
• 8081 — internal HTTP port
• 3306 — database traffic

of course, only if the service is being listened to...

The code to do this is as simple as

ln -s /usr/share/munin/plugins/port_ /etc/mu

ece-install - feature request - i'd like to avoid deploying a conf package post install an have ece-install do it for me

Currently ece-install supports .ear files in fai mode, but not conf packages. For that I have to use ece-deploy or dpkg.

A welcome addition to ece-install would be the option of specifying a fai_presentation_conf package in addition to fai_presentation_ear.

An option to decide on how to handle conflicts would also be helpful. In other words if the dpkg step of the .deb package deploy should fail have ece-install fail on a conflict or simply keep th

build warns: /usr/bin/ece-build: line 668: [: too many arguments

It seems to be a linebreak caused by the latest change.

ece-deploy - in a newvly and automatically install environment ece-deploy will fails on permissions

In a newly installed (fai) environment ece-deploy will fails on the error below unless a restart is first performed with the 'ece' script where the permissions are corrected:

[ece-deploy-0] Started @ Mon Jan 14 12:39:22 UTC 2013
[ece-deploy-0] This deployment has ID ip-10-58-107-107-1358167162 and is
[ece-deploy-0] logging to /var/log/escenic/ece-deploy.log
[ece-deploy-0] Remembering the deployment states for all instances ...
[ece#engine-engine1] /var/run/escenic/engine1.pid: /var/run/escenic isn't
[ece#engine-engine1] writable for user escenic

ece-install - trail_virtual_host_ gets added with <pubName>,<warName>.war in the variable name which makes it un-sourceable

The addition of trail_virtual_host_ to the ece-install.trail uses the wrong value when adding the publication name. This results in a .trail file with trail_virtual_host_,.war=:

As a result this line in the .trail cannot be sourced and fails on a:

root@:/# source /var/lib/ece-install/1359104110-ece-install.trail
trail_virtual_host_mypub,mypub.war=local.mypub.com:8080: command not found

Warning when installing escenic-munin-plugins on a fresh system

dpkg-statoverride: warning: --update given but /var/lib/munin does not exist

Help regarding editorial server and solr, indexer-webapp

Hi,
We have installed an editorial instance by putting fai_editor_install=1 in ece_install.conf.
The instance is fine and we have checked all status in escenic-admin which is fine.

But we have some issue with solr searching and indexing.

Can you please answer the following questions?

1. We are not seeing indexer-webapp in tomcat webapps folder.
2. The solr is also not working
3. Whenever we deploy by using ece -i editor1 deploy the publication created by us is not automatically copied at tomcat webapps folder. But when we copy manually copy this at
   webapps folder it is fine.

May be we missed some configuration issues. Not sure how to fix it?

Thanks,
Sorowar

Allow a shared_resource_dir in an ece-import archive

crons and tranformations might need to have ro access to files. No executables allowed.

ece-install - analysis-engine profile install on the same tomcat as search profile is missing jndi settings for search

When installing both the search profile and the analysis engine profile on the same tomcat the ece install fails to setup the jndi settings in context.xml for the solr. It is possibly skipped or overwritten.

Here's an example file used when this conflict occurred:

 technet_user=xxx
 technet_password=xxx

 technet_download_list="
   http://technet.escenic.com/downloads/assemblytool-2.0.2.zip
   http://technet.escenic.com/downloads/release/54/engine-5.4.1.126472.zip
 " 

 wf_download_list=""

 fai_enabled=1

 fai_search_install=1
 fai_search_port=8081
 fai_search_shutdown=8105
 fai_search_name=search1
 fai_search_indexer_ws_uri=http://localhost:8080/indexer-webservice/index/
 fai_search_ear=http://some.ear
 fai_search_for_editor=0
 fai_search_host=localhost

 fai_analysis_install=1
 fai_analysis_db_install=1
 fai_analysis_db_schema=analysisdb

 fai_monitoring_install=1
 fai_monitoring_host_list=localhost

 fai_db_install=0

 fai_restore_from_backup=1
 fai_restore_db=1
 fai_restore_data_files=1
 fai_restore_from_file=/backup.tar

 fai_cache_install=1

 fai_builder_http_user=xxx
 fai_builder_http_password=xxx
 fai_presentation_install=1
 fai_presentation_ear=http://some.ear
 fai_presentation_name=engine1
 fai_presentation_deploy_white_list='myPub escenic-admin indexer-webservice webservice escenic studio'

escenic-munin-plugins :: has linking errors when upgrading the package

The escenic-munin-plugins package has started to yield errors when upgrading it.

# apt-get upgrade -y
[..]
Setting up escenic-munin-plugins (1.0-2012-12-06-413) ...
[..]
ln: failed to create symbolic link `/etc/munin/plugins/escenic_jstat_dev1_gc': File exists
ln: failed to create symbolic link `/etc/munin/plugins/escenic_jstat_dev1_gcoverhead': File exists
ln: failed to create symbolic link `/etc/munin/plugins/escenic_jstat_dev1_heap': File exists
ln: failed to create symbolic link `/etc/munin/plugins/escenic_jstat_dev1_uptime': File exists

ece-install :: no memcached munin graphs

Installing the debian package libcache-memcached-perl makes it work out-of-the-box.

Edit: not out-of-the-box. These commands are needed

ln -s /usr/share/munin/plugins/memcached_ /etc/munin/plugins/memcached_counters
ln -s /usr/share/munin/plugins/memcached_ /etc/munin/plugins/memcached_bytes
ln -s /usr/share/munin/plugins/memcached_ /etc/munin/plugins/memcached_rates

This will give three graphs showing the hit ratio, the number of items in the cache, and the rate at which they're added

The download for tomcat fails.

The ece-install-248 command 'Downloading Tomcat from http://apache.komsys.org/tomcat/tomcat-6/v6.0.36/bin/apache-tomcat-6.0.36.tar.gz fails.

This is because this location doesn't exist anymore.
A working location is for example http://apache.mirror.1000mbps.com/tomcat/tomcat-6/v6.0.37/bin/apache-tomcat-6.0.37.tar.gz

The script /usr/share/ escenic/ece-scripts/common-os.sh contains the variable fallback_tomcat_url. This variable needs to changed to a location that exists.

Add post ece command hook

It is often needed to automate stuff that happens after the ece script runs. Lets agree on where to put the post command scripts and execute them automatically

We already have:
/usr/share/escenic/ece-scripts/ece.d/ : assemble.sh clean.sh flush.sh info.sh logs.sh publication-resources.sh restart.sh stop.sh top.sh backup.sh deploy.sh help.sh kill.sh package.sh remove-old-log-files.sh start.sh thread-dump.sh versions.sh

what about this:
/usr/share/escenic/ece-scripts/pre-ece.d/deploy/ : 01-schedule-downtime.sh 02-hipchat-start.sh 03-shutdown-varnish.sh
/usr/share/escenic/ece-scripts/post-ece.d/deploy/ : 01-run-bootstrapper.sh 02-start-varnish.sh 03-hipchat-done.sh

or
/usr/share/escenic/ece-scripts/deploy/pre.d/ : 01-schedule-downtime.sh 02-hipchat-start.sh 03-shutdown-varnish.sh
/usr/share/escenic/ece-scripts/deploy/post.d/ : 01-run-bootstrapper.sh 02-start-varnish.sh 03-hipchat-done.sh

ece-install :: add munin graphs for TCP connections

It would be nice if ece-install made graphs for e.g. fw_conntrack. This requires autoloading the ip_conntrack module, perhaps by adding it to /etc/modules (for debian at least) or by adding a small script to rc.local... When the module is loaded, munin-node-configure will autosuggest some nice graphs showing the statistics of how many connections are in time_wait, established, etc.

ece-install - feature request - as a template developer I'd like a no cache option for js and css in varnish

For the local development use-case a "change -> F5" process for css/js cannot have a varnish configuration that caches these resources for any period of time. ece-install should support setting up a varnish conf that runs varnish as normal, but ignores caching for js/css.

"ece-import" and "ece-import download" cannot run in paralel

/usr/bin/ece-import has a locking scheme that should be loosened up.

ece-install - after java6_39 the oab-java6 script fails

The current version of oab-java6 we use can't download the latest java from Oracle. We should switch back from https://github.com/madkinder/oab-java6.git to the original https://github.com/flexiondotorg/oab-java6.git which will resolve this issue.

Solr installation problem with 5.6

Default search instance cannot properly install solr for engine 5.6. Solr admin page shows the following:
org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Could not load config for solrconfig.xml

There are no SolrCores running.
Using the Solr Admin UI currently requires at least one SolrCore.

Solution:
Had to copy /engine/solr/solr.xml to solr_home manually.