ortelius/ortelius

The mission of the Ortelius community is to expose weak links in the software supply chain by continuously gathering and analyzing software supply chain intelligence introduced across the DevOps pipeline and connected to your deployed environments.

ortelius's Issues

Deploy to Kubernetes using Helm

@piyush94 - I want to make sure we handle your use case for deploying using Helm. What is your Kubernetes cluster running on, AWS, GKE? I need to make sure the authentication happens correctly prior to running Helm. Also, I am assuming that Triller is already configured.

Thanks, Steve

Getting a list of all environments

Is there a DMScript way to get all the environments?

I have used the rest service to retrieve them but I was wondering if there is a way within DMScript to get them directly?

Thanks

No domains in the GUI

Hello,
Suddenly the domains tree disappeared from the GUI.
All the options in the main menu stopped showing any action .
I uninstalled DeployHub and resinstalled it many times expecting to get back its functionality, but the result is always the same.
I'm working on Windows 10
Any idea where the problem can be ?

How may I change the port of DeployHub

DeployHub by default runs on port 8080. How may I change the port?

Runtime error: Pattern is required for http repository

Hi,
I am trying to set up my project in deployhub with jenkins. I have done jenkins set up in deployhub for example Application103 and enviornment 103 and configured all seeting in Jenkins job configuration page and when i run the build it is throwing the below error

Runtime error: Pattern is required for http repository
18:22:57
18:22:57 Stacktrace:
18:22:57 repository Repository104
18:22:57 dropzone 1
18:22:57 deploy
18:22:57 component Component105
18:22:57 application Application104
18:22:57 avloop
18:22:57 application Application104
18:22:57 environment Environment104
18:22:57 global
18:22:57
18:22:57 INFO: Time taken 0.172000 seconds
18:22:57 IO Exception: java.lang.UnsupportedOperationException: Refusing to marshal net.sf.json.JSONObject for security reasons; see https://jenkins.io/redirect/class-filter/
18:22:57 Build step 'DeployHub Interface' marked build as failure
18:22:57 Finished: FAILURE

Please can you advise what went wrong, I want deploy the .net webapp folder to target folder not single file .

remotescript command not working

Hi
I have a component with a postaction invoking this function :

echo "Running script on end point ${server.name}";
echo "before executing /home/MyDirectory/MyChmod.ksh";
remotescript(filepath: "/home/MyDirectory/MyChmod.ksh");
echo "exit status is $?";
return 0;

When I see the execution log I see:

Running script on end point az70
before executing /home/MyDirectory/MyChmod.ksh
exit status is 0

But the script never is executed in the end point
am I missing something?
I have tried invoking a none existing remote script as well and I always get an rc= 0
Is there a way to at least get an rc <> 0 and know it is failing when trying to execute the remote script?

About window shows 'Release Engineer'

About window shows 'Release Engineer' when clicking on upper right 'i' icon instead of 'DeployHub'.

Enable subscribing to a component

Run Task times out

I am trying to run a run task that takes a while to complete. The UI comes back with nothing or somethings an error. It is not the functions I am running because they all work individually.

I assume there is a timeout setting somewhere.

Is this a setting I can update within the tool?

Using variables in Command Line Interpreter Path

Hi,

Looking to use the getcredential function in a command line interpreter path but it does not seem to work. I am trying to do something like

${PATH_TO_WSADMIN}/wsadmin.${EXT} -lang jython -user "${getcredential("${was_credential_name}"}.username}" -password "${getcredential("${was_credential_name}"}.password}" -p ${soap_client_props_dir}/mysoap.client.props -f
The direct variables work fine PATH_TO_WSADMIN, etc.. but not the get credentials.

I have tried attributes to do this as well, on the endpoint, but doing a getcredential there has issues as well since it seems to have problems navigating the quotes.

I have tried the following syntax in both locations:

getcredential("Cred_Name"}.username
getcredential('Cred_Name'}.username
getcredential(''Cred_Name''}.username
getcredential""Cred_Name""}.username
getcredential(/'Cred_Name/'}.username
getcredential(/"Cred_Name/"}.username
${getcredential([With all the combinations above]}.username}

Any thoughts?

Need to classify Domains

We need an option to indicate a domain is a "catalog" or a "project" domain. When it is a "project" domain, it should include Environments and Endpoints, and Tasks. A catalog domain should not have these Objects and we should prevent that in the frontend.

This simplifies the use of Env and tasks.

Status check to endpoint failing

I am running via docker container.
After adding the end point status check is failing:

But if TTY into the container i am able to issue ping to the endpoint.

Create Discord Channel

Setup Discord for project.

Feedback Loop has overlapping boxes

Attributes not getting expanded.

Hi,

I am trying to get an attribute set as ${server.name} echo'd in my deployment script.

So I have my attribute set to:

I then have my script set to

action WS_Clean_Cluster
{
echo "${test_attr}";
return;
}

My output is this

INFO: Starting deployment #67216

INFO: Deploying Application "CFM_1_0;1" into Environment "Old_UAT"
INFO: Deploying Component CFM
INFO: Checked out /job/CFM_AD_4.1_Int/4/ca.ontario.gov.health.GAPP.CFM$CFMWebEAR/artifact/ca.ontario.gov.health.GAPP.CFM/CFMWebEAR/4.1/CFMWebEAR-4.1.ear;4
INFO: Item "CFM WebSphere": Checked out 1 file(s) from repository "Jenkins"
${server.name}
INFO: Pre Action for Component CFM exits code 0
INFO: Deploying Component CFM to Server Dev WebSphere 8_5 Admin
INFO: Deployed File CFMWebEAR-4.1.ear -> Dev WebSphere 8_5 Admin:/export/home/walec/deploy/CFMWebEAR-4.1.ear
INFO: Time taken 2.810000 seconds

Is this expected behavior? It does not seem to evaluate the attribute.

SSH/SFTP support for Windows

Currently the SFTP protocol is not supported if the end point type is set to windows. The Windows command set is not used when doing Status checks or deploys.

Please add this functionality to Deployhub.

Thanks.

Add endpoint to deploy action

I have create a new action of category deploy.
action DoMongoDBInstall { deploy(repository: "GlobalRepo", path: @'software', pattern: "installers/mongodb-linux-x86_64-rhel70-3.6.3.tgz"); deploy(repository: "GlobalRepo", path: @'software', pattern: "scripts/ase/mongodb-install.sh"); ExecMongoDBInstall; return; }

And i am running this task like this:

and then:

But it is not asking for endpoint where to run.

Calling Remote Procedure using strings with spaces in command line

Hi,

I am trying to run a remote script on an endpoint and the parameters that are required to be passed are stings with spaces. I cannot seem to find a way to get quotes put around the parameters. If I put them in the Action that calls the procedure then the deployment just fails because, I believe, of the double quotes that are in the DMScript that is generated

ws_create_jdbcprovider(Server: @"${was_server}", Classpath: @""${DERBY_JDBC_DRIVER_PATH}/derby.jar"", Implementation_Type: @""XA data source"", Database_Type: @"Derby", Name: @""Logger Derby JDBC Provider (XA)"", Provider_Type: @""Derby JDBC Provider"", Description: @""Derby embedded XA JDBC Provider. This provider is only configurable in version 6.0.2 and later nodes"", Cluster: @"${was_cluster}");
return;

I can't tell what the crash actually is because when I run it from the command line dmtransfer fails with "Failed to create Target Directory". (It transfers fine when I run it from the GUI but that is another issue) So I cannot tell you where exactly it fails.

If I run it with no quotes

ws_create_jdbcprovider(Server: @"${was_server}", Classpath: @"${DERBY_JDBC_DRIVER_PATH}/derby.jar", Implementation_Type: @"XA data source", Database_Type: @"Derby", Name: @"Logger Derby JDBC Provider (XA)", Provider_Type: @"Derby JDBC Provider", Description: @"Derby embedded XA JDBC Provider. This provider is only configurable in version 6.0.2 and later nodes", Cluster: @"${was_cluster}");
return;

I get this error when it tries to run the script:

bash: -c: line 0: syntax error near unexpected token (' bash: -c: line 0: sh -c cat - >/tmp/create_jdbcproviderws.py;/apps/ibm/websphere/appserver/v8552/bin/wsadmin.sh -lang jython -user **** -password ******** -p /export/home/walec/mysoap.client.props -f /tmp/create_jdbcproviderws.py -cluster SOACCluster -name Logger Derby JDBC Provider (XA) -description Derby embedded XA JDBC Provider. This provider is only configurable in version 6.0.2 and later nodes -impltype XA data source -providertype Derby JDBC Provider -server -databasetype Derby -classpath /derby.jar '

Pretty sure it is complaining about the bracket as part of the (XA) text which it thinks is part of the command line not part of the script parameters.

Thoughts?

Server giving 404

Hi,

I've been trying for quay.io/deployhub/deployhub-pro:latest for deployhub server, but the server gives 404 response on app url.

Log of docker run

+ sudo chown -R postgres:postgres /var/lib/pgsql
+ chmod -R 777 /opt/deployhub
+ pkill postgres
/tmp/entrypoint.sh: line 6: pkill: command not found
+ sudo test -f /var/lib/pgsql/data/pg_hba.conf
+ echo 'Database already initialized'
+ sudo -u postgres pg_ctl start --pgdata=/var/lib/pgsql/data
Database already initialized
pg_ctl: another server might be running; trying to start server anyway
waiting for server to start....2019-02-25 12:13:15.441 UTC [15] LOG:  listening on IPv4 address "127.0.0.1", port 5432
2019-02-25 12:13:15.441 UTC [15] LOG:  could not bind IPv6 address "::1": Cannot assign requested address
2019-02-25 12:13:15.441 UTC [15] HINT:  Is another postmaster already running on port 5432? If not, wait a few seconds and retry.
2019-02-25 12:13:15.446 UTC [15] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
2019-02-25 12:13:15.449 UTC [15] LOG:  listening on Unix socket "/tmp/.s.PGSQL.5432"
2019-02-25 12:13:15.529 UTC [15] LOG:  redirecting log output to logging collector process
2019-02-25 12:13:15.529 UTC [15] HINT:  Future log output will appear in directory "log".
... done
server started
+ sleep 10
+ sudo -u postgres pg_ctl status --pgdata=/var/lib/pgsql/data
pg_ctl: server is running (PID: 15)
/usr/bin/postgres "-D" "/var/lib/pgsql/data"
+ '[' '!' -e /opt/deployhub/logs ']'
+ mkdir /opt/deployhub/logs
+ cd /opt/deployhub/engine
+ export LD_LIBRARY_PATH=/opt/deployhub/engine/lib:/opt/deployhub/engine/bin
+ LD_LIBRARY_PATH=/opt/deployhub/engine/lib:/opt/deployhub/engine/bin
+ export PATH=/opt/deployhub/engine/lib:/opt/deployhub/engine/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ PATH=/opt/deployhub/engine/lib:/opt/deployhub/engine/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
++ cut -d: -f6
+++ whoami
++ getent passwd omreleng
+ export HOME=/home/omreleng
+ HOME=/home/omreleng
+ cp -r /keys/authorized_keys /keys/config /keys/config.bkp.13052018_2231 /keys/config.bkp.13052018_2233 /keys/config.bkp.13052018_2329 /keys/config.bkp.13052018_2331 /keys/id_rsa /keys/id_rsa.pub /keys/known_hosts /home/omreleng/.ssh
+ cp -r /keys/authorized_keys /keys/config /keys/config.bkp.13052018_2231 /keys/config.bkp.13052018_2233 /keys/config.bkp.13052018_2329 /keys/config.bkp.13052018_2331 /keys/id_rsa /keys/id_rsa.pub /keys/known_hosts /root/.ssh
cp: failed to access '/root/.ssh': Permission denied
+ sudo chmod 700 /root/.ssh
chmod: cannot access '/root/.ssh': No such file or directory
+ sudo chmod 700 '/root/.ssh/*'
chmod: cannot access '/root/.ssh/*': No such file or directory
+ sudo chmod 600 /root/.ssh/authorized_keys
chmod: cannot access '/root/.ssh/authorized_keys': No such file or directory
+ chown -R omreleng /home/omreleng/.ssh
+ chmod 700 /home/omreleng/.ssh
+ chmod 700 /home/omreleng/.ssh/authorized_keys /home/omreleng/.ssh/config /home/omreleng/.ssh/config.bkp.13052018_2231 /home/omreleng/.ssh/config.bkp.13052018_2233 /home/omreleng/.ssh/config.bkp.13052018_2329 /home/omreleng/.ssh/config.bkp.13052018_2331 /home/omreleng/.ssh/id_rsa /home/omreleng/.ssh/id_rsa.pub /home/omreleng/.ssh/known_hosts
+ chmod 600 /home/omreleng/.ssh/authorized_keys
+ echo Running DeployHub Processes
Running DeployHub Processes
+ java -jar /opt/deployhub/webadmin/webapp-runner.jar --path /dmadminweb /opt/deployhub/webadmin/deployhub-webadmin.war
+ /opt/deployhub/engine/trilogyd

Service validation from host:

wget localhost:7171

Output:

--2019-02-25 12:14:58--  http://localhost:7171/
Resolving localhost (localhost)... ::1, 127.0.0.1
Connecting to localhost (localhost)|::1|:7171... connected.
HTTP request sent, awaiting response... 404
2019-02-25 12:14:58 ERROR 404: (no description).

Build Log Still Says Release Engineer

All references to what should now say DeployHub still say Release Engineer, i.e. "Logged into Release Engineer".

dependency failure

dependency failed for deployhub engine listener

Build out Kubernetes install instructions

As a maintainer, I want to build out a simple set of instructions for using Ortelius on Kubernetes

Component Items should display a message when none are defined

It should say something other than giving a blank page. This typically happens when a custom action is used for the deployment.

RTC type repository

I got the OSS DeployHub version.
In the documentation I can see that there are RTC repository types. But on what I have installed I only can see: File system, ftpprep, harvest, http, meister, perforce, and svn.
Can you help telling me what is the best option for RTC repositories ?

Base Dir check failing

This happens on the Status tab of a server

Need to Explain Reports and Auditing Capabilities in More Detail and in a Separate Chapter

Need to Explain Reports and Auditing Capabilities in More Detail and in a Separate Chapter. Also need to have some of the reports rewritten a with a bit more detail and better organization.

Build helm chart for Ortelius

As a maintainer, I want to build out a helm chart.

unzip for Windows, internal procedure referencing wrong script

Trying to use a Remote Procedure outside of a deployment

So I am trying to create an admin script that uses an environment and then calls some procedures. What I am finding is that the remote procedure call get totally bypassed. There is no error and no indication that the system has even acknowledged that the procedure call is actually in the code. The call works in a normal deployment.

This is my dmscript

using environment "${env}" { // use an environment 
    set servers = ${environment.servers};
  iterate(s: $servers) {
    if (${s.attributes.PATH_TO_WSADMIN} != "") { // I do this so that I can pick the right server to run the procedure on.
       set -g server = $s;                               // set the server so that one is selected before the call. This might be the problem since it is not really on the stack. Is there a way to force it on the stack?
       echo "Server: ${server.name}";            // check it. Yes it displays the correct server name.
       myecho(test: @"TEST***");                 // This is a procedure created in the database that I call to make sure I can call out. and Yes it displays a string successfully. It just does an echo.
       ws_all_remove_sharedlibs(Cluster: @"${cluster}"); // !!! This procedure is completely bypassed. !!!!
    }
  }
}

My output looks like this.

bash-3.2$ engine/bin/dm "-pw" "[password]" "-usr" "admin" "-appid" "127" "-sessionid" "C38487E8049A77805A184BCF1018CB9E" "-runtask" "222" "appsrv2=asdas" "cluster=SOACCluster" "appsrv1=asdas" "adminserver=Dev WebSphere 8_5 Admin" "was_credential_name=Dev_WAS_8_5_Admin" "env=GLOBAL.Claims.CFM.Development.Old_UAT" -debug 3
Server: Dev WebSphere 8_5 Admin
In My Echo TEST***

I am assuming that I have missed something that the remote procedure needs on the stack or somewhere. It's just odd that I don't get any kind of error or crash or anything?

I guess the root question is is this even possible to do?

Thanks.

Move Tasks from Domain to Environment

Tasks are performed against an Environment, but assigned to a Domain. We need to move the Task to under an Environment and update all documentation around Tasks in the reusable/tasks.md, firststeps/2 defin domains.md and 2 define environments.md

Is there a way to disable deploy tasks at the environment domain level?

I don't want developers to shortcut the gating/move process by selecting the deploy task at environment domains. I want to force them to deploy from the application object.

Is there a way to do this?

Component Versions don't inherit custom action

When creating a new component version from a parent that has custom actions associated to it, the new component version has the custom action field blank.

Please allow dashes in names e.g. DSL-BC or DSL-WEBAPPPL

I have noticed when creating credentials and repositories that - is not allowed. When trying to set things up for multiple applications - (dash) is a very common separator. Not a high priority, but a nice to have.

DeployHub does not handle Jenkins Folders correctly

typo in docs for expression subsitution

https://www.deployhub.org/help/NetHelp/index.html#!Documents/expressionsubstitution.htm

echo "here's the result of testscript: $(testscript()}";

should be

echo "here's the result of testscript: $(testscript())";

Error: Could not find library ftplib.dll

I'm trying to deploy a simple text file from "ftprep" type repository, but I got the following:

INFO: Starting deployment #152
INFO: Deploying Application "MyApp" into Environment "MyEnv"
INFO: Deploying Component MyComponent
Runtime error: Could not find library ftplib.dll
INFO: Time taken 0.010000 seconds

Can someone help me to resolve this?

I'm using the Linux DeployHub Open Source (OSS Latest version)

Thanks in advance!

Entering a New Repository Shows 2 Indentical Repositories in Tree Structure

Connections view -> Repositories tab -> Right Click on a Domain -> New Repository in this Domain, notice tree opens showing 2 Repositories with the same name. Redrawing tree shows 1 as expected.

General Deploy Setup Description says "under under" for Environment

Setup view -> General Deploy Setup -> Next button -> Second bullet point says "An Environment represents a target for deployment and contains one or more End Points. Environments can be found under under the Data Center view."

Details install link is broken

Readme.md content has Detailed install link (https://www.deployhub.org/help/NetHelp/#!Documents/deployhubinstallationguideforlinux.htm) which is broken.

Please update it with correct link.

Multiple tasks

I have an application that has four components that need to be deployed to a pair of servers. Unfortunately, instead of one component going to 1 server and 3 components going to the other - I now have 4 components going to both servers. Do you have a more complex example of how to configure this properly other than creating two separate applications?

Can I run a unix function (mkdir) without having to create a script?

I am trying to create a procedure that just runs a mkdir command. I have defined 'command line interpreter' to /bin/mkdir and deselected the 'Copy to Remote' checkbox.

Should I have something like ksh /bin/mkdir instead?

It is just a simple single command. I am just trying to not have to manage another script file for such a simple function.

Thanks.

Move documentation to Docsy

Currently the documentation is in word doc and uses Doc2Help to convert to html pages. Need to convert to markdown and use Docsy to serve up the pages.

Slack Channel discontinued

We are closing the Slack channel. Check all outgoing emails for reference to slack.

credentials not working

credentials not working.
endpoint connect fails.

new verion:

old version:

Err msg on initial DeployHub sign in attempt: Unsupported major.minor version 52.0

Email from customer:

Recently install in my computer DeployHub 8

My computer has:
Windows 7 64bit
PostgreSQL 9.3
Java jdk1.8.0_144
Java jre1.8.0_144
Posgres psqlodbc_09_03_0400

When I run:

localhost:8080/dmadminweb/Home in any of the web browser I got the folling error message:

HTTP 500 - dmadmin/Home : Unsupported major.minor version 52.0
Apache Tomcat/7.0.54

What do I have to do to correct it?

Thanks in advance,
Ricardo Lorenzi

Timed out waiting for deployment to start Unhandled exception: Current user not set - can't deploy

Jenkins Plugin does not update DeployHub when Component Selection alone is selected and filled in

When I try and just set the component selection tab only, Deployhub does not create a component version or updated attributes.

Thanks.

Uploading patterns in a massive way

Is there a way to upload patterns in a massive way?
What I would like to be able to do is to add a big list of file names to be deployed in the patterns tab of a connection.
Think about this as a huge set of arbitrary file names (they don't follow any pattern name ... I can't use wildcards)
Adding one by one using the GUI can be a tiresome task and prone to make typos.
I know beneath Deployhub there are a set of Postgress tables. Perhaps If I was able to interact directly with those tables I would be able to upload a csv file into the table holding those patterns.

Any suggestion?

Database Management Support

I see on the documentation that DeployHub can help with database management support. i.e. database changes from development to QA or PROD.
Do you have an example on how this can be used or configured ?

odbc error message

traying to deploy the application sample I got the following error message: