dto-btn/todo

Catch-all for issues that aren't related to a specific project.

todo

Catch-all for issues that aren't related to a specific project.

todo's Issues

Convert Drupal playbook to use composer.json install

Related #8

Add Solr search appliance

Related #8

Add Varnish caching server

Related #8

Check if French name of the team makes sense

• It's currently L’équipe d’intervention numérique, but there's been feedback that this sounds awkward.
• It's also not a standard translation of Task force.

Dockerfile with systemd running as PID 1

This will allow and Ansible playbook test docker stack to run services that rely on systemctl.

Another possibility would be:

1. Removing ssh and switching to ansible_connection: docker; and
2. Starting container with CMD: ["/sbin/init"].

This would mean that the Ansible playbooks could only be tested from a Linux host.

Related to #8

Simplify Drupal playbook to have only one webserver, one database

This can be scaled out for iteration two. For now, one of each should be enough to handle an anonymous Drupal instance (mainly static caching).

Related #8

MySSC: link local Drupal accounts with ADFS accounts.

This will allow users with local accounts to login with their AD credentials.

MySSC: revert database renaming

Use same name in each environment.

Debug latest MySSC Drupal site deployment

We're getting failures during the simplesaml configuration because of the following two modules:

• Lullabot/block_dashboard
• Lullabot/entity_browser_block_layout

Errors occur when importing our exported simplesaml config:

./drush cim --partial --source=/path/to/config/simplesamlphp_auth -y

Error

[error]  Drupal\Core\Config\ConfigImporterException: There were errors validating the config synchronization.
Unable to install the <em class="placeholder">block_dashboard</em> module since it does not exist.
Unable to install the <em class="placeholder">entity_browser_block_layout</em> module since it does not exist. in Drupal\Core\Config\ConfigImporter->validate() (line 737 of /path/to/drupal/web/core/lib/Drupal/Core/Config/ConfigImporter.php). 

In ConfigImportCommands.php line 261:
                                                                                                                  
  The import failed due to the following reasons:                                                                 
  Unable to install the <em class="placeholder">block_dashboard</em> module since it does not exist.              
  Unable to install the <em class="placeholder">entity_browser_block_layout</em> module since it does not exist. 

MySSC: improve Varnish/Drupal cache settings

We're currently running default configuraiton for Varnish, which can be improved.

MySSC: include metadata refresh as part of playbook

Currently ADFS metadata must be manually refreshed or wait until the hourly cron job runs.

Cleanup MySSC Drupal playbooks and follow best practices

https://docs.ansible.com/ansible/latest/user_guide/playbooks_best_practices.html

Related #8

Blackberry replacement booth

Could Blackberry replacement be approached with a physical booth, the same way it was done for SIM card swaps?

Booth team could:

• Exchange device; and
• Walkthrough of new device setup.

Performance test MySSC Drupal stack

• Use JMeter.
• Tests:
  • With/out Varnish
  • With/out authenticated session

MySSC: support incremental codebase updates to database

• Current database deploy is all or nothing.
• We need to support incremental updates without losing user entered content.

Investigate performance test errors on 4 CPU/16 GB VMs

Non HTTP response code: java.net.NoRouteToHostException/Non HTTP response message: Cannot assign requested address (Address not available)

Related #17

Install SimpleSAMLphp for authentication

Possible roles that could be used as a starting point:

• https://github.com/erasme/ansible-simplesaml
• https://github.com/Sanchiz/ansible-role-simplesamlphp
• https://github.com/magenta-aps/ansible-role-simplesamlphp-idp
• https://galaxy.ansible.com/search?deprecated=false&keywords=simplesamlphp

Related #8

PHP hardening in playbooks

Related to #24

Meet with accessibility team to discuss onboarding and tracking process

• Walk through of FORK and discuss features that could be included in a replacement.
• Develop list of core features for MVP.
• Develop list of alternatives for building MVP.

⚠️ solution must be fully WCAG 2.1 AA compliant (at minimum).

MySSC: add ability to install Drupal dependencies using Composer

This would require a composer install rather than expecting a package which contains the dependencies already included.

Research issue tracking options for AAACT team

This would serve as a potential solution for FORK.

Related #3

Build docker-compose stack for local testing on Ansible playbooks

This will help with the infrastructure development for #8.

Harden PHP/Apache/MySQL configuration

• https://geekflare.com/apache-web-server-hardening-security/
• https://github.com/OWASP/CheatSheetSeries/blob/master/cheatsheets/PHP_Configuration_Cheat_Sheet.md

Fix "too many open files" error when running JMeter tests on Ubuntu 18.04

Default open files is 1024.

Configure MySQL default/replica for Drupal in Ansible playbook

geerlingguy.drupal role will need to be extended to support this.

Related #8

Data: metadata search tool

Met with Sean Strevens and Mark Malkowski to discuss EIM's metadata gathing project. They are in the process of getting a tool that could make it possible to improve how employee's search for documents and information.

Once procurement has finished, we'll touch base to see what's possible.

Nginx hardening in playbooks

Related to #24

AzureStack: open flows to GCcode

Allow VMs on AzureStack to talk with GCcode.

Automated testing of Windows based applications

The UiPath Community Edition is an RPA tool, but it can also be used to run automated tests as part of a CI/CD pipeline.

Flow would be:

1. Pipeline triggers spin up of Windows VM with UiPath dependencies.
2. UiPath story is run and tracks results using try/catch blocks.
3. Results are sent back to the pipeline.

This could be used for testing the AccessPro ATIP system releases.

Varnish/Apache localhost

Create playbook to have Varnish/Apache on same host, with Apache performing SSL termination.

Related #8

Onboarding chatbot feasibility

Investigate if this could be a good fit for alleviating some of the onboarding problems.

CircleCI has a good example of an engaging chatbot with common pre-populated questions:

---

---

MySQL hardening in playbooks

Related to #24

Remove secrets from MySSC Ansible playbooks

Passwords, artifacts and certs should not be part of the playbook repo.

Optimize backup/restore MySSC playbooks

• Use drupal-deploy role if possible.
• Support deploy/backup from URL or site.tar.gz.

Experiment with creating and configuring cloud dev VM

• Use Azure/AzureStack
• All configuration-as-code (ideally one-action create and ready to use).

Rename organization to team acronym

This will give us clearner URLs for our gh-pages deployments.

• Should be English-French to match SSC's geographic base in Ottawa..
• Currently, it would be dtf-ein, but #1 is confirming if the French acronym will stay the same.

Enable SimpleSAMLphp cron and metarefresh modules

MySSC: organize playbooks

• Only have playbooks that are run at the top level.
• Move sub-playbooks into a sub-folder.

MySSC: setup mail server for Drupal

Mail server is needed for user account management.

All-staff presentation

30 minutes, right after workshop:

• Introduce DTO
• Introduce Cloud Accelerators (high-level)
• Introduce DTF
• Example for MySSC (high-level)

Sli.do is available for interaction.

@britthurley @jessmardo @OliParipovic

MySSC: performance test latest OPIN codebase

MySSC: setup GitLab CI for Ansible project

• Start docker-compose service.
• Start play_all.yml playbook run.
• Curl services to make sure they're responding.

Stretch goal:

• Run automated integration tests against the environment.

Apache hardening in playbooks

Related to #24

Fix drupal_domain and durpal_domain_alias in webserver.yml

It's not being properly overridden by the [all:vars] section int he inventory files.

MySSC: remove X-Forwarded-By header check

Use hard coded private IPs of the Varnish servers instead. The header check breaks drush and direct access to Apache.

Cloud infrastructure for communications launch of MySSC

Gather requirements to host MySSC on AzureStack.

MySSC: triage of failed production configuration import

Underlying problem

• Drupal deploy directory was not clean. It contained code from previous releases.
• New deployments of Drupal code base were not cleaning the directory. They were only adding content.
• This was creating an inconsistent deployment artifact.

Fix

1. Backup Drupal site files.
2. Delete Drupal deploy directory.
3. Import new Drupal code base.
4. drush cim to import config.

Add the SIMPLESAMLPHP_CONFIG_DIR env var to the simplesaml role

It needs to be set so that metarefresh works:

# /etc/environment
SIMPLESAMLPHP_CONFIG_DIR="{{ drupal_deploy_dir }}/simplesamlphp/config"

Test command:

cd modules/metarefresh/bin
./metarefresh.php -s https://url/to/federationmetadata.xml

MySSC: document Ansible playbooks

High-level documentation that explains:

1. How to setup the project.
2. How to run playbooks.
3. The purpose of the different playbooks.
4. Further references.

GitLab: create dev VM to run the gitlab-runner

Pipeline runs are eating all of my dev VMs resources :/