lucas42/lucos

lucos's Issues

Auto-start of services on server startup

At the moment, if the server restarts, all the services stay stopped until they're manually restarted. It'd be ideal if they were started automatically.

Secrets Management service

Build a service which lets me download environment variables using scp

Golang looks like it has some useful built-in functionality for this: https://debugged.it/blog/ssh-direct-to-docker/

Add status service to github

This service doesn't actually do anything yet, but it might be worth putting it on github at some point.

Depends on:

• Remove example code from project
• Don't commit node_modules (Though explain in documentation how to get them)

Add progs service to github

This service doesn't actually do anything yet, but it might be worth putting it on github at some point.

Need to work out dependencies and puppetise them (just python for now, but I'm guessing some sort of RDF library will be needed)

Service discovery

Currently there's hardcored lists of services in several places, mainly:

• lucos_dns
• lucos_router
• lucos_root
• lucos_monitoring

At a bare minimum, this should be reduced to a single list which is polled/cached where needed.

Ultimately it'd be nice if discovery was fully automated, so deploying a new service results in it being added in all the relevant places.

Add auth service to github.

Depends on:

• Removing API keys for external services from source code
• Removing internal lucos API keys from source code
• Add messaging for when there are no API keys
• Document how to add API keys

Consistent colour pallette

At the moment, the colour palette varies a lot between lucos services. Sometimes this is useful, but it'd be nice to have some stylistic consistency beyond the navbar.

Potential colours:

• Black #000
• Burgundy #502

Images service

Requirements:

• Store canonical version of own images
• Store extensive metadata in a flexible way (something like tags/rdf)
• Some sort of privacy settings (just public/private is fine for now)
• Batched API service for images
• Client side library for loading images from server, storing them offline and making them available for offline use.

Desirable:

• Batching API service to include support for third party images.
• Caching of third party images.

Add time service to github

Depends on:

• Remove video files from project
• Make media urls configurable

Standardise dependency management.

Need to be able to pull dependencies in from other repositories.

Must be language agnostic.

Add dns service to github

Depends on:

• Remove API from source code
• Make domains configurable
• Puppetise perl

High res icons

Go through each service, and ensure the icon is as high-resolution as possible.

Add google contacts sync service to github

Depends on:

• Remove google API key from source code
• Remove lucos auth API key from source code

lucos v4

Lucos v4 architecture

• Containerise services
• Discovery mechanism
• Surface info, following discovery - json endpoint?
  • Routing
    • DNS
    • Port running on
  • Stuff for displaying homepage:
    • Service name
    • URL
    • Icon
    • Whether service works offline
  • Monitoring?

Migration strategy

• Create new VM on hive for housing containers
• Start with things which encounter operational problems (eg tfluke app)
• Next focus on legacy stuff on prometheus (eg DNS)
• Then anything not on daedalus
• Finish with remaining daedalus services
• Once completed, could look at removing virtualisation layer and running containers on bare metal

User agent strings for http requests between systems

There's inconsistent usage of user agent strings in the various lucos systems. Set system-specific UA strings where possible, rather than relying on library or language defaults.

Add media services to github

There's quite a few media modules - probably should use a separate repository for each, but this may present problems with those which are static files served by a server in a different repository.

Depends on:

• Remove acoustid API key from source code
• Don't commit fingerprinter executable
• Don't commit manager's java class files (move them to their own directory)
• Don't commit bulktag executable
• Don't commit weighting exectuable
• Puppetise stuff
• Remove all the extraneous files in all the modules

Modules/Services to include:

• Media Manager
• Media Controller
• Media Player
• Media Selector
• Acoustic Fingerprinting
• Media Weighting
• Misc Metadata management

Add contacts service to github

Depends:

• Puppetise/document dependencies (python, django, postgresql)
• Remove database details from source code
• Remove authentication API key

ipv6 routing to xwing and salvare

This was working for a while. But then got a new a router which handles ipv4 better, so it hasn't been a big problem.
Worth getting inbound ipv6 working again for more resilience.

Misc ideas from todo list

Can't remember the context for most of these, but moving them here from todo list as it seems a better place to keep them:
📋 cal - pylon of the month; pindippy daily doodle.
📋 dynamic display page
📋 general - impove navigation (breadcrumbs?)
📋 Computer stats widget
📋 stream twitter to client
📋 service to convert links to preview. (async with loads of caching)
📋 add facebook updates to social stuff
📋 use open calais to parse updates for concepts
📋 use fanhubz to get progs from hashtags
📋 use trending topics and programmes to play related music

Add root service to github

Depends on:

• Remove unused code from project (especially stuff that's not mine e.g. PhoneGap libs)
• Puppetise java