tethysplatform/tethys

The Tethys Platform main Django website project repository.

tethys's Issues

Improve Production Installation Instructions

Production installation is fraught with bugs and issues. Review and clean up.

Create shapefile from resource.FILES memory issue

Motivation

• Current implementation of create_shapefile_resource that accepts the resource.FILES object may have issues handling large files.
• Currently creates a zip archive containing all the shapefiles in memory

Fix

• Perform check on the size of the files and at some threshold, write zip archive to tempfile object instead of to memory.

Add "Powered by Tethys" Attribution in Footer

Description

• Add "Powered by Tethys" with the Tethys Logo and as a link to http://tethys.ci-water.org for attribution.
• Place in the footer of the Tethys Portal on the right side.
• Add a parameter in the site settings for turning this off.

Install Applicable GeoServer Extension

Description

• Investigate useful GeoServer plugins and add to the docker
• Useful extension would add Raster support, animation capabilities, and support for formats like NetCDF
• http://docs.geoserver.org/latest/en/user/extensions/index.html

Update Command

Add a tethys update command for handling the updating of Tethys automatically.

Add D3 Plotting Support

Investigate D3 as a plotting alternative to High Charts.

URL Regex Expansion and Option

• Add "." and "_" to the default REGEX for the URL Map
• Add an argument to the UrlMap object that allows advanced users to pass a custom REGEX pattern to match for each url parameter provided.

"List" methods for datasets services and wps services

Description

• Add methods for listing dataset services and wps services in addition to retrieving them.
• list_dataset_services
• list_spatial_dataset_services
• list_wps_services

Formalize Workspaces for Apps

Create a mechanism for working with files in apps.

• Provide a workspace directory for apps to work in
• Create an SDK method either for obtaining the path to that workspace another means of stashing stuff there.

Check compatibility with new boot2docker

Check out version compatibility with later boot2docker versions on OS X.

May be related to this: docker/docker-py#465

Add ArcGIS Server Python client

• Investigate existing clients python clients: e.g.: http://arcgis-server-python-client.readthedocs.org/en/latest/
• If no acceptable solutions exist, create a custom solution.
• For geoprocessing

Add attributes option to all gizmos

Add an "attributes" option to all gizmos. The value of this option will be a string representing additional HTML attributes to add to the element being generated:

attributes='onclick=runme(); class=a-class'

would result in <element onclick="runme()"; class="a-class">

Engine Validators

Add validation to dataset and wps engines to ensure the endpoint provided is a valid endpoint.

Forgot Password Capabilities

Add support for resetting passwords when forgotten.

Add finished loading event for map gizmos.

Have Map Gizmos fire an event after the data has finished loading. Add this event to the JavaScript API documentation.

App Base Footer Size when Empty

Motivation

Footer in app templates shrinks when empty.

Solution

Modify template and css to retain size of footer even when empty.

Advanced Spatial Tutorials

Create advanced tutorials that demonstrate the use of key components of the SDK, especially the spatial components.

Fetch Climate Gizmo is Buggy

Alan, please investigate.

Expand Production Docs to Include Docker Remote Deploy

Expand the production installation documentation to include instructions for running the dockers remotely on separate servers.

System Requirements Docs

Description

• Add system requirements to docs including:
  • Memory: 3 GB minimum
  • Processors: 2 minimum
  • Storage: 10 GB? (investigate how big Dockers are and provide itemized list?)

Object Interfaces for Tethys Gizmos

• Options for Tethys Gizmos specified with objects, rather than dictionaries.
• Create classes for each Tethys Gizmo options object
• Will allow for cleaner abstraction from the gizmo
• Continue supporting dictionary format for backwards compatibility

Special Cases

• Create special subclasses of the Highcharts objects that provide reasonable defaults for different plots (e.g. HighChartsLinePlot, HighChartsScatterPlot, etc.)

Add Support for Spatial Animations in Map View

Probably a GeoServer/OpenLayers solution
See: http://docs.geoserver.org/stable/en/user/tutorials/animreflector.html

Add CKAN Dockers to Tethys CLI

Attributes

• Use the Docker images provided by CKAN (https://registry.hub.docker.com/repos/ckan/)
• Add logic for initializing CKAN dockers to the Tethys Command Line Interface (tethys docker)
• Make starting of CKAN docker optional

Add Legend Support to Map View

• Select layers
• Adjust visibility, opacity, and order
• Maybe as a separate gizmos that is linked with the map?

Finish Unit Tests on tethys_dataset_services

Complete the unit tests for tethys_dataset_services and fix the broken ones.

One Repository to Rule them All

Merge all Tethys Django Apps into the main Tethys project:

• Tethys Gizmos
• Tethys WPS
• Tethys Datasets
• Tethys Compute

Subclass HighCharts Gizmo for specific Plot types

Create special subclasses of the Highcharts objects that provide reasonable defaults for different plots (e.g. HighChartsLinePlot, HighChartsScatterPlot, etc.)

• Line Plot
• Scatter Plot
• Spiderweb/Polar Plot
• Pie Plot
• Bar/Column Plot

See the Highcharts Demo Page for examples: http://www.highcharts.com/demo

Drawing Mode for Map View

Attributes

• Add drawing controls for map view similar to google map view
• Add a hidden field that is updated when changes are made
• Support GeoJSON and WKT formats as output
• Model after google map view
• Support Point, Line, Polygon, and Box

Naming WPS Configurations with Uppercase Characters Fails

Description

Providing a name with uppercase characters to Web Processing Configurations with uppercase characters causes errors.

Suggestions

Either validate and allow only lowercase characters or fix to allow uppercase characters.

Optimize Tethys Docker Images

Motivation

• Docker images are quite large requiring a lot of disk space and causing the installation process to take a long time.

Solution

• Shrink the size of the Docker images
• Research means of optimizing the size of Docker images
• Start here: http://www.centurylinklabs.com/optimizing-docker-images/

Canned GSSHA Label Switched

Herman: I noticed that there is a cross labeling between the Snow Line and the Snow Gradient, in the slide bars and the radar plot.

Merge django-tethys_datasets with django-tethys_wps

Merge django-tethys_datasets with django-tethys_wps and call it django-tethys_services

Add Installation Instructions for Windows

Add installation instructions for creating apps with Tethys Platform on windows.

Note: We will not support running Tethys Platform in production on Windows at this time. We will only support Tethys app development in windows if it is feasible.

Alan's Tethys Dataset Services Update

Alan fixed the shapefile uploader utility to handle large uploads better. Integrate his code:

https://github.com/snowman2/tethys_dataset_services

It requires requests_toolbelt (new dependency):

https://toolbelt.readthedocs.org/en/latest/uploading-data.html#streaming-multipart-data-encoder

Header with variable title is not responsive and obscurs controls

Description

• Titles longer than "Tethys" cause header contents to wrap to additional lines, obscuring critical controls in the process.

Solution

• Make font size of title responsive
• Add ellipsis with long names
• Prevent wrapping

Implement Attribute Table For Google Map View and Map View

Background

• Value pop-up box appears in upper left corner of map instead of above the overlay.
• I've investigated it as a conflict with Bootstrap CSS, but found no conflicts.

Attributes

• On Google Map View, remove pop-up overlay that occurs when new features are created.
• On both Google Map View and Map View add attribute table with rows for each shape.
• Add new rows with editable fields for each shape drawn on the map.
• Attributes set by user should be reflected in the hidden geojson/wkt field
• Make attribute table data entry mode an option of drawing mode.

Draw Box on Google Map View

Attributes

• Add support to draw boxes to Google Map View

App Library Title Setting

Attributes

• Add a site setting that allows the administrator to change the name of the app library (e.g.: "Dashboard")

Make Scaffolding Project Naming More Robust

I ran into a bug that you may or may not know about. You probably do.

http://docs.tethys.ci-water.org/en/1.0.0/getting_started/scaffold.html

     $ . /usr/lib/tethys/bin/activate

(tethys) $ mkdir ~/tethysdev
(tethys) $ cd ~/tethysdev
(tethys) $ tethys scaffold my_first_app
I used "My First App" with the quotes cause I'm dumb and it threw the error below but I deleted some things and put a new name in and it still gave me the error.

This may have been my fault for naming it with quotes but I went back and deleted the directory in my user home/tethysdev directory and it still was giving me this error. I had to go to the specified app.py in the image above and delete the quotes that were part of the class name.

Recommended: Writing an if statement that says if the string has quotes in the My First App name, make the user try to name it again.

Let me know if you want me to submit bugs / user made bugs to a different place.

Create custom WPS client

Create a custom WPS client to replace defective owslib library.

Click and Plot Support for Map View

• Streamline "click and plot" capabilities.
• Click on a feature
• Pop-up shows time series plot associated with the feature
• Perform via callback

Sign-in 500 Error with username with "." characters

Description

Sign-in redirects to 500 error with usernames with "." (e.g.: bob.smith)

CLI Error: tethys gen apache: '{0}' is not a directory

Description

• Occurs when creating apache config file using the tethys gen utility during production installation

Set Restart Policy to Always on Tethys Dockers

Set the restart policy of the Tethys dockers so that they will start automatically after a system reboot of the server they are running on.

See: https://docs.docker.com/reference/commandline/cli/#restart-policies

Add Sextante Support to 52 North WPS Docker

Description

• Add support for Sextante in 52 North WPS Docker

Implement the User Access and Permissions Model

Attributes

• Restrict access to apps library to authenticated users
• Restrict access to individual apps on a user by user basis
• All restrictions optional (admin can turn off restrictions)

.tethyscluster Directory Creation causes Error in Production

Description

• Error at Runtime with Production Installation caused by inability to create .tethyscluster directory
• This works in development mode, but causes permissions error in production installation:
  • .tethyscluster directory created in home directory of the current user (/var/www/tethys/.tethyscluster?)
  • In production user running Tethys is the Apache user
  • Home directory of Tethys user is the /var/www directory which is owned by the root user
  • Hence, Tethys doesn't have the ability to create it automatically

Suggestions

• Option 1: Create a "tethys" user that owns all Tethys source and belongs to the Apache group during production installation to allow the appropriate permissions.
• Option 2: Mitigate through docs by including instructions to manually create the .tethyscluster directory during production installation.
• Option 3: Move .tethyscluster directory to the tethys src directory.
• Others?

Add Helper Function for Linking PostGIS Databases with GeoServer

Create a helper function that will streamline linking PostGIS databases with GeoServer

• using the engine objects?
• handle weird Docker trick if not public (had to do this with Jocelynn's app)

GeoServer Investigate Deleting Behaviour

GeoServer retains workspaces, stores, and files even after being deleted. Investigate how to safely allow for deletions.

Custom "collectstatic" CLI command

Motivation

• Static files must be manually moved to a static files directory to be served in production.
• This is normally automated by the Django CLI collectstatic management command.
• Files added dynamically to the static directory of an app project are not automatically added to the static directory and are thus not served automatically.

Solution

• Create a custom collectstatic management function for Tethys that will create symbolic links from the static files to the static file directory (tethys manage collectstatic).
• This command will also call the Django collectstatic command.
• Alternatively, investigate the "Media" directory for Django web projects.