ubccr/coldfront

HPC Resource Allocation System

ColdFront - Resource Allocation System

ColdFront is an open source resource and allocation management system designed to provide a central portal for administration, reporting, and measuring scientific impact of cyberinfrastructure resources. ColdFront was created to help high performance computing (HPC) centers manage access to a diverse set of resources across large groups of users and provide a rich set of extensible meta data for comprehensive reporting. The flexiblity of ColdFront allows centers to manage and automate their policies and procedures within the framework provided or extend the functionality with plugins. ColdFront is written in Python and released under the GPLv3 license.

Features

• Allocation based system for managing access to resources
• Self-service portal for users to request access to resources for their research group
• Collection of Project, Grant, and Publication data from users
• Center director approval system and annual project review process
• Email notifications for expiring/renewing access to resources
• Ability to define custom attributes on resources and allocations
• Integration with 3rd party systems for automation, access control, and other system provisioning tasks

Read more

Community Supported Plugins

• OpenStack Plugin
• Keycloak User Search
• Starfish Plugin

Submit a PR to add your plugin to the list above.

Documentation

For more information on installing and using ColdFront see our documentation here

Contact Information

If you would like a live demo followed by QA, please contact us at [email protected]. You can also contact us for general inquiries and installation troubleshooting.

If you would like to join our mailing list to receive news and updates, please send an email to [email protected] with no subject, and the following command in the body of the message:

subscribe [email protected] first_name last_name

License

ColdFront is released under the GPLv3 license. See the LICENSE file.

coldfront's Issues

mokey_oidc breaks ability to hijack user in admin interface

With mokey_oidc enabled, admins can no longer hijack user accounts.

Add "Last updated" info to project detail

Under Grants and Publications sections, add "Last Updated:" with the date so users can see when they last updated that information.

sort publications

Add ability to sort publications by date or by title.

Add help info to grant form

For, at least, the percent credit and direct funding items, let's add help info they can mouse over that defines what we mean by these two entries.

Users Page

Make page similar to projects and subscriptions where a PI can see all the users in all their projects

subscription name displaying incorrectly

A subscription that has a linked resource isn't displaying with the main resource name but rather with one of the linked resource's. See screenshot

Wrong message is displayed when a user tries to renew subscription on a project with pending review

Wrong message is displayed when a user tries to renew subscription on a project with pending review

add & delete user buttons on subscriptions error

Both the add & delete user buttons on subscriptions result in 'webpage not found' error. Tried this on both active and pending subscriptions, as a PI.

Remove trailing slash in renew link

The trailing slash in the email link to subscription renewal has to be removed.

Allow privileged users to export all grants

Users such as center directors should be able to export all grants

Add export feature for publications

All users to export their publication list

refactor quantity for subscriptions

Not all subscription types need a quantity. Pull out and add as a subscription attribute instead

django admin interface - subscription status changes

Add drop down options to include all subscription statuses to change status easily. Right now the only option is "delete"

issues displaying expired subscriptions

On home page, under list of subscriptions, if a subscription has 0 days left or is expired, it is not clickable. If I go to the list of subscriptions using the menu, it is no longer displayed because it's not active. It's also no longer displayed under the project.

ability for user to enable/disable notifications

Users should be able to enable or disable their own notifications. Managers can do this for all the users in their project but currently users can't do this themselves

user lookup function

Allow staff role to lookup users on projects and subscriptions. Right now, the only filters available to search projects on are PI username, last name or field of science. There are additional filters for subscriptions but the username field would be useful to those staff who are trying to find a specific user and may not know what project or PI they fall under.

email notifications for subscription attribute that is a date

Allow the configuration of emails to be sent if a subscription attribute is set that is a date. For example, if something is an expiration date, send out a notification X days before expiration to the manager on the project.

Project & subscription list filters

Think it would be more user-friendly to make the filter icon clickable or move the + sign over from the right to the left

Add robots.txt

Add FreeIPA integration

Create an extra/djangpapp for FreeIPA. When a user is added or removed from a subscription, need to add/remove them from the corresponding unix group in FreeIPA. Can use the FreeIPA API with kerberos keytab.

When auto-logged out, redirect to current page after login

Currently, when a user is auto-logged out and they log back in again, they are redirected to the home page. Would be more user friendly to log them back in on the page where they left off.

Ensure publication bar chart shows unique

When painting the publication bar char on center summary ensure we're grabbing unique DOI's

Merge custom and generic navbars

subscription renewal label

Change label for expiring subscriptions to be read "Expires in X days - click to renew"

New subscription request - select all users

Add a 'select all' box for PI to add all of his/her users to a new subscription. Otherwise they have to check the box for every user.

Subscription users status

Subscription users are only shown if they are in Active, Pending - Add, or New status. This makes it slightly confusing to the PI as users in Error or Pending - Remove status are not shown. The logic should be changed to show users in ALL statuses except "Remove". That is the only status that should be hidden. Also, if a user is removed from a subscription there is no way to re-add them to the subscription? Perhaps the add logic needs to also grab the list of users that have been removed from the subscription?

subscription search filters

Add ability to filter search on any attributes. If you want a specific list for us, let me know

Filter for "project" attribute - is this a name or a project ID? We should specify in label or help tag

display name of subscription with multiple resources

Change the display name of a subscription that contains multiple resources. Also, verify that the subscription only displays once in the list of available subscriptions when adding a user to the project.

From mkzia: The logic would be that if a parent exists, then display the parent name, otherwise if multiple resources exist and none of them is a parent, then display multiple resources.

Django search

Not sure if this is something that can be fixed but when searching for a PI's subscriptions or projects, the search is returning anything with those characters anywhere in the name or description. For example, when I search for PI=abc, I'm getting projects & subscriptions that have those letters together in them. I'm not sure this can be changed though because I want to be able to search for a user across all the projects or subscriptions, not just PIs.

Add 'disable cloud usage notifications' feature

On cloud subscriptions, we want users to be able to disable usage notifications. There might be several reasons they'd want to do this: they are using up the subscription quickly and getting notified alot, they're in the process of paying for more resources, they're shutting down their project and only using it until it's gone.

provide ability to add multiple publications at once

either by searching a list of DOIs and/or by uploading a file in bibtex or other standard format.

Auto-select PI to be added to new subscription

When requesting a new subscription, there's a list of project users the PI can choose from to add. The PI name should be selected and greyed out as we always add the PI to the subscription and don't allow them to remove themselves.

Subscription filter

When filtering for subscriptions, if you use "active until" or "active from now until date" you still have to click on the "active" status. (this has been a problem for years)

Add users to project

Hi we are trying to see if we can use colfront in our Center

Trying to "Add users to project" we have this error. The user is marked as PI

"POST /project/12/add-users-search-results/ HTTP/1.1" 200 3743 Internal Server Error: /project/12/add-users/ Traceback (most recent call last): File "/root/coldfront_app/venv/lib64/python3.6/site-packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/root/coldfront_app/venv/lib64/python3.6/site-packages/django/core/handlers/base.py", line 137, in _get_response "returned None instead." % (callback.__module__, view_name) ValueError: The view coldfront.core.project.views.ProjectAddUsersView didn't return an HttpResponse object. It returned None instead

Thanks

Fix view permissions

Users with all view permissions should not see the renew subscriptions button

Add logging

• We should do some basic logging
• Either write logs to a file or stdout
• Should be able to configure the log level in local_settings.py

Add XDMoD integration

Create a extra/djangoapp for integration with XDMoD. The current use case is to fetch the cloud usage for a subscription. As the XDMoD API is still in flux, we will use a reference implementation called vortex to fetch cloud usage from OpenStack.

difference in expiration date of subscription and status

Seems like the status is not getting changed to expired when the expiration date is hit. Look at subscription 781. In the Coldfront interface, the user sees the subscription as expired but in the admin interface it is showing up as active.

username search (also part of add user)

If I choose to search for username only and then try the same but adding an asterisk, it gives me differing results.

Add slurm integration

When a user is added or removed from a subscription the corresponding slurm association should be created or removed.

Ajax view methods should return 401 for unauthenticated users

Any view method that serves ajax calls using LoginRequiredMixin will redirect unauthenticated requests to the home page. These should be fixed to return 401 or json to indicate the user is not authenticated.

implement "expire notification" function on subscription

Allow admins to set an attribute on a subscription that will prevent users from getting expiration notification emails. This is different than issue #2 and is used for things like courses where the PI doesn't need to renew the subscription

As PI, should only be allowed to request subscriptions for certain resources

Seems like the AllowedGroups attribute on resources isn't being honored when requesting a new subscription. As a PI, I can request a new subscription to anything. This should not be the case.

Adding attributes cause attribute value error

While try to add attributes to a resource we get the following errors. They seem to have valid values for the attribute type. Am I missing something?

Attribute type is "Paid"

	Subscription attribute type	Value	Delete?
Invalid Value "50000.00". Value must be a float.

Attribute tyoe is "PO"
Invalid Value "006778766". Value must be an integer.

  |  

check all subscriptions by default when adding new users to project

When adding new users to a project, auto-select all subscriptions on the project to add the user to, rather than force the PI to select them all individually

Add version info page to admin menu

should be an easy way for admins to tell what version of coldfront they're running

PI can't see subscription with status of 'new'

Once a status is switched to pending, the PI can see it but when it's 'new' it is not displayed

README.md

Thanks for releasing the code!

Please add "yum install epel-release" to README.md in order to install Python 3.6 on Centos 7.5.

Enforce attribute constraints on resources and subscriptions

Allow attributes to require unique constraints.

Add cc to project review email and cc admins

Project review email should have a cc field and by default the cc should include the admins.