wenox/data-anonymization

Data anonymisation web platform

data-anonymization's Issues

Dockerfile for frontend

Frontend should run as a separate container

API: user login

For now the logging in can be stateful session-based. Later on implement stateless JWT-based authentication as described in #29.

Uploader module

Responsible for storing the uploaded file (db, json, csv) and performing related activies, such as:

• file correctness valildation (e.g.: is it valid json?)
• database restoration (creating database from dump)
• managing API resources, such as FileEntity

Registration form

Blacklist schemas and tables

Develop functionality that allows blacklisting the selected schemas / tables, from serialization into worksheet template metadata.

Blacklisting coudl have different scopes:

• system wide (defined by application developer)
• per account
• per worksheet template

Create storage service

Responsible for managing uploaded files.

Create implementation using local file system.

User registration

Endpoint declarative validation

Add dependency to pom.xml

Role-based secure controller endpoints

Extend Hibernate functionality with hibernate-types library

Admin: block/unblock users

Create backend and frontend

Pagination for users management table

Adapt backend and frontend code

Implement WorksheetTemplateFlowManager

Add requests logging filter

Should log all incoming http requests

Refresh token JWT

Implement logic responsible for refreshing JWT token

Prevent page refresh on redirections

Some redirections cause redundant page refresh

API: retrieve worksheet template status

GET: /api/v1/worksheet-templates/{uuid}/status

For now it can return String. Later on the String should be replaced with enum status.

Later on authorization should be added: only worksheet template owner can retrieve its status (and possibly admin as well).

Admin: edit existing users

Admin should be able to edit some of user properties.

Admin should not be able to directly change the e-mail address, password, lastLoginDate, registeredDate, blockedDate, removedDate, removalRequestedDate, forceRemoval, markedForRemoval, verified.

Add and manage Worksheet Template

Reset password

Link metadata file with template

Extend User with extra business properties

Add the following properties to the User:

• name
• surname
• purpose
• verified
• markedForRemoval
• forceRemoval
• removalRequestedDate
• removedDate
• blockedDate
• registeredDate
• lastLoginDate

Dynamic database connection

Refactor blocked User property

blocked: boolean property should be status: Enum{ ACTIVE, BLOCKED, REMOVED }. Adapt backend and frontend to this change.

Enable asynchronous events

WorksheetTemplateCreatedEvent should be handled asynchronously

Implement JWT based authentication

Enable h2 console for development

Add validation to user registration DTO

Add Spring Security

Database metadata extractor

Admin: create new users

Admin should be able to directly create new verified accounts.

Executing arbitrary command line from Java code

Concurrent file upload problems

Ocassionally POST: /api/v1/worksheet-templates will fail with NoSuchFileException when calling multipartFile.getInputStream(). The problem becomes significant when processing multiple requests concurrently.

This is likely caused by asynchronous processing: the input multipart object is destroyed before it is processed.

Create FileDTO data transfer object that will contain the data of MultipartFile object.

AC:

• no exceptions are thrown when multiple POST requests are fired concurrently

Login form

Create mail sender service

The service should be able to send basic mail messages, for now.

Move secrets to distinct secrets.propertires, for now.

Create files controller

Create endpoint:

• POST: /api/v1/files

AC:

• requires multipart file and request param type
• acceptable request params: json, csv, psql, mysql
• should store the file on the filesystem

UserContext: re-fetch user after manual page refresh

AC:

• don't rely on localStorage
• disable rendering until user is fetched

Maven as a backend build tool

Admin: manage users through users management table

API: retrieve worksheet template metadata

GET: /api/v1/worksheet-templates/{uuid}/metadata

Create React and TypeScript based frontend

AC:

• frontend starts up successfully

Request close account

This duplicates #86

Create Spring based backend

Database metadata: add support for primary and foreign keys

Extract information about primary and foreign keys

PostgreSQL as database

Replace H2 with PostgreSQL

AuthContext as authenticated user storage

Redirections: user context

BCrypt user password encoding

Investigate db version compatibility when importing a new dump

Can a PostgreSQL 13 dump be imported into PostgreSQL 14 database, or vice versa?

Establish event flow for uploader module

Consider possible failures, such as:

• template upload failure
• database restore failure
• metadata extraction failure
• metadata persistence failure
• ..