jsquar/cato

Automatic source transformation to apply HPC frameworks with minimal user interaction

cato's Issues

control netCDF error checking via env

Design feedback component

What shall the workflow look like to inform the user, what Cato did and what the user should do?

• Decompile transformed IR into oringal language? (discouraged, probably not human readable anymore)
• Text feedback in the end:
  • Line count of replacement
  • Estimation of difficulty level if done by hand
  • Links to tutorials/user guides on how to use the framework yourself

Logo

Cato needs a logo

sanity check nc_close

Is nc_close called on every ncid?

Feedback for compression replacement

use nc_var_par_access after variable definition

Currently nc_var_par_access is only used after inquiry call (probably ro-access), but should also be added after variable definition (probably rw-access).

Integrate FileCheck in test infrastructure

Currently output is simply diffed, this could also be done with FileCheck from the LLVM tool suite

Improve user guidance component

• shell script for easy access
• Extend existing documentation for MPI
• Extend existing documentation for netCDF

Don't repeat yourself in netCDF component

Multiple requests are performed multiple times instead of saving the results for reuse within the netcdf objects

Add netCDF tests

Documentation

The documentation needs to be created to elevate from source comments. Possibilities:

• Read the docs
• static github page

Rebase to LLVM15

Update LLVM interaction to make use of LLVM15 and the new pass manager

New component: Compression

Add compression for file I/O:

• Make use of tools, which determine optimal selection of compression algorithms for analysed output data
  • Trade off between ratio and bandwidth
• Only in-memory compression (compression after file has already been written, does not sound like a use case for CATO)

Improve logging

Currently there is no debug logging component, to ease following the performed code transformation (e.g. which replacement code has been chosen etc.)

New UML overview

Create new UML overview (abstracting the single component, shift focus on more general components) to stress sandbox character of tool

Allow rw access using nc_open

README.md

Write a better README.md

Feedback for parallel IO replacement

Feedback for MPI replacement

Integrate existing OpenMP-MPI replacement into feedback workflow

New component: parallel I/O with NetCDF