pppk520/scope_workflow_visualizer

for SCOPE and Workflow

SCOPE & DWC Workflow Visualizer

This project works on a simplified Microsoft SCOPE language parser to automatically generate logic graph from scripts.

Implemented with:

• pyparsing
• graphviz

Packages

$ pip install -r requirements.txt

Example

The following SCOPE script

#DECLARE MyFile1	string = "/path/to/myfile1.ss";
#DECLARE MyFile2	string = "/path/to/myfile2.ss";

#DECLARE MyOutputFile	string = "/path/to/output.ss";
#DECLARE MyOutputFile1	string = "/path/to/output1.ss";

Data1 =
SELECT RGUID,
    ListingId AS OrderItemId,
	HourNum
FROM (SSTREAM @MyFile1);

Data2 =
SELECT RGUID,
    ListingId AS OrderItemId,
	HourNum
FROM (SSTREAM @MyFile2);

Data = SELECT
            RGUID,
            OrderItemId
       FROM Data1
       JOIN Data2 ON Data1.RGUID == Data2.RGUID
       WHERE OrderItemId != 0;

OUTPUT TO SSTREAM @MyOutputFile;
OUTPUT Data1 TO SSTREAM @MyOutputFile1;

The output will be like this:

scope_workflow_visualizer's Issues

Images for README

Mixing func and string cat

@OutputFolder.Trim()+@"/CookedBulkApiLogs/FilteredBulkApiLog_"+@TodayStr+".ss" will be parsed as func_chain

@"/CookedBulkApiLogs/FilteredBulkApiLog_" + @OutputFolder.Trim() + @TodayStr+".ss" will be parsed as str_cat

Need to handle inner func of str_cat

#IF statement understanding

#DECLARE INPUT_PATH string = "@@INPUT_PATH@@"; 
#IF (@INPUT_PATH.Contains("INPUT_PATH"))
    #SET INPUT_PATH = @OPT_SHARE_PATH + @"/BroadMatchSuggestion/";
#ENDIF

For now it keeps IF body no matter the condition is but some path settings are conditional.

May use 'Contains' in IF_statement to deal with this path trick

declare map doesn't follow script sequence

#DECLARE Path string = "111.ss";
OUTPUT data TO SSTREAM @Path;

#SET Path string = "222.ss";
OUTPUT data TO SSTREAM @Path;

will make data output to 222.ss only