griddynamics/behavior-analytic-starter-kit

Behavior Analytic Starter Kit

behavior-analytic-starter-kit's Issues

UX: split jobs in applications view to different sections

Possible sections:

1. Operate e-chop catalog.
2. Calculation jobs
3. Maintenance

There is function 'add datanodes', but no 'reduce number of datanodes', it makes me out of control, it is sad

Issue, while trying to upload new product catalog

https://griddynamics.undeploy.me/organizations/520c6a22e4b04a3226c36708/instances/520ca9b7e4b04a3226c36769

Exception in thread "main" org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory /tmp/transaction_log already exists
at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:132)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:985)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:946)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:946)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:566)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:596)
at com.griddynamics.deming.hadoop.JobUtil.runJob(JobUtil.java:19)
at com.griddynamics.deming.data.generator.HadoopDataSetGeneratorRunner.startGeneratingJob(HadoopDataSetGeneratorRunner.java:93)
at com.griddynamics.deming.data.generator.HadoopDataSetGeneratorRunner.run(HadoopDataSetGeneratorRunner.java:48)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at com.griddynamics.deming.data.generator.HadoopDataSetGeneratorRunner.main(HadoopDataSetGeneratorRunner.java:155)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:208)

Research how to add new association rules learning algorithm to recommendation processor

Now we use PFP-Growth algorithm to find frequent patterns and build association rules.
Need to research how to add new association rules algorithm.

Please, change the UI for right-click menu over application jobs

'Advanced' menu option over the job is awful, one can miss the item and click on another job accidentally.

Unknown network issues, that appear with no explanation, and then dissapear

Problem while trying to view HDFS

execution of Download_transaction_log failed

S3 bucket name deming, S3 transaction file name sl_tr_log

ArgumentError
-------------
Source /tmp/transaction_log/sl_tr_log not found!
...
[2013-08-15T10:42:02+00:00] FATAL: ArgumentError: Source /tmp/transaction_log/sl_tr_log not found!

re-run of transaction log generation causes exception

13/08/15 10:10:40 ERROR security.UserGroupInformation: PriviledgedActionException as:hdfs (auth:SIMPLE) cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory /tmp/transaction_log already exists
Exception in thread "main" org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory /tmp/transaction_log already exists
    at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:132)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:985)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:946)
    at java.security.AccessController.doPrivileged(Native Method)...

Need to rename "Sample Store" to "Web Store"

Not clear what Download_transaction_log does, but Upload_transaction_log transfers log file to S3 bucket.

Multiple items in cart - no recommendations