mydlp/mydlp

An open source data loss prevention solution.

mydlp's Issues

Thrift package shoul contain a build dependency to cdbs package

As defined in title..

Need to add minimum text length limit for bayes_match

.

OCR support could be added for images.

http://code.google.com/p/tesseract-ocr/
http://github.com/hoffstaetter/python-tesseract/
http://code.google.com/p/tesseract-ocr/wiki/TrainingTesseract3

Exceptions on handling MHT files.

.

Deny pages should be refined.

.

Source Code Detection should be implemented for MyDLP NW

.

No need for running matchers for empty files

.

SMTP FSM could be refined.

.

/etc/init.d/mydlp restart does not work

It prints

medra@ubuntu:~$ sudo /etc/init.d/mydlp restart

• Stopping MyDLP mydlp
  ...done.
• Stopping MyDLP Python Backend mydlp
  ...done.
• Stopping MyDLP Java Backend mydlp
  ...done.
• Starting MyDLP Java Backend mydlp
  ...done.
• Starting MyDLP Python Backend mydlp
  ...done.
• Starting MyDLP mydlp
  ...done.

However open ports are:

medra@ubuntu:~$ sudo netstat -pltn
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 2115/apache2
tcp 0 0 0.0.0.0:9090 0.0.0.0:* LISTEN 1633/python
tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN 1920/mysqld
tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 2115/apache2
tcp 0 0 0.0.0.0:4369 0.0.0.0:* LISTEN 833/epmd
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 1739/sshd
tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 1632/cupsd
tcp6 0 0 :::9000 :::* LISTEN 2195/eclipse
tcp6 0 0 :::10000 :::* LISTEN 2195/eclipse
tcp6 0 0 :::22 :::* LISTEN 1739/sshd
tcp6 0 0 ::1:631 :::* LISTEN 1632/cupsd

mydlp_api:get_text should handle compressed files like mydlp_acl

same extraction mechanism should be used by mydlp_api:get_text too. Also, recursion limit may be added.

Thrift interface should support multiple group membership for a file

Need to add file_id field to sentence_hash and file_hash tabs.

.

SMTP deny page shoud use new mechanism

.

RTF functionality should be tested.

RTF text extraction
Regex performance on binary RTF

regexes in scode regex suite could be refined

.

Bug in rm_trailing_cflf

# CRASH REPORT <0.8541.0> 2010-09-06 10:39:48

Crashing process
initial_call {mydlp_icap_fsm,init,['Argument__1']}
pid <0.8541.0>
registered_name []
error_info
{exit,{{badmatch,"b:"},
[{mydlp_icap_fsm,rm_trailing_crlf,1},
{mydlp_icap_fsm,'HTTP_HEADER',2},
{gen_fsm,handle_msg,7},
{proc_lib,init_p_do_apply,3}]},
[{gen_fsm,terminate,7},{proc_lib,init_p_do_apply,3}]}
ancestors [icap_socket_sup,icap_sup,mydlp_app,<0.45.0>]
messages []
links [<0.218.0>]
dictionary []
trap_exit true
status running
heap_size 6765
stack_size 24
reductions 231833


License

IPR like user tab should be implemented.

.

Code repetition in mydlp_mnesia.

In handle_call functions, in order to make async mnesia query same code repeated more than once. Should be refined.

Process Groups should be supervised.

.

Should provide Squid3 SSL packages.

.

make run command fails in src/backend

Should handle absence of /var/run/mydlp directory.

Should not truncate data tabs on compileFilters

.

ODT and OOXML to text refinements.

On some files extracts some redundant text.

Truncate tabs needed before compile filters

.

Should provide i386 packages from downloads.medratech.com

.

Sentence hash matcher could use NLP TR too.

.

Thrift interface should support file removal from a group

Protocol definition for ACL rules should be defined.

.

Should handle exceptions better on Thrift Client

.

Chunked transfer encofing for HTTP module should be examined.

Probably contains some bugs.

Quarantine should be implemented for MyDLP NW

.

Installation issue!

Any suggestions on how to deal with these errors? I'm new to these softwares. Thank you in advance.

Error at installation using source code

I am trying to install MyDLP using this source code but i keep getting this error.

I think the problem is related to Erlang/OTP so I tried installing using different versions of Erlang/OTP from 17.0 to the latest version 24.0 but always the same error concerning the application asn1.
I need to install a DLP solution for a school project, and the only solution that matches the objectives of the project is MyDLP.
So I was wondering if it's still working, and if so, please provide me with the versions of the packages used.

Log for content blocking

Currently in log file, it writes Files: "filename". It should write Files: "content" for content

Repository no longer exists?

Can't seem to install from http://ftp.linux.org.tr anymore. Any mirrors available?

Quarantine mechanism should be refined.

Probably hashes instead of filenames could be used. And a tree structure for better filesystem performance.

Application config load from mnesia

.