danieldi96/sd_communicationpractice

MapReduce

This is an implementation of MapReduce in python using The PyActor library.

This project consists in the first Distributed Systems practice of URV.

Script's Usage

Using master:

python master.py (num_mappers) (ip*) (program*)
    ip* = If ip is "localhost" it's equal to '127.0.0.1'.
    program* = It can be 'WC' or 'CW' for 'WordCount' or 'CountWord', respectively

Using mapper (many terminals as mappers you want):

python mapper.py (id_mapper*) (ip*)
    id_mapper* = '0 to N-1' mappers you have in master.py.
    ip* = If ip is "localhost" it's equal to '127.0.0.1'.

Tutorial of PyActor

PyActor has many examples and a tutorial explaining all its functionalities. This examples can be found in the 'pyactor/examples' directory of the project. They are also explained in the documentation as a tutorial, hosted at readthedocs.org.

Installation of PyActor

Install with:

sudo pip install pyactor

or Install using:

python setup.py install

Check that works executing the examples:

cd examples
python sample1.py
...