- Nishanth reddy, Devi Reddy([email protected])
- Saikiran, Doddapaneni([email protected])
- Yeshwanth reddy, Anumula([email protected])
44517-02
Our project is about weather in major cities of Australia, that includes temperature, wind speed, pressure, rainfall.
- weather data source , data is of size 13.5 mb, which is in CSV format. Data is strucutred. It has 142190 rows and 11 columns. It is updated every year. Data is reliable.
- To run Mapper code:
Type "python 1mapper.py" in powershell or terminal
- To run Reducer code:
Type "python 3reducer.py" in powershell or terminal
- Question 1: For each location, find avg rainfall
Solution: Mapper input:
12/1/2008 | Albury | 13.4 | 22.9 | 0.6 | NA | NA | W | 44 | W | WNW | 20 | 24 | 71 | 22 | 1007.7 | 1007.1 | 8 | NA | 16.9 | 21.8 | No | 0 | No |
---|
Mapper output:
location | Rainfall |
---|---|
Albury | 0.6 |
Reducer output:
location | avg rainfall |
---|---|
Albury | 1.95 |
chart: bar graph.
- Question 2: For each location, find highest recorded MaxTemp.
Solution: Mapper input:
12/1/2008 | Albury | 13.4 | 22.9 | 0.6 | NA | NA | W | 44 | W | WNW | 20 | 24 | 71 | 22 | 1007.7 | 1007.1 | 8 | NA | 16.9 | 21.8 | No | 0 | No |
---|
Mapper output:
location | MaxTemp |
---|---|
Albury | 22.9 |
Reducer output:
location | highest MaxTemp |
---|---|
Albury | 44.8 |
chart : Bar graph
-
Question 3: For each location, find lowest recorded MinTemp
Solution: Mapper input: | 12/1/2008 | Albury | 13.4 | 22.9 | 0.6 | NA | NA | W | 44 | W | WNW | 20 | 24 | 71 | 22 | 1007.7 | 1007.1 | 8 | NA | 16.9 | 21.8 | No | 0 | No | |-----------|--------|------|------|-----|----|----|---|----|---|-----|----|----|----|----|--------|--------|---|----|------|------|----|---|----|
Mapper output:
location | MinTemp |
---|---|
Albury | 13.4 |
Reducer output:
location | lowest MinTemp |
---|---|
Albury | -2.8 |
chart: Bargraph