saikirandd/sunrisers

Sunrisers

Project Number: 02

1. Nishanth reddy, Devi Reddy([email protected])
2. Saikiran, Doddapaneni([email protected])
3. Yeshwanth reddy, Anumula([email protected])

Course

44517-02

Links:

• GitHub repo

• issues link

Project Introduction:

Our project is about weather in major cities of Australia, that includes temperature, wind speed, pressure, rainfall.

Data source:

• weather data source , data is of size 13.5 mb, which is in CSV format. Data is strucutred. It has 142190 rows and 11 columns. It is updated every year. Data is reliable.

Commands

1. To run Mapper code:

Type "python 1mapper.py" in powershell or terminal

1. To run Reducer code:

Type "python 3reducer.py" in powershell or terminal

Big data problems

Sai Kiran Doddapaneni

• Question 1: For each location, find avg rainfall

Solution: Mapper input:

12/1/2008	Albury	13.4	22.9	0.6	NA	NA	W	44	W	WNW	20	24	71	22	1007.7	1007.1	8	NA	16.9	21.8	No	0	No

Mapper output:

location	Rainfall
Albury	0.6

Reducer output:

location	avg rainfall
Albury	1.95

chart: bar graph.

• 

Mapper screenshot

• 

Reducer screenshot

• 

Yeshwanth Reddy Anumula

• Question 2: For each location, find highest recorded MaxTemp.

Solution: Mapper input:

12/1/2008	Albury	13.4	22.9	0.6	NA	NA	W	44	W	WNW	20	24	71	22	1007.7	1007.1	8	NA	16.9	21.8	No	0	No

Mapper output:

location	MaxTemp
Albury	22.9

Reducer output:

location	highest MaxTemp
Albury	44.8

chart : Bar graph

• 

Mapper screenshot

• 

Reducer screenshot

• 

Nishanth Reddy Devi Reddy

• Question 3: For each location, find lowest recorded MinTemp

  Solution: Mapper input: | 12/1/2008 | Albury | 13.4 | 22.9 | 0.6 | NA | NA | W | 44 | W | WNW | 20 | 24 | 71 | 22 | 1007.7 | 1007.1 | 8 | NA | 16.9 | 21.8 | No | 0 | No | |-----------|--------|------|------|-----|----|----|---|----|---|-----|----|----|----|----|--------|--------|---|----|------|------|----|---|----|

Mapper output:

location	MinTemp
Albury	13.4

Reducer output:

location	lowest MinTemp
Albury	-2.8

Mapper screenshot

• 

Reducer screenshot

• 

chart: Bargraph

• 

sunrisers's Issues

find lowest recorded Minumum temperature for every city

add dataset

find average rainfall for each location

For different locations find average rainfall

find highest recorded maximum temperature of all cities

add .gitignore

Adding gitignore to the repo

write introduction

maximum temperature for each location

find max temperature

Readme.md file creation

create readme.md

for each loaction, find average rain fall.