lukeprior / nbn-upgrade-map Goto Github PK

View Code? Open in Web Editor NEW

91.0 91.0 10.0 5.93 GB

Interactive map showing premises eligible for the NBN FTTP upgrade program.

Home Page: https://lukeprior.github.io/nbn-upgrade-map/

License: MIT License

Python 65.04% HTML 13.59% Dockerfile 1.24% Shell 2.46% JavaScript 17.45% CSS 0.23%

australia nbn

nbn-upgrade-map's Introduction

👋 Hi there

📕 Latest Blog Posts

nbn-upgrade-map's People

Contributors

Stargazers

Watchers

Forkers

kuchel77 lyricnz televisi loomonop majibow justinclift fn5 nathan-cloudsmith mingozhangaus ssmith-github terrapinlogo

nbn-upgrade-map's Issues

CANBERRA

WA

Butler – 6036
Merriwa – 6030
Clarkson – 6030
Ridgewood – 6030

Chelsea in Vic

Ettalong Beach NSW 2257

Thanks for this resource!

deception bay

Doolandella, Forest Lake, Inala, Heathwood

please and thanks

Fix techFlip, reasoncode

I received this message from a user

I noticed in some of the data that it appears to be losing the premises that have done the tech flip some time ago where nbn removes the altReasonCode from the json once the original FTTN is disconnected.

Perhaps if it is reasonCode: "FTTP_CT" and techFlip: true you could leave it in the extracted data set to fill in the missing dots? Perhaps a new category to distinguish upgraded from original FTTP?

e.g.

"id": "LOC000107398763",
"latitude": -33.43858117,
"longitude": 149.61829671,
"reasonCode": "FTTP_CT",
"changeoverDate": "15 July 2050",
"patChangeDate": "Apr 2022",
"patChangeStatus": true,
"techFlip": "Yes",

Where its a recent switch and they still have an active parallel FTTN service connected, they do show up, I'm guessing because altReasonCode still exists?

e.g.

"id": "LOC000078509381",
"latitude": -33.43905317,
"longitude": 149.61801771,
"reasonCode": "FTTP_CT",
"altReasonCode": "FTTN_CT",
"changeoverDate": "15 July 2050",
"patChangeDate": "Apr 2022",
"patChangeStatus": true,
"techFlip": "Yes",

Can you Please add Traralgon? (3844)

South Cairns

Mount Sheridan 4868
Edmonton 4869
White Rock 4868
Woree 4868
Earlville 4870

New location: Paralowie, SA

Documentation about how to run locally?

It would be nice if there was a TLDR on how to run it locally, and view the results.

Port Macquarie 2444, Lake Cathie 2445 and Wauchope 2446

Awesome tool.
Would be awesome if we could visualise the NSW postcodes 2444, 2445 and 2446.
Thanks!

Helensburgh, NSW

Hey, the map is great. This is just a request for Helensburgh NSW to be added please :)

Mount Coolum 4573

New location please: Somerville, VIC

historic NBN Technology WMS layer

Sent from a user

historic NBN Technology WMS as a layer underneath the dots to be able to reference the ADA boundaries. Might make a bit more sense as to the patterns of which house have it and which don't...

https://data.gov.au/dataset/ds-dga-c79b2219-7e1f-46a9-961f-e87668122f02/distribution/dist-dga-e38ac9e6-3ba1-4369-a063-ca6402e05589/details?q=

Dural 2158

Addresses missing from map

Manually generated the map output for Somerville, VIC per #33

FWIW a bunch of addresses seem to be missing from the map (those on "Eramosa Road East" and "Eramosa Road West" for example). Possible mishandling of street_suffix in DB?

SELECT * FROM gnaf_202302.address_principals WHERE locality_name = 'SOMERVILLE' AND state = 'VIC' and address like '%ERAMOSA ROAD %' LIMIT 100000

Bexley North NSW 2207 please

And great job, thank you!

Mitchell Park, Clovelly Park, Edwardstown, St Marys SA

Hi, Great website! can you please add the suburbs above if possible? They have all been on various upgrade lists over the past 2 years.Thank you!

Bella Vista NSW 2153 North Rocks NSW 2151 ??

Any chance you could also add Bella Vista NSW 2153 and North Rocks NSW 2151 ??

Kellyville, NSW 2155

Noosa

Parkwood (6147)

Add local caching for requests to NBNco

Performance, debugging, adding features.

Orange, Bathurst & Parkes

Glenwood NSW

Can you please add Glenwood NSW 2768

Port Douglas

Craiglie 4877 and Mossman 4873

6BSD locations

Would be amazing if you could add 6BSD related suburbs

Ashfield, WA 6054
Bassendean, WA 6054
Beechboro, WA 6063
Bennett Springs, WA 6063
Eden Hill, WA 6054
Kiara, WA 6054

Duplicate suburbs would cause auto-next to fail?

If I understand correctly, when iterating through the states+suburbs to find the next unprocessed state, the code checks if the state-name is in the list of previously processed results.

    if target_suburb == "NA":
        suburb_list = open("results/suburbs.json", "r")
        suburb_list = json.load(suburb_list)
        
        for state in suburb_list["states"]:
            for suburb in suburb_list["states"][state]:
                flag = False
                for record in suburb_record["suburbs"]:
                    if record["internal"] == suburb:  # <==== here
                        flag = True
                        break

However, there are duplicate state names:

{'ALBERT PARK': ['VIC', 'SA'],
 'ANNANDALE': ['NSW', 'QLD'],
 'BAYSWATER': ['VIC', 'WA'],
 'BEACONSFIELD': ['NSW', 'VIC', 'QLD', 'WA'],
 'BELMONT': ['NSW', 'VIC', 'WA'],
 'CAMPERDOWN': ['NSW', 'VIC'],
 'CLAREMONT': ['WA', 'TAS'],
 'COOLANGATTA': ['NSW', 'QLD'],
 'CROYDON PARK': ['NSW', 'SA'],
 'EASTWOOD': ['NSW', 'VIC', 'SA'],
 'ENFIELD': ['NSW', 'SA'],
 'EVANDALE': ['SA', 'TAS'],
 'GRANGE': ['QLD', 'SA'],
 'HAMILTON': ['NSW', 'VIC'],
 'HIGHGATE': ['SA', 'WA'],
 'KELSO': ['NSW', 'QLD'],
 'LAKELANDS': ['NSW', 'WA'],
 'MAYLANDS': ['SA', 'WA'],
 'MILTON': ['NSW', 'QLD'],
 'MOUNT PLEASANT': ['NSW', 'QLD'],
 'NEWPORT': ['VIC', 'QLD'],
 'NEWTOWN': ['NSW', 'VIC', 'QLD'],
 'PADDINGTON': ['NSW', 'QLD'],
 'PERTH': ['WA', 'TAS'],
 'SMITHFIELD': ['NSW', 'QLD', 'SA'],
 'SORRENTO': ['VIC', 'WA'],
 'ST PETERS': ['NSW', 'SA'],
 'SURF BEACH': ['NSW', 'VIC'],
 'THE GAP': ['QLD', 'NT'],
 'TORQUAY': ['VIC', 'QLD'],
 'WATERFORD': ['QLD', 'WA'],
 'WATTLE GROVE': ['NSW', 'WA'],
 'WHITE ROCK': ['NSW', 'QLD'],
 'WOODCROFT': ['NSW', 'SA']}

Westlake, Riverhills, Middle Park, Mount Ommaney, Jindalee, Jamboree Heights. QLD

if its not too much trouble to add these as well

Don't retrieve unused data from the database (performance)

Current code does

    cur.execute(f"SELECT * FROM gnaf_202302.address_principals WHERE locality_name = '{target_suburb}' AND state = '{target_state}' LIMIT 100000")

On my machine this takes 10.4 seconds for a sample suburb (5957 rows). Fetching just the five fields we use takes 3.5 seconds.

    query = f"""
        SELECT address, locality_name, postcode, latitude, longitude
        FROM gnaf_202302.address_principals
        WHERE locality_name = '{target_suburb}' AND state = '{target_state}'
        LIMIT 100000"""

    cur.execute(query)
    rows = cur.fetchall()

Thanks!