Add mapping functionality to govCMS

[govcms]

Add mapping functionality to govCMS

[fiasco]

I think we'd want to understand more about the stories and what are involved to help push this one along?

[WebProject2015]

The benefit a mapping module brings over just embedding a map is that it allows you to create a dynamic view of items near a specific location, and then display that view as points on a map. Many agencies would see a benefit from this when displaying shopfronts or providers near the user. It is particularly useful where users move about frequently, or an agency lists services in overseas areas, or in regional and remote locations. The other benefit it brings is in allowing the map's views filters to be exposed to the user, thereby enabling the user to dynamically switch between different types of services or providers, as well as shift the locational bounds as required.

[nicholas-gk]

I am looking for a simple interface mostly to show data the department produces. We currently use National map, but it is not very responsive when embedded. Simple is the key, show people your data and let them search it.

1. As a user I want to zoom, pan, search and view information on data on the map with any device so I can better understand large datasets produced by the Government.
   --should be responsive
   --search would be for custom data and address search
   --the info shown would be that of custom data
2. As an administrator i want to show and set up search of my data and other street data on a map to better display my information for users.
   --data would not have to be hosted on GovCMS
   --would need to be able to read WMS, KML and various map tiling data sources.
   --Would not be tied to just one maps provider
3. As a user i want to be able to turn map layers on and off to see data in isolation or as a group.
   --this would just change the visibility for that session.
4. As an user want to use a map interface to choose a location so that I can give a more accurate and consistent location information.
   --The information could be captured along with form information
   --Possible reverse geocode

[typhonius]

Pinging @kurtsalsa as I think he was working on something similar.

[kurtfoster]

I'm implementing a front end solution at the moment. It's only POC at this moment but I'm also having the issue of search by location, which isn't available in govCMS. Do GMAP and Location provide this functionality, I thought they only provide views of all content via views on a map and location based search in drupal search, but I'm not that familiar with them.

The PoC just pulls everything back on a single map level in a json object via custom ajax and renders it using the Google Maps JS API, when the user clicks though on this level, we pull the next level in. It works well enough but this won't work well when users move the map around or zoom in etc.

I know leaflet provides search by location functionality in views, however I'm pretty sure it still uses session vars for anonymous users, invalidating varnish cache, so it's not a great option.

I think that using Map class getBounds() function I should be able to pass that into my view and pull back all of my layers with lat / long points within those bounds, regardless of their layer and get what I need. This would then work when the user zooms / moves the map etc. I can just store the updated data in the browser and avoid having to constantly retrieve it.

I'm not sure it that works for you @aleayr, but that's my workaround for govCMS.

[Pixie74943]

The DECD team requires the ability to embed maps from Google and http://www.location.sa.gov.au/viewer/ as part of our launch.

This is further complicated by the need to auto-generate these maps when importing data from a csv file using feed.

My original attempt to use an iframe has been unsuccessful as the iframe code has been blacklisted in the WYSIWYG editor.

An example of the content we need to replicate in the govCMS system can be seen here:

http://www.decd.sa.gov.au/locs/a8_publish/modules/locations_new/school_detail.asp?id=3636&type=AZ`

Can this issue be escalated? Our ideal solution would include a module that can handle embedding maps, whilst playing nicely with the feeds and feeds tamper modules.

[fiasco]

Is the data in lat long format is does it require to be geocoded?

[Pixie74943]

We use lat and long as some of our schools are on long country roads so google doesn't always display them correctly.

From the CSV file, currently we have latitude and longitude as separate fields (e.g. "34.815955" and "140.216073") which get plugged into the search as "-34.815955,140.216073"

[aleayr]

@Pixie74943, if iframes were allowed in the editor, would this be a satisfactory option for you to keep moving forward?

[Pixie74943]

I believe if iframes were accepted by the rich-text editor then it would solve our current problem.

Is this something that could be implemented in the next 48hours? If not, what is the expected timeframe?

[fiasco]

@aleayr from a broader strategy perspective, adding complex capabilities to wysiwyg editors is probably grinding against structured data initiatives. In the distro, we should add geo and gis capabilities. But to get over the line for DECD, perhaps we can give them this capability in the editor without committing such a change to the distro?

[fiasco]

I've created #162 as a beginning module capability. We'd still need to provide does and evaluate if it should be available out of the box or featurized to provide a base implementation.

[cdriessen]

@nicholas-gk @Pixie74943 - it sounds like Comms and DECD have some overlapping requirements in regarding to mapping functionality. Comms currently uses iFrames to embed the National Map - https://www.communications.gov.au/what-we-do/internet/competition-broadband/telecommunications-new-developments-map
@nicholas-gk may be able to provide some feedback on how this interim solution is currently working from a management/publishing perspective...

[WebProject2015]

@kurtsalsa With the gmap module you create your view and add "Search: Search Terms" as an exposed filter. The search terms work with the Location module if youv'e set up geocoding and have geocoded data for the items in your view. The exposed filter search box just filters the items in the view which is being mapped, so from an end user's perspective it just narrows down the number of items on the map. You'd need to spin up a local environment to see if it meets your specific needs, however it is usually pretty good. We think Gmap is certainly a much better solution than iframes.

[kurtfoster]

@WebProject2015, agreed re the iframes. The addressfield module is already in govCMS, so I'm not sure if that could be leveraged instead of also adding Location @fiasco?

We're still in PoC phase at the moment and our use case is a little different. We need to display very large polygons with a large number of points, rather than individual points on a map, the search is by clicking on a polygon, then the map should zoom in and show the polygons that existing within that polygons area. I'll take a look to see if GMap will help with our requirements.

[fiasco]

@kurtsalsa my PR was really just to get some conversation happening. I too would like to see if we could achieve our objectives here with less. Perhaps the geocoder module would be a better fit over the location module?

[pandaskii]

mapping in Drupal 7 is quite interesting - from 1-2 modules simple task to "mapping module suite" that can provide robust features and APIs.

Two very useful links regarding "Drupal mapping" are on Drupal community:

• Comparison of mapping modules https://www.drupal.org/node/1704948
• Drupal Mapping Diagrams https://www.drupal.org/node/1807358

Not only Google map, mapping also brings many other popular frameworks and service providers into the panels.

For example. data.gov.au(http://data.gov.au/dataset/acnc2014ais) uses "Map box"(https://www.mapbox.com/about/maps/), leaflet (http://leafletjs.com/) and OpenStreetMap(https://www.openstreetmap.org) Some government sites uses OpenLayers http://openlayers.org/ for advanced mapping features such as GeoScience Australia, State of Victoria gov site.

IMO, before moving into this mapping area, iFrame is a good solution for urgent and small requirements. On another side, we can start from collecting more generic user requirements, modules analysis, hardware requirements such as higher memory or more storage space, UI and mapping accessibility etc.

[Pixie74943]

@cdriessen We have the ability to use iFrames if we are creating individual pages (I've created a text format that accepts iframe) however when using the feeds import it does not accept the iframes. From what I can see this is because it's importing into the Rich-text format and will not allow me to import into a different text format.

For us to get what we need from a module/extension/upgrade we need to be able to import data (Long and Lat) via the feeds module and have a map auto generated. This seems slightly different to Dept Comms needs (correct me if I am wrong) - we are generating locations for 900+ schools and education sites, so manual isn't a viable option.

I've only had a cursory look at the locations and gmap modules, however I was unable to connect them with Feeds. I placed a locations field in my content type and manually entered long and lat - giving me the map I needed. However when I went over to the Feeds module, I was unable to select this locations field as a mapping option.

[pandaskii]

@Pixie74943

Need a "fields mapping module" for feeds in your case

Check this out "feeds location module" https://www.drupal.org/project/location_feeds

This is only from technical side regrading "unable to select this locations field as a mapping option" :)

[Pixie74943]

I've just had an unofficial chat with a developer friend of mine and we've nutted out a workaround for using iframes via the import that is working quite nicely. We've created a new text format and set it as the default for the importer.

I still need to test it in the live site to be 100% it all works as it does in the test environment. The iframe solution obviously isn't the best for accessibilty, but it will get us over the line :)

[Pixie74943]

@jozhao Thanks 👍 that looks perfect (haven't tested it)

[WebProject2015]

@jozhao Last commit was 3 years ago, there also hasn't been an issue closed or a bug fixed in three years. The maintainer has at least commented on bugs within the past 12 months, but it would appear only to ask for other maintainers.

[pandaskii]

True. Many modules in Drupal community are as this one. Even in current govcms code base, we may notice this point more or less. So is Drupal core, we are still trying to push a book module fix on both 7 and 8 which has been discussed for 6+ years since 6. :)

I didn't suggest adding this one into govcms code base, instead, as Josh and Jason, we are trying to keep govcms code base in a scaleable and stable condition.

Back to this discussion, iFrame can resolve urgent and small requirements. We need a careful plan and analysis the generic requirements before setting up a govcms mapping solution.

On 10 Feb 2016, at 6:33 PM, WebProject2015 [email protected] wrote:

@jozhao Last commit was 3 years ago, there also hasn't been an issue closed or a bug fixed in three years. The maintainer has at least commented on bugs within the past 12 months, but it would appear only to ask for other maintainers.

—
Reply to this email directly or view it on GitHub.

[kurtfoster]

I just thought I'd see if anyone had an opinion on the views json output / Google Maps js API solutions we're using. I'm not sure if it fits your use case, but it's working well and we don't require an iframe.

[kring]

Hi everyone, I'm the lead developer of NationalMap and its underlying library, TerriaJS, at NICTA / Data61. It sounds like you at least considered using NationalMap with GovCMS and maybe ran into some difficulties, so I wanted to introduce myself in case I can help. We have seen several Australian government web sites embed NationalMap via an iframe now, and there are more options for tweaking there than may be immediately apparent. We're also in the process of some UI changes that will, among other things, make NationalMap much more usable inside smaller windows. Lastly, for advanced scenarios, it's possible to use TerriaJS inside a div on a web page in much the same way you would Leaflet or Google Maps.

Let me know if I can help. My email address in on the web page linked from my github profile if you want to contact me directly.

[fiasco]

Services module has now been committed which can provide the functionality for this issue. Please create a new ticket if it does not.