Subscribe to this thread
Home - General / All posts - Linking M9 to Covid-19 data
rk
621 post(s)
#13-Mar-20 13:24

I was looking for source data behind the Covid-19 map. The site links to github. There are CSV-s with data.

Unfortunately, the "database" is three pivot tables. A bit disappointing. Still, attached is M9 project with csvserver datasources.

I created a datasource to ArcGIS REST FeatureServer too. M9 gets the capabilities, but tries to display images not "features". Am I missing something?

Attachments:
m9_Johns_Hopkins_Covid-19_v1.map

Dimitri


7,413 post(s)
#13-Mar-20 14:25

Thanks! Fascinating. Sure wish they'd post a single file called "latest.csv" or at least add a "latest" column to the time series. :-)

What is the URL connection string used for the feature server? Is there an ESRI page for it?

rk
621 post(s)
#13-Mar-20 14:58

There's an ESRI page

https://www.arcgis.com/home/item.html?id=c0b356e20b30490c8b8b4c7bb9554e7c

and the connection string is

https://services1.arcgis.com/0MSEUqKaxRlEPj5g/arcgis/rest/services/ncov_cases/FeatureServer

adamw


10,447 post(s)
#13-Mar-20 14:28

ArcGIS REST consists of multiple different services with individual servers configured to use a subset of them. We do not support all of the services available, only those that return images - tile / export. This particular server only supports vector data (the only supported operation is 'query'), we cannot retrieve that currently. We might add it in the future.

artlembo


3,400 post(s)
#28-Mar-20 22:32

in the meantime, you can use QGIS to directly connect to the url that Rivo provided, and then export the data into a format Manifold can read.

I've been doing this to keep up with some regression modeling I've been doing. Manifold's SQL is just so easy to write to associate COVID-19 cases to urbanized areas, transit zones, etc. And, QGIS has an easy one-click way to get the data from an ESRI Feature Server.

Basically, I was interested in the relationship between COVID-19 deaths and the number of mass transit riders in a location. There is a very strong relationship, but unfortunately, that is all driven by NYC. One you take NYC out of the model, the whole things falls apart.

this is probably one that needs to get added. Like it or not, pretty much every State and County in the US are serving data as an ESRI Feature Server.

Attachments:
qgisload.gif

Dimitri


7,413 post(s)
#29-Mar-20 04:20

this is probably one that needs to get added.

Agreed. Much more convenient to do it all in one system.

wvayens108 post(s)
#30-Mar-20 14:02

That would be great....so much US info at the state and county level is as an ESRI Feature Server, which for us neophytes is a challenge!

RonHendrickson
283 post(s)
#13-Mar-20 17:06

I'm not sure if this is what you are needing, but there is more than way to convert a pivot table to a normal database table within Excel and/or Power Query. If you have access to Power BI there is a similar method, easily googled.

Here is a sample video in Excel: https://www.youtube.com/watch?v=UrL-YrhlCJQ

If I have misunderstood what you are needing, please ignore.

jsperr
143 post(s)
#27-Mar-20 12:20

Blue Marble just published some COVID mapping information and links.

https://www.bluemarblegeo.com/covid-19.php

gpBike1001
48 post(s)
#28-Mar-20 22:10

Without getting into the ethical debate around privacy and data security (as others have), this from Tectonix & X-Mode on CoVID19 is fascinating and has gone viral:

https://twitter.com/TectonixGEO/status/1242628347034767361

Of interest for Manifold users and developers is the massive size of the geospatial data set involved and the rendering speed of the query result.

adamw


10,447 post(s)
#30-Mar-20 12:56

This is impressive, indeed. Thanks for the pointer!

Dimitri


7,413 post(s)
#30-Mar-20 07:46

There is a new Example topic using the Edit - Join dialog that is useful. It harvests data from the CSV web server cited by Sergio in this post and then aggregates the cases and deaths for each date into totals as of the latest report.

Manifold User Community Use Agreement Copyright (C) 2007-2021 Manifold Software Limited. All rights reserved.