1

Re: Downloading data from the NBN Gateway

We've been granted full download access to some data on the NBN Gateway. On downloading it, we find it doesn't contain unique NBN keys as found in Recorder. Has anyone else downloaded data from the Gateway and imported it into Recorder? Can you share any tips? How, for instance, do you handle updates?

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

2

Re: Downloading data from the NBN Gateway

Charles

My understanding is that gateway data is not intended to be  loaded into Recorder. If you want to use it then it has to be incorporated outside Recorder or you have to go back to the dataset owner and get the source data via a data exchange agreement. If you were to import it into Recorder , then you would need to delete the whole dataset when a new one becomes available and re-import it. This of course means that you can not apply your own validations etc. and would need to take steps to avoid passing the data on to others.

The data on the gateway will often be just a partial snapshot of the data held by the dataset supplier and may not include essential information (like the owner and/or custodian of the record). My understanding  is that the data from the Gateway is intended for information only (eg for including in reports) and not for incorporation as records in other datasets.


Mike

Mike Weideli

3

Re: Downloading data from the NBN Gateway

Hello Charles

If you are importing records via the NBN Gateway into Recorder then as Mike says you need to make sure you are not passing the records on to others.
The reasons for not passing the records on
1. To comply with the terms and conditions around the use NBN Gateway data (ie. always acknowledging the data providers and obtaining written permission from the data provider before disseminating any records you have been granted better than public access for)
2. Duplication of recorder keys with resulting duplication of records within the NBN.

Best wishes

Graham

4

Re: Downloading data from the NBN Gateway

Thank you Mike and Graham. What you say is pretty much what I had in mind myself. Thing is, we were explicitly told we should download the data from the Gateway and not get it direct from source (which we did originally ask for). Armed with what you've said, I'll go back and attempt to get the data directly.

Many thanks,
Charles

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

5 (edited by mbeard 26-10-2010 09:39:46)

Re: Downloading data from the NBN Gateway

Is Graham's second reason such a bad thing?  From what I have heard there are already numerous duplicate records on the NBN; if they had duplicate recorder style keys then we would have the ability to recognise them.

Mike Beard
Natural Course Project Officer
Greater Manchester Local Records Centre