1

Topic: Downloads in DwC do not contain VC or other computed geo values

For each record, the 'Additional political boundaries information' section shows a comprehensive set of areas, including three variants of Vice County, computed by the Atlas itself based on each record's original geolocation. However, none of this is included in the Darwin Core format export, so anyone using the records has to have a GIS system to recompute the values they need.
Please extend the export CSV by a few columns to include at least the 'Watsonian Vice Counties - 12 mile' and 'Districts, Boroughs and Unitary Authorities (Great Britain)' values.

David Hepper
Records Officer, British Dragonfly Society

2

Re: Downloads in DwC do not contain VC or other computed geo values

Hello David,

Sorry for the delay on replying to this post. Whilst the 'Additional political boundaries information' is not available in the Simple Spreadsheet or Full Darwin Core download formats, this information can be included when using the Custom download format.

However, I have identified that the Custom download format is not working as expected. There is an option to include contextual layer fields (e.g., returns Vice county record is indexed to) but these fields are not being included in the download.

As mentioned previously, we are currently underway with implementing data pipelines, which will change how records are processed on the NBN Atlas. Therefore, it will be more efficient to focus on identifying if this issue exists with data pipelines, and if so resolving it for data pipelines as we will be making the switch soon.

However, in the meantime, if you would benefit from including vice county information (and any other layer information) now, this is possible using the Occurrence download webservice. If you need support with using this web service, please let me know.

Thank you.

Kind regards,
Rhiann

Rhiannydd Stock
NBN Atlas Support Officer

3

Re: Downloads in DwC do not contain VC or other computed geo values

I have had another request for this feature (from a BDS member and NBN Trust hon. member).
How are you doing with Data Pipelines and do these now allow export to spreadsheet of a VC number with each record? If not please point me to the 'Occurrence download webservice', though I'd rather not have to learn another export mechanism.
Regards,
David

David Hepper
Records Officer, British Dragonfly Society

4

Re: Downloads in DwC do not contain VC or other computed geo values

Hi David,

Data Pipelines is not live yet but we are very close, we are currently working on completing the ingestion of production data (i.e., data currently on the NBN Atlas). Unfortunately this means that the issue with Custom download has not been resolved. We do apologise for this and for any inconvenience caused.

Here's the link to the NBN Atlas Occurrence download web service - https://api.nbnatlas.org/#ws4

Here's a suggested workflow for using the Occurrence download ws for your use case:

1. Complete an occurrence search as normal

2. Append the 'q' and 'fq' parameters from the search URL to the Occurrence download ws, e.g.,
'https://records-ws.nbnatlas.org/occurrences/index/download?q=lsid:NBNSYS0000005645&fq=-occurrence_status:"absent"'

3. Then you will need to append the other required/optional parameters for the ws to the URL. All parameters need to be joined by the '&' symbol. The required parameters are:
a. 'email' (required) - the email for your NBN Atlas account
b. 'reasonTypeId' (required) - see reasonTypeId options here - https://logger.nbnatlas.org/service/logger/reasons
c. 'qa' (optional) - supply 'none' for this parameter if you do not want data quality fields to be included in your download
d. 'dwcHeaders' (optional) - supply 'true' for dwc header names to be used, otherwise the names used in the 'Simple spreadsheet' download format will be used.
e. 'fields' - this is the parameter you will use to included the specified vice county field. You can copy the below text for this parameter, which includes the fields included in the 'Simple spreadsheet' download format and the field name for the vice county field. I have also attached the string of fields as a text file in case you have any trouble copying the test below.

id,occurrence_id,license,rightsholder,taxon_name,scientific_name_authorship,nomenclatural_status,common_name,taxon_concept_lsid,rank,occurrence_status,occurrence_date,day,month,year,occurrence_date_end_dt,end_day,end_month,end_year,raw_locality,grid_ref,longitude,latitude,coordinate_uncertainty,raw_depth,collector,identified_by,individual_count,organism_quantity,organism_quantity_type,organism_scope,organism_remarks,raw_sex,life_stage,occurrence_remarks,identification_verification_status,basis_of_record,collection_code,data_resource,data_resource_uid,data_provider,data_provider_uid,institution_code,kingdom,phylum,class,order,family,genus,grid_ref_100000,grid_ref_10000,grid_ref_2000,grid_ref_1000,country,state,vitality,cl256

4. Once you have built the URL, simply search for the URL in your internet browser and the download will be completed.

Please let me know if you have any questions or need further support.

Post's attachments

default_download_fields&vice_county_field.txt 733 b, file has never been downloaded. 

You don't have the permssions to download the attachments of this post.
Rhiannydd Stock
NBN Atlas Support Officer