1

Re: Tools for Validating

Trevor James has just circulated a (draft) paper for comment "Improving wildlife data quality: guidance on data verification, validation and their application in biological recording".
Question is, do we have enough tools in Recorder to actually carry out all the essential validation tasks efficiently?
We have many tools within Recorder to manipulate our own data but what about incoming data?
True we have a means of influencing verification by adding a new taxon and setting this as the preferred ID but we have little else.

For example I have an Event sent in by a contributor which has the wrong grid reference to the named Location. I need to somehow isolate this Event for a variety of reasons: to stop the Location/grid reference combination from being used/reported, to exclude it from my Location hierarchy system (County then District then Parish - as used by a few LRCs) as wouldn't insert correctly, to prevent wrong reporting.
Because it's someone else's Event + Sample + Taxon occurrences my options for carrying out validation tasks are limited, all I can do is "change" the determination of each taxon occurrence.
What I would like to be able to do is:
1. Mark the Event as invalid
2. Mark the Sample as invalid
3. Mark the Location as invalid AND/OR non-preferred (e.g. whilst the name "LEICESTER" might be legitimate as an historic location, it's not something we want people to use nowadays)
4. Be able to select a command on right clicking the offending Event which allowed me to send an email to the originator which a) detailed what is wrong, b) offers a quick fix on their database via an import
5. Be able to keep track of "quarantined" items (which of course never ever find their way into reports) - perhaps via the Filter - so that they can be later corrected.
People are increasingly looking to LRCs for guidance on location naming. This is not going to be possible while we still have to cope with incoming errors that we cannot fix readily.

2

Re: Tools for Validating

These all sound like very useful features Darwyn. One other I would like to add that is related to checking verification (i.e. ticking off records that have been entered): when a list of records have been entered via a recording card, the observations do not get listed in the obs hierarchy in the same order - the get sorted alphabetically. This makes it very difficult to compare the original paper recording card with those records in the hierarchy as they are out of sync with one-another. An 'original order' (sort by taxon occurrence key?) sort would solve the problem.

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

3

Re: Tools for Validating

I think what you are suggesting, Charles, is a sort by taxonomic sort code option.

I will add these options to the Future Development list when I get a chance.

John van Breda
Biodiverse IT

4

Re: Tools for Validating

I just realised that the record card is not in taxonomic sort code order, so this option would not work.  As you suggest Charles, sorting by the Taxon Occurrence Key should do the job.

John van Breda
Biodiverse IT

5

Re: Tools for Validating

Thanks John. Being able to sort by taxonomic order would also be very useful, so could you work that into the CCN too, please?

Looking at Darwyn's validation enhancements more closely, they look like quite a large undertaking and, I would imagine, something a full proposal is needed for. What happened to the idea of championing features? Is this still the way things should happen? Perhaps someone from JNCC could provide the lowdown on exactly what is required in order to more formally make the larger feature requests? I know that the planning and design Lee Manning and I undertook for our new SMART add-in saved time and thus money because we carefully specced everything up and presented a proposal. With the larger feature requests, is preparing a more fully fledged proposal something that is worthwhile?

Charles

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

6

Re: Tools for Validating

Hello everyone

Re-opening this issue, during the testing of V6.9 myself and Charles have noticed that when you input a taxon occurrence via 'Enter a species record' or via the Import Wizard the resultant record is flagged as "not validated". However, if you input a taxon occcurence via a Recording Card the resultant record is flagged as "passed validation".

Similarly, is you add a taxon or biotope occurence in the Observation hierarchy directly, or if you edit a record in anyway, these records are also flagged as "passed validation".

I think that the default for new records should be consistent throughout Recorder regardless of the method used to input data, and my personal view is that these records should be flagged as "not validated".

What do users think? Should records be automatically flagged as "passed validation" or "not validated"?

I have placed a draft copy of an incident report regarding this on the file uploads page and would welcome any comments on this, although some of the issues raised would undoubtedly form part of a future CCN.

I also note the comments made previously on this subject.

Many thanks for your input,

Sarah

Sarah Shaw
Biodiversity Information Assistant
JNCC

Sarah Shaw
Biodiversity Information Assistant
JNCC