1

Re: How do I export unvalidated data to a satelite copy of Recorder 6

I have a copy of Recorder 6 running in a museum gallery (with the Nature Notebook interface installed to provide easy access for visitors) and need to get the data that they inputed to our master copy on a different computer.  I cannot export the data they have inputed as it is unvalidated.  They are inputing around 600 new records every month and I cannot validate that quantity of records on the computer in the gallery.  Therefore, I need to be able to perform an export of those unvalidated records and import them into our master database where I will be able to validate them.  Is there a way of forcing R6 to export the unvalidated records, or (slightly less ideal) a way to bulk validate them (and unvalidate them at the other end?)

Hope someone can help,

Alistair McLean
Sheffield Galleries & Museums Trust

2

Re: How do I export unvalidated data to a satelite copy of Recorder 6

Alistair, when you say unvalidated, do you mean unchecked? There's a difference between checked records, validated records and verified records you see. I'm pretty sure you mean unchecked, though, and unfortunately I don't know of a way to export these data. I did try it once by running a Report Wizard report and unticking the "Exclude unchecked data" filter, but the end result on import was a bunch of survey events and samples but no occurrences.

It's relatively easy to do a mass "check" and subsequent "uncheck" at the other end by running SQL directly against the database, if you're comfortable with working with the database directly. However, acting directly on the database like this is extremely risky if you're not experienced. I'd suggest talking to Mike Weideli if you need some help with this - he does much work for us and we're always impressed with his services. If any of the other authorised Recorder experts are reading this and can help, I'm sure they will let it be known.

Charles

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

3

Re: How do I export unvalidated data to a satelite copy of Recorder 6

Yes - I mean unverified.  Once a record has been entered by a member of the public, it is considered to be unvalidated by R6 (in the general tab of the taxon occurence).  In order to validate it, I have to click on edit and save it.  This changes the validation tag to "passed validation."  According to the R6 help, Recorder will only export those records that have passed the validation.

However, I have now disovered that this is only one of my problems.  I have succesfuly imported the events & field observations from the gallery computer, but for some reason, the master R6 rejects the import of the taxon occurences.  I had thought that this may have been down to validation of the taxon occurences, but I've just performed an experiment by validating some of the occurences but the master copy still rejects them. 

I'm pretty sure that this is because Nature Notebook uses a species list generated using the thesaurus editor.  We had a lot of trouble linking these species with their synonyms in the other checklists.  I suspect that the gallery copy of Recorder is exporting a bunch of species names that our master copy of Recorder doesn't understand as the links to the synonyms have broken down during export.  I've tried to export the Nature Notebook checklist on the gallery computer to the master computer, but that also won't import.  I can think of a wide variety of ways of getting around this, such as importing the entire gallery dataset periodically, but it will just cause the same problem if I try to export to NBN or Sheffield LRC.  Any suggestions?

Alistair

4

Re: How do I export unvalidated data to a satelite copy of Recorder 6

Ah, OK, you mean unverified. In that case, the records will export unless the occurrence is flagged explicitly as "invalid" (i.e. the occurrence has an "invalid determination"). Verification within Recorder is something that is going to be looked at and tightened up as I understand it, including the somewhat dodgy and inconsistent terminology used in relation to verification and validation.

As for the nature notebook issue; I've not used it, so can't be of any help there I'm afraid. But from your description of the situation, I would hazard a guess that you are correct in your suspicions.

Charles

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

5

Re: How do I export unvalidated data to a satelite copy of Recorder 6

My problems keep getting compounded.  I have now moved a duplicate copy of the Gallery database onto the master machine.  On this copy, I have deleted some of the data entered on the gallery machine using the non-standard species checklist.  I've then performed an import of the full data from the gallery machine.  As predicted, most of the data is duplicated, but it says there is some new stuff (i.e. the stuff I deleted).  On checking the results, I've discovered that the data I deleted has reappeared but once again, the taxon occurrence has been left out.  As the machine I've tried to import the data onto has the nature notebook checklist on it, I've concluded that the taxon occurences can't be being exported in the first place.  I've checked the xml file produced by the export on the gallery computer and verified that this is the case - there's no reference to either the taxon name or its GUId anywhere in the file.

So far as I can tell, Recorder 6 is not exporting any taxon occurrences made using the non-standard nature notebook checklist generated in the thesaurus editor.  If anyone "in the know" has any ideas what the problem might be, I'd appreciate some assistance.

Thanks,

Alistair
SGMT

6

Re: How do I export unvalidated data to a satelite copy of Recorder 6

Are the observations checked (ticked) in the observation hierarchy?

Charles

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

7

Re: How do I export unvalidated data to a satelite copy of Recorder 6

Alistair

A few notes which may help:
1) For the export to work, your non-standard checklist must exist on both the Nature Notebook gallery machine AND the master database. A normal export does not include taxon dictionary information, so you may be exporting determinations with a link to missing records in the master database's Taxon Dictionary.
2) I noticed you mentioned exporting an XML file - I suggest you try the zipped Access export format. Even if it makes no difference this format tends to be a lot quicker anyway.
3) After importing onto the master machine, have you taken a look at the ImportRejects.txt file? This may give you some clues (its much better in 6.9.3 than it used to be by the way).
4) Another possible place to look for clues is to look in your windows temp folder immediately after doing an import. There is an NBN Import folder, and in there, a copy of the data you imported in an mdb file (you may have to shut Recorder down to access it). You can look in there to see if the right number of taxon occurrence and taxon determination records were in the import file.

John

John van Breda
Biodiverse IT

8

Re: How do I export unvalidated data to a satelite copy of Recorder 6

Hello all

In Recorder 2002 I would like to exclude exporting records that have been checked but "Failed validation" (ie those that I have given a value of 1 in the verified field of the taxon_occurence table) but don't seem to be able to do this when exporting from rucksacks. These "dodgy records" are exported along with the ones that have "Passed validation". I can get around this by either using the report wizard, however as I am exporting records from multiple vice-counties this is not ideal, or by unchecking the unverified records prior to exporting (this still however exports the sample and survey event associated with the record) but am I missing something simpler?

Thanks

Graham