1

Re: MapMate to Recorder 6 export queries

Martin Harvey with help from Brian Miller has kindly added more enhacements to the MM to Recorder 6 export queries. These take into account certain enhancements and limitations within the Recorder import wizard. I've invited Martin (or Brian) to post a quick message explaining these enhancements. The new queries are available here:

http://forums.nbn.org.uk/uploads.php?file=061212%20-%20Export%20to%20R6.txt

A big thanks should go to Martin and Brian for their work on this; these are essential tools for anyone transferring data from MapMate to Recorder. Feedback and comments welcome.

Charles

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

2

Re: MapMate to Recorder 6 export queries

Thanks for uploading the text file Charles.

The file contains three SQL queries, which are revised versions of the three MapMate queries previously circulated for exporting to Recorder 2002. The "Find bad dates" query has not altered, but in the other two queries the differences are:

- Date field formatted so that it shows real date ranges for any period of time, e.g. a single day date will show as "dd/mm/yyyy", a date range will show as "dd/mm/yyyy - dd/mm/yyyy".

- Abundance, stage and sex fields are concatenated:
-- non-numeric abundance terms are translated - where DAFOR codes have been used they are shown instead of numeric quantities;
-- MapMate also has a "Not recorded" term, if this has been used it will show as "NotPresent";
-- "0", for "Present", is translated into "+";
-- In the Stage field, "1st Summer" etc. is translated into "FirstSummer" to avoid confusion with numeric abundance;
-- In the Sex field "mixed sex group" is converted to "MixedSexGroup" to remove spaces.

I did try stringing together a load of IIf statements to strip out all the spaces from the Stage field, but there are 40 stage terms that have spaces in them, and the query won't run with 40 nested IIf statements! So the best I can do is concatenate the three fields as described above - you'll still need to do an extra editing job outside MapMate to remove any extraneous spaces before import into R6.

The main data fields within MapMate that do NOT get exported in the queries are the fields relating to the "Reference" (equivalent to Recorder's "Survey"). The Reference fields could be added to the queries fairly easily, but not sure how that would get treated on import to Recorder. (And perhaps in Recorder it would be best to have a single Survey that refers to the original source of all the MapMate data?).

Any further suggestions for making this work smoothly will be gratefully received, and ideally I'd like to get the whole "MapMate to Recorder 6 data transfer" doc fully updated, so would be good to hear from anyone who is using this to import into R6.

Martin

Martin Harvey
Biological Records Centre
CEH Wallingford

3

Re: MapMate to Recorder 6 export queries

One question regarding "Not Recorded", does this mean the recorder looked, but found nothing? In other words, is it a "zero abundance" record? If that's the case, then the value should be a plain zero, as this will then be imported into Recorder as a proper zero abundance record.

Regarding the Reference field, I think it may be useful for this information to go into the surveyor's ref field, but it may be too small to hold the full reference. What do others think?

Charles

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

4

Re: MapMate to Recorder 6 export queries

One further issue to ponder: all of our incoming MM data is lumped into one large store and it's difficult to distinguish what individuals data have come from. So for instance, I may have one set of data from a recording group and others from individuals sending in records on a ad hoc basis. Ideally I would like to be able to separate out the data and place the recording group's data into its own Recorder survey, and other individual's data into their own separate surveys. However, I've as yet not been able to find a way of separating data by source. It occurred to me that the References field might help?

Any ideas?

Charles

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

5

Re: MapMate to Recorder 6 export queries

Charles,

Re "Not present", as far as I know this is intended to show that the species was looked for but not found, so I will adjust the text file accordingly so that it shows "0" and resend it tomorrow. I'll also add in the Reference fields so you can see what they contain. Basically the raw data for References in MapMate consists of four fields: Author, Year, Title and Comment. What would be the best way to format these for Recorder?

Re identifying sources, there are two bits of information in MapMate that do this. One is the originating CUK (Centre Unique Key, equivalent to siteID), and the other is the Reference. Each CUK will probably use several References, and it is conceivable (although probably not frequently done) that a single Reference could be used by several CUKs.

If you split records up by CUK you will be able to give some indication of where the data was entered, if you know who owns which CUK. In fact the CUK is always retrievable from the unique ID given to each record, so arguably you don't need to duplicate this as a Survey type field as well.

If you split records up by Reference you will find a huge variety of ways in which people have used the Reference fields, and where people have imported data into MapMate as text files then the Reference may be relatively uninformative (i.e. many will be in the form of "Data import by centre 1pm").

Presumably these issues also arise between Recorder users who exchange data?

Martin

Martin Harvey
Buckinghamshire and Milton Keynes Environmental Records Centre
www.bucksmkerc.org.uk
egroup: http://groups.yahoo.com/group/BMERC

Martin Harvey
Biological Records Centre
CEH Wallingford

6

Re: MapMate to Recorder 6 export queries

Martin,

I somehow missed your reply here, so my apologies for that.

Regarding sources, I'll give a little further background to the problem. We receive data from several individuals in addition to a major recording group via MapMate. Separating out the individuals is easy enough using the CUK as you suggest. However, there doesn't seem to be a way of distinguishing the records that have come from the recording group as there are many CUKs for each of the individuals using MM within the group. I'm not sure that there is going to be a robust solution to this issue unless Teknica add an attribute to MM entities that store where they last came from (as opposed to where they originally came from). The same issue does exist in Recorder, but is somewhat alleviated through use of surveys as a grouping mechanism for records and also the newer addition of a custodian field.

Charles

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

7

Re: MapMate to Recorder 6 export queries

Hi,

Once MapMate records have been imported to Rec6, I have no permission to edit any of the records?
but i can delete them?
Is this correct... and is it possible to override this and be able to edit records (ie: mark some as unconfirmed etc etc)?

cheers Jim

Jim Wheeler
[b]Norfolk County Macro Moth Recorder[/b]
[url]http:/www..norfolkmoths.co.uk[/url]

8

Re: MapMate to Recorder 6 export queries

This is correct behaviour as it enables you to get rid of any imported data you don’t want in your reports, etc. You can’t change imported data unless the owner/custodian of that data has transferred custody to you although this may not be possible with MapMate data. For general information see the Help – Help – Contents tab – Tasks – Exchanging data – Transfer of ownership and other topics. You can, however, add determinations to imported data which if flagged as preferred will be used in reports etc. instead of the imported ones. You can do this because you are adding a new entry in the taxon determination table, i.e. you aren’t changing the imported data. There are batch updates which will do this – see Tools – Run Batch Updates – although only system managers can run these. If you are going to run things like these, backup your database first and check carefully that they do precisely what you want. If they don’t, restore your backup.

Sally Rankin, JNCC Recorder Approved Expert
E-mail: s.rankin@btinternet.com
Telephone: 01491 578633
Mobile: 07941 207687