However i am not receiving both the formal Location (database defined lookup) and the Location Name (user free-text). Where there is a Location it is overriding the Location Name in the exported csv. I need both as the user is selecting a defined site (LWS) using Location then entering the specific Location Name (subsite details) relating to the species list.

I need to export both location_name and location_id:name

Checking iRecord download that also omits the Location_Name field where there is a Location. Is there any way to get both attributes?

I understand that spatial indexing can pick up intersecting observations but would like to be able to directly attach observations to a location on entry. ideally through the use of a mandatory lookup and unique name/reference on the entry form. This is something we do already and seems more resource efficient than running spatial queries (we have around 1200 sites)?

I can create the lookup term list but not sure how i can explicitly link that to a boundaried location in the database so if i report on a location the database knows that the observations are for that site.

I'm sure this has been done before and i'm just missing the guide so any help would be appreciate.

Has something changed server-side? What changes to I need to make to my Drupal Indicia module configuration?

We are running Drupal 7.87 with Indicia Forms 7.x-1.59.

Thanks, Chris

<select id="sc:species-grid-76-0:696742:occAttr:21:777405" name="sc:species-grid-76-0:696742:occAttr:21:777405" class="scAbundance ">
<option value=""></option>
<option value="1">Dominant</option>
<option value="2">Abundant</option>
<option value="3" selected="selected">Frequent</option>
<option value="4">Occasional</option>
<option value="5">Rare</option>
</select> 

In the same form, if there is a list of checkboxes the one/s which were ticked have the attribute 'selected="selected"' (conventionally it would be "checked" for checkboxes) and nothing is ticked. Ideally it would show these checkboxes with a tick. Is this a bug and/or do I need to do something different:

<ul class="scAnnualCycle control-box " id="sc:species-grid-76-0::occAttr:137[]">
<li><input type="checkbox" name="sc:species-grid-76-0::occAttr:137[]" id="sc:species-grid-76-0::occAttr:137:0" value="377" class=" first-item" /><label for="sc:species-grid-76-0::occAttr:137:0">Bare</label></li>
<li><input type="checkbox" name="sc:species-grid-76-0::occAttr:137[]" id="sc:species-grid-76-0::occAttr:137:1" value="378:777406" selected="selected"/><label for="sc:species-grid-76-0::occAttr:137:1">Leaves</label></li>
<li><input type="checkbox" name="sc:species-grid-76-0::occAttr:137[]" id="sc:species-grid-76-0::occAttr:137:2" value="379" /><label for="sc:species-grid-76-0::occAttr:137:2">Flowers</label></li>
<li><input type="checkbox" name="sc:species-grid-76-0::occAttr:137[]" id="sc:species-grid-76-0::occAttr:137:3" value="380" /><label for="sc:species-grid-76-0::occAttr:137:3">Fruits</label></li>
</ul> 

Every time a user edits an obs which is part of a sample, I get an error added to the work_queue table even if the edit is saved correctly. The task is task_spatial_index_builder_sample. It seems like the empty location_types array is causing a problem.

There was an SQL error: ERROR:  syntax error at or near ")"
LINE 16:     AND l.location_type_id IN ()
                                        ^ - DROP TABLE IF EXISTS smplist;
DROP TABLE IF EXISTS changed_samples;
SELECT record_id INTO temporary smplist
FROM work_queue
WHERE claimed_by='65deff94d3b293.35621103'
AND entity='sample'
AND task='task_spatial_index_builder_sample';

WITH RECURSIVE ltree AS (
  SELECT l.id, l.location_type_id, l.parent_id, s.id as sample_id
  FROM smplist sl
  JOIN cache_samples_functional s ON s.id=sl.record_id
    LEFT JOIN locations l ON st_intersects(l.boundary_geom, s.public_geom)
    AND (st_geometrytype(s.public_geom)='ST_Point' OR NOT st_touches(l.boundary_geom, s.public_geom))
    AND l.deleted=false
    AND l.location_type_id IN ()
    
    /* type filters, e.g. and (l.location_type_id<>#id or s.survey_id in (#surveys)) */
  UNION ALL
  SELECT l.id, ltree.location_type_id, l.parent_id, ltree.sample_id
  FROM locations l
  JOIN ltree ON ltree.parent_id = l.id
  AND ltree.location_type_id IN ()
)
SELECT sample_id, array_agg(distinct id) as location_ids
INTO TEMPORARY changed_samples
FROM ltree
GROUP BY sample_id;

-- Samples - for updated samples, copy over the changes if there are any
UPDATE cache_samples_functional u
  SET location_ids=cs.location_ids
FROM changed_samples cs
WHERE cs.sample_id=u.id
AND (
  ((u.location_ids IS NULL)<>(cs.location_ids IS NULL))
  OR u.location_ids <@ cs.location_ids = false OR u.location_ids @> cs.location_ids = false
);

UPDATE cache_occurrences_functional o
SET location_ids = s.location_ids
FROM cache_samples_functional s
JOIN changed_samples cs on cs.sample_id=s.id
WHERE o.sample_id=s.id
AND (o.location_ids <> s.location_ids OR (o.location_ids IS NULL)<>(s.location_ids IS NULL));

In the spatial_index_builder.php this (default) code is present. I've tried removing it but that just causes other errors. Does it need to change somehow so there is something in the location_types array?:

// List the location type terms that area available for indexing against. Typically these will need to be those
// which are frequently reported against especially where the boundaries are large and/or complex.
$config['location_types']=array(
  'Vice County',
  'Local wildlife site'
);

// Of the indexed types, which are layers which have a parent ID that points to
// another higher level layer that should also be indexed?
$config['hierarchical_location_types']=array(
  'Vice County',
);

// If any of the indexed location types only need indexing for certain surveys then that can be configured here.
// Omit this configuration if not required.
// $config['survey_restrictions']=array(
// 'Local wildlife site' => array(25, 26, 27) // only build an index for surveys 25, 26 and 27 for local wildlife sites
//);

Apart from anything else, if the work_queue table has entries, other things in the warehouse seem to stop working (such as filtering occurrences). Once I clear it, these issues disappear.

Any ideas?

Just looking to pick the brains of the general community. I have recently started a new post which will involve survey of local sites. I really like iRecord and would like our new data collection to feed through it as a system. My previous post was with a LERC where i had some experience of using Indicia to design datasets and front end forms.

I guess my question is can anyone suggest the best approach, what do others do?

iRecord is great but the standard record entry forms don't capture all the information we need, we could enter species data here and capture other data elsewhere but that will duplicate effort and split information.

Activities might be a solution but there's no way to tailor entry forms.

Indicia would be ideal but as an individual i doubt the BRC would host (it's me and whoever else i can convince to use it) and setting up a warehouse myself would be excessive!

I feel there should be an Indicia 'lite' or some additional iRecord customisation but i appreciate how messy that could get architecturally...

Suggestions welcome!

p.s. will also post this in iRecord forum but following replies on both so no need to 'double reply'!

I regularly import observation data from CSV files using a Utilities > Importer page. I have a new survey now which has a multi-value Occurrence Attribute (Annual cycle) with 4 possiblities (Bare, Leaves, Flowers, Fruits) from a Term list lookup. There can be one or more options selected so the "Allow multiple values" option is ticked. From a data entry form on the website everything works correctly.

The problem I am having is getting the syntax right to import from a CSV file. If the Annual cycle field contains one value such as Flowers the import works but how should I structure it if there are multiple values? I've tried a variety of things with the names and term IDs e.g. "Flowers,Fruits", "Flowers|Fruits", "379,378" and "{Flowers,Fruits}" but I always get an error like "occAttr:137: Invalid value 'Flowers,Leaves' for attribute Annual cycle".

For example, the first line of this file import; the others don't:

Date,Occurrence created by,Sample created by,Grid ref or other spatial reference,Species or taxon name,Annual cycle
05/09/2022,Chris_Brown,Chris_Brown,22.686461S 17.116769E,Tarchonanthus camphoratus,Flowers
05/09/2022,Chris_Brown,Chris_Brown,22.686183S 17.117124E,Tarchonanthus camphoratus,"Flowers,Fruits"
05/09/2022,Chris_Brown,Chris_Brown,22.686183S 17.117124E,Tarchonanthus camphoratus,"{Flowers,Fruits}"
05/09/2022,Chris_Brown,Chris_Brown,22.686183S 17.117124E,Tarchonanthus camphoratus,"378,379"
05/09/2022,Chris_Brown,Chris_Brown,22.686183S 17.117124E,Tarchonanthus camphoratus,"{378,379}"

Can anyone please help?

I'm trying to get something right in an Indicia report (page category=reporting; page type=reporting page (customisable)).

A logged-in user sees the Filter Bar but an anonymous user doesn't. Based on a previous question this seems to be expected behaviour: https://forums.nbn.org.uk/viewtopic.php?id=7024 where Jim said

I want to restrict the report's map and grid to records that have not been rejected or are dubious.

If I specify a parameter such as @quality=!D in the Form Structure of the User Interface under [standard_params], it correctly filters out dubious and rejected records for logged in users. For the logged-in user the filter states 'Quality. Exclude not accepted records' and changing this to e.g. 'All records' makes rejected records appear as I would expect. Great. However for the anonymous user the report loads with all records visible, even rejected/dubious ones, and there is no filter bar so they cannot interogate the records based on status.

I tried another approach (from https://indicia-docs.readthedocs.io/en/ … ing.html). Instead of specifying a parameter in the form structure I added it in the report's xml files by adding a condition to the query like this:

and quality_check('#quality#', o.record_status, o.certainty)=true

and a parameter like this:

<param name="quality" display="Data quality" datatype="lookup" default='!D'
         description="Quality level required of data to be included in the map."
         lookup_values="V:Data must be verified,C:Data must be verified or certain,
        L:Data must be at least likely,!D:Include anything not dubious or rejected,
        !R:Include anything not rejected" />

Running that report as a logged-in user restricts records as it should but changing the Quality option in the filter bar e.g. to 'All records' does not make rejected records appear. Running it as an anonymous user shows the records filtered correctly.

So - how can I get this to work for both logged-in and anonymous users correctly so that records are always initially restricted but can be queried using the filter bar. (Or - is there a way to make the filter bar available to anonymous users?)

Thanks for any advice.

I asked about this before but got no replies. I think it should be something simple.

The 'Send to expert' button works correctly and sends an email. The 'Query' button doesn't.

Chrome developer tools tells me:

cUrl POST request failed. Please check cUrl is installed on the server and the $base_url setting is correct.
URL:http://www.zzz/index.php/services/report/requestReport?report=library/users/user_notification_response_likely.xml
Server response
{"error":"There was an SQL error: ERROR: relation \"user_email_notification_settings\" does not exist\nLINE 10: from user_email_notification_settings \n ^ - \n select case acknowledged when true then 'acknowledged' else 'unacknowledged' end as key, count(*)::varchar as value\n from notifications \n where user_id=300\n and triggered_on>now() - '1 year'::interval\n and source_type in ('C', 'V')\n group by acknowledged\n union\n select 'email_frequency', notification_frequency \n from user_email_notification_settings \n where user_id=300\n and notification_source_type='C'\n ","code":44,"file":"\/var\/www\/zzz\/indicia_warehouse\/system\/libraries\/drivers\/Database\/Pgsql.php","line":342,"trace":[]}
unknown"

and the log file has this:

Missing i18n entry general_errors.There was an SQL error: ERROR:  relation "user_email_notification_settings" does not exist
LINE 10:    from  user_email_notification_settings 
                  ^ - 
   select  case acknowledged when true then 'acknowledged' else 'unacknowledged' end  as  key, count(*)::varchar  as  value
   from  notifications 
  where user_id=300
  and triggered_on>now() - '1 year'::interval
  and source_type in ('C', 'V')
  group by acknowledged
  union
   select  'email_frequency', notification_frequency 
   from  user_email_notification_settings 
  where user_id=300
  and notification_source_type='C'
   for language en_GB

According to a php.info file cURL support is enabled; cURL Information 7.64.0.

$base_url is set in the Drupal settings.php file.

I have a table called notifications but I don't seem to have a table user_email_notification_settings. Is that what the problem is?

Thanks.

If I create a very basic data entry form using default settings (e.g. enter single records or list of records) and tick the Occurrence Sensitivity checkbox, the sensitivity dropdown has 6 options: Not sensitive; Blur to 100m; Blur to 1km; Blur to 2km; Blur to 100km.

In the warehouse, if I edit an occurrence there are 4 options in the Sensitivity precision list: <not sensitive>; 1km; 10km; 100km.

Presumably these should match?

If I edit the Sensitivity precision value in the warehouse, the change is saved and my website reports blur correctly. But if I chose a value in a data entry form it is not being saved to the warehouse. This seems to be the case for all of my forms.

This used to work and I can't work out what changed.

On a test form, the form data was like this:

auth_token: afec7afc00c8edbc05c97b8880cea2ae1b90d978
nonce: 789b052269c95d3eb3cd103d45b09372abffaadc
website_id: 2
survey_id: 25
occurrence:record_status: C
gridmode: true
sc:species-grid-239--idx-::occAttr:87: 
sc:species-grid-239--idx-::occAttr:21: 
sc:species-grid-239--idx-::occurrence:comment: 
sc:species-grid-239--idx-::occurrence:sensitivity_precision : 
sc:species-grid-239-0::present: 11946
sc:species-grid-239-0::occAttr:87: 225
sc:species-grid-239-0::occAttr:21: 1
sc:species-grid-239-0::occAttr:137[]: 377
sc:species-grid-239-0::occAttr:137[]: 378
sc:species-grid-239-0::occAttr:139[]: 389
sc:species-grid-239-0::occAttr:139[]: 390
sc:species-grid-239-0::occAttr:138[]: 381
sc:species-grid-239-0::occAttr:138[]: 382
sc:species-grid-239-0::occurrence:comment: dummy
sc:species-grid-239-0::occurrence:sensitivity_precision : 100000
sc:species-grid-239-1::occAttr:87: 
sc:species-grid-239-1::occAttr:21: 
sc:species-grid-239-1::occurrence:comment: 
sc:species-grid-239-1::occurrence:sensitivity_precision : 
sample:entered_sref: 18.58931S 11.22522E
sample:geom: POINT(1249585.77444247 -2106642.98074488)
sample:entered_sref_system: 4326
OpenLayers_Control_LayerSwitcher_35_baseLayers: OpenStreetMap
sample:date: 20/09/2022
sample:comment: dummy
action-submit: Save

All occurrence attributes (certainty, and custom attributes like height and habitat) save correctly but not sensitivity.

I'd appreciate any help or insights...

Thanks.

I'm sure this is simple but I'm not finding the info I need in the docs.

In my warehouse, under > Taxonomy > Taxon ranks I have a category for Family (Id=1) and one for Species (Id=2). In my plant list under Taxa I have 152 families (each one has the Taxon Rank set to 'Family') and each family has a list of Child Taxa which are the species.

In my data entry form, which is of the type 'Enter single record or list of records' the [species] control lists all families and all species eg:
Ascolepis pusilla
Ascolepis speciosa
Asparagaceae
Asparagus africanus
Asparagus asparoides

What do I need to do to exclude families from this list? I thought there might be a way to add a term to limit the [species] control, like @taxon_rank<>1 but I can't find documentation.

Thanks, Alice

Thank you

Christine

For the most part things are fine but while trying to re-create a record explore page which should limit to a warehouse dataset/survey the form 'Report Settings' appears to be ignoring the survey_id which i place in "Preset parameter values".

The report does not throw an error but loads blank. The filters against user records and user taxon group work as expected but the survey_id parameter is ignored (it queries all data).

There are definitely records in the dataset (514) on the warehouse.

I'm using the "Reporting page (customisable)" pre-build.

Preset parameter values;

smpattrs=
occattrs=
location_id={profile_location}
taxon_groups={profile_taxon_groups}
currentUser={profile_indicia_user_id}
survey_id=514

placing survey_id in either of the Default parameter settings blocks results in a syntax error on page load.

I'm trying to upload a simple zipped shapefile into the Locations page of the warehouse. I am getting this error:

There was an SQL error: ERROR: invalid input syntax for integer: "" LINE 5: AND "locations"."location_type_id" = '' ^ - SELECT "locations"."id" FROM locations WHERE "locations"."public" = 'true' AND "locations"."name" = 'Etosha National Park' AND "locations"."location_type_id" = '' AND "locations"."deleted" = 'false'

The dropdown list to enter Location Type does not have any options available and I assume this may be the problem. (If I try the option to manually add a New Location, it does have options: City, Site, Town etc.)

This used to work - I have a previously uploaded shapefile (of type Site) listed.

Any ideas why it won't work now and how to fix it?