1

Topic: Gateway performance is shockingly bad

I've just tried to access records of the common weevil Mecinus pascuorum using the Interactive Map Tool. Amazingly I was able to see records for much of the British Isles, although large parts of the map were pasted with large pink squares. I did a selection of all of the records and waited. And waited and waited. Nothing. The rotating dots progress monitor in the top right corner spun uselessly to itself for 10 minutes before I gave up altogether. What I would like to know is this: if the server is unable to fulfil a request within a reasonable time frame (say 30 seconds) why not admit as much and post a 'failed request' message to the user? It would mean I could get on with something more useful. Secondly, why is the performance this bad despite the recent version and server upgrade? Something is clearly still seriously wrong with the architecture. At this time of day (6 p.m. on a Friday) I should be able to access any data almost instantly. It's not as if I live in Outer Mongolia. For the record, I'm using a Windows 7 laptop running IE 11 3 GB RAM.

2

Re: Gateway performance is shockingly bad

Here is a hint - try the OLD gateway.  I have been using it almost as much recently as this 'new improved' version (though some datasets will be out of date).  As a demo of how to turn an eminently useful (if sometimes frustrating) resource into something with appalling design, no better performance, less functionality, and a rash of inconsistencies, this 'upgrade' is in a class of its own.

M.

3

Re: Gateway performance is shockingly bad

... but even the old gateway is down now.  Great.

M.

4

Re: Gateway performance is shockingly bad

... and now the OLD gateway is back in action and I have been able to get the information denied to me by the new version for the past 24 hours and more.  It is unpredictable - sometimes nothing but a page of Apache errors, then you get in and can GET USEFUL INFORMATION!

M.

5

Re: Gateway performance is shockingly bad

Hello Andrew

Over the Christmas and New Year period there was an issue with the performance of the NBN Gateway,  especially the interactive mapper resulting in the appearance of pink squares on the map. The cause of this issue appears to be the result of problems with one of the databases. This is currently being looked into. We apologise for the inconvenience this caused over the Christmas period.

Best wishes

Graham
NBN Technical Liaison Officer

6

Re: Gateway performance is shockingly bad

At the time of writing (10:47 am Thurs. 16th Jan.) I'm still getting this problem: pink squares, no records selectable, at least for some species. You really do need to get to the bottom of this as it makes the Gateway completely unusable.

7 (edited by andrew.duff 23-01-2014 12:14:26)

Re: Gateway performance is shockingly bad

Right now (Sunday 19th Jan. 08:30) I'm unable to select records in Interactive Mapping Tool: the progress dots just spin for ever. Tried the old Gateway and discovered that the 'Select Records' button has been disabled! Thanks guys - NBN Gateway is completely unusable as far as I'm concerned. Please get this sorted!!

UPDATE: now Thurs. 23rd Jan. midday and nothing has been fixed. Pink squares, can't select records. Why is there no status update in the NBN News feed? I shouldn't have to keep logging in, trying to do some work, and failing miserably time after time.

8

Re: Gateway performance is shockingly bad

I am right with you on this, Andrew.  I think the corporate wagons have already circled on this one, and I suspect it will be impossible to do what is really needed - namely junk Gateway 5; go back to the old version; rewrite G5 so that the multitude of errors, inconsistencies, appalling design features, and performance problems are addressed; restore all the lost functionality; give it PROPER beta testing (that was completely lacking, and is the root cause of many of the problems we are seeing); and only then launch it.

We are 3 months into G5 and none of the crucial problems has been solved apart from from a few access problems right at the start, and I doubt that in all that time the Gateway has functioned satisfactorily for more than a few days consecutively.

The Gateway site is just one aspect - as I have pointed out in other threads, the poorly planned changes have had impacts on other sites and applications which use easy-maps, straight URL links to maps, and other features.

This whole venture has been a complete mess - and this verdict comes from someone who is among the greatest supporters of the idea of the Gateway.

Murdo

9 (edited by Syrphus 26-01-2014 09:19:06)

Re: Gateway performance is shockingly bad

I have just tried to get some info from the Gateway.

The good news - it loaded in seconds rather than minutes.

The bad news (or just some of it) - none of the mapping functions works in either the new or the old Gateway.  With the knock-on to those of us who use direct links to the Gateway in our websites to display maps.

The absence of responses from NBN staff to these complaints is unacceptable, and just reinforces the feeling that no-one there wants to acknowledge that whatever fancy IT has gone on in the background, Gateway 5 is ***simply not fit for purpose***!  Hear no evil, see no evil, and maybe it will all go away is not good enough.

I think the staff know that I have always been a great supporter of the Gateway, and have promoted it at every opportunity - including in the NBN Newsletter and on a range of sites including HBRG and SBIF - so I hope they and the other readers will accept that my deliberately blunt and sometimes undiplomatic criticisms are intended constructively.   The old Gateway was not without its problems, but it was (and frequently still is) *vastly* more useful than G5.

Gateway staff - please accept that this exercise has been a total fiasco.  Forget blame and retribution - just give us a resource that delivers what we want efficiently, effectively and reliably, even if that means (as I suspect it will) going right back to square one.

Murdo

10

Re: Gateway performance is shockingly bad

Goodness, and I just thought it was me who was having problems, going so far as to think it was my laptop at fault.  I have to agree with all of what has been written here and would endorse the suggestion that we go back to the original "old" Gateway.  The old version was so useful and I made so many additional records from the information that could be gained/interrogated that there is little point in using the new version apart from looking where a species has been seen.  Last night when trying to access data via Record and drawing the square round the distribution dots just nothing appeared.  I did try the old version but as has been mentioned earlier, this was down.  This is not progress and the new version appears to have been designed by someone who isn't a recorder and spends time out in the field trying to add data to give a true picture of where species occur.  NBN gets a lot of records from me via Highland Biological Recording Group, hours in the field, hours writing up and you are not repaying every ones efforts by running the new version of Gateway.  I probably visit NBN a few times a day, please give us a system that works, as a thank you to the 100's or 1000's of folk collecting the data that makes Gateway work.  I only use Gateway to check species distribution, god knows how others are getting on when trying to do more complicated things.  I back Murdo et al in asking for a system that works.
Stewart

11

Re: Gateway performance is shockingly bad

Murdo
Over the weekend an issue with the web server lead to the NBN Gateway not returning maps from Saturday afternoon onwards. The Gateway developers have looked into this and are aware of the underlying cause and have resolved the issue. They are looking into reducing the risk of this happening again in the future. There is another issue with the interactive mapping tool not returing records which the developers are currently looking into. This seems to have resulted from an update released last week. The Gateway is being monitored and issues resolved as soon as possible after they arise. I do apologise for the lack of communication around this, a close eye is kept on the forum, with issues and suggestions fed back to the developers.

Best wishes

Graham
NBN Technical Liaison Officer

12

Re: Gateway performance is shockingly bad

Thanks, Graham.  It was not just last weekend, though.  This sort of thing has been happening frequently since the launch of G5, and these are problems that should all have been identified and solved *before* the launch.  The maps fail in all sorts of ways and combinations: sometimes the grid loads and the imt does not; sometimes G5 is working and the old Gateway is not; other times it is the reverse; occasionally everything even seems to work properly; you never know until you try.

Nor is it just the mapping - there is a quite different intermittent problem of time to load pages - 2 minutes for me the other day.  There is the unpredictability of behaviour - one day Opera will load the imt perfectly; the next day - or even an hour later - I have to move to Chrome.  And we read of problems with the upload of datasets.  And I heard yesterday from someone who knows a lot more about these things than I do that the underlying database design is highly suspect - something I can very easily believe.  And you tell us that more problems are created by an update to the system.  Are updates not tested to ensure that solving one problem does not create others?  Evidently not.

None of that touches on the absurdly opaque, unhelpful and complicated user interface, or the loss of really important functionality.  Nor the loss of currency of the easymaps widget (when will that be linked to G5?).  In the past week some half dozen people, regular serious data providers and users, have offered me the unsolicited opinion that the NBNG is now a complete waste of time, and they have disengaged, or are in the process of disengaging from it.  I don't blame them, and am sorely tempted to join them.

Frankly, I don't want an explanation of why things went wrong.  I want the problems identified and cured, to provide a resource that does what the users want, allows us to do what we were able to do before, and performs reliably.

Murdo

13

Re: Gateway performance is shockingly bad

Just tried to access records for Buxbaumia viridis (box round dots on map) and nothing appears.
Stewart

14

Re: Gateway performance is shockingly bad

Interactive map is still not returning record details.
We have worked hard to encourage our local recorders to use NBN, but the feedback I am getting is of total bemusement as to how to use the new site and frustration as it is frequently not working.
Please restore the old site to full working order and remove the new version to incorporate the user comments and ensure that it works consistently.

Christine Johnson

15

Re: Gateway performance is shockingly bad

I tried to look at smooth snake records on Monday, so that I could answer an urgent query.  I could see the records on the interactive map, but couldn't get any details - very frustrating.  Today I am trying to answer requests for access to data - so far it has taken about half an hour to process one request.

Ellie Knott

Eleanor Knott
Devon Biodiversity Records Centre

16

Re: Gateway performance is shockingly bad

At last the maps are working.
Thank you

Christine Johnson