502 Bad Gateway on /search/companies

The peak load on 4/1/2017 was between 09:56 - 10:04.
We have been in contact with one particular customer who caused this peak, and do not envisage another occurrence.
Sorry for the inconvenience.

Thanks MArkWilliams, unfortunately though the problem seems to have returned.

Sorry, we have a serious issue this morning since about 10:26.
We are currently still working to resolve this issue.

All resolved now. Sorry for the inconvenience.

We are also seeing the same issues this morning.

If there is any more information from our side that could be useful in investigating the issues please let us know.

We’ve been seeing this again this morning from 10:50 (and still going now). Is there a longer term fix you can apply to stop this happening so frequently?

Hi MArkWilliams, this is happening again this morning. This is becoming a regular occurrence. Are you able to advise if a longer term solution is close?

Yes there was an issue from 10:21 to 11:29.
This is the first this week.
All resolved now. Sorry for the inconvenience.
We are currently testing a number of changes/fixes to prevent these issues happening in the future.

Happened again on 2018-01-29T12:02:47.175Z

Just saw this issue happening right now

Yes, we did have issues between 11:40 - 12:01.
Sorry for any inconvenience.

Here we go again. MArkWilliams, this is becoming a frequent occurrence. Please can you advise if a longer term fix is close?

Hi, just want to echo our desire for a longer term fix here. Can you give us an update on that?

This seems to be happening again right now.

Yep, happening again. Last year this seemed to be pretty reliable, the occasional hiccup, but since the start of the year it has become really unreliable.

We are working hard to diagnose the root cause(s) of these issues. We have implemented a number of changes in order to restore the stability of the platform, and have a number of further changes planned. Unfortunately the change implemented last night has had to be regressed resulting in further errors being received today.

We apologise for the ongoing inconvenience these issues are causing.

Steve

I’m guessing it is something else, but you aren’t using docker by any chance are you? Another API we use that is hosted using docker had containers keep falling over for no apparent reason. It turned out that it was because docker needed updating. It started happening early this year/very end last year too, so the timing fits which is why I thought worth suggesting, but doubt it will be the same thing.

Good luck on the fix, but please do keep us updated.

Pinging since it’s happening again right now.

Same here, can you please work on it?

Yes we are aware thanks

We are working on it - sorry for the inconvenience