Urgent: bad request (in production, prevents users from purchasing our product)

Not yet. It is taking some time. Will post an update as soon as I have one

1 Like

We made a few changes. Could you please check on your side?

it seems that all business logic calls now return this:

{ā€œcodeā€:15000,ā€œmessageā€:ā€œCustom business logic execution has been terminated because it did not complete in permitted time - 20 secondsā€}

Does it happen with all business logic calls? Even the basic ones?

we have only this purchaseorder oncreate because it must work to call stripe and get people to pay, no other business logic is currently in place due to its unreliability (everything is disabled to make sure that at least who has paid, can access what they paid for)

the only other task is for admin purposes, a find on users, that also fails with the exact same error now

how did this stop working when it was all good 2 days ago?

The primary reason is your app is running on an ancient version of Backendless. The app continues to grow, both in database and in file storage. As it happens it becomes significantly harder for us to maintain it.

You need to seriously consider upgrading to the latest version as incidents like this will continue to happen.

Back to the problemā€¦ what is the typical invocation time of the logic that times out now?

Regards,
Mark

Mark, itā€™s a quick call that does not do anything but calling stripe, and it happens on our smallest table (purchaseorder)

there is some new problem here that doesnā€™t have anything to do with how long itā€™s supposed to take.

The other call on users simply counts how many registered in the past 24 hours, week and month, and the users table is also much smaller than tables that are working very well with a lot more data (but without business logic)

I get your point on the older version, but we discussed this already, how can we upgrade if we cannot even use 2 mobile SDKs at the same time for the two versions? There needs to be a phase in which we have both systems running, otherwise this would be a complete nightmare

Could you please check in REST console how long that API request takes?

if I simply try a GET from the REST console on Backendless on the users table, I get the same error listed above (ā€œCustom business logic execution has been terminated because it did not complete in permitted time - 20 secondsā€)

If I disable the business logic (find), then it works in less than a second

note that the business logic does basically nothing: it checks the user role

this is not a problem of how long it takes to do such a simple operation

Iā€™m swamped here with users having problems and would really appreciate a fix

The only reason I am asking these questions is to facilitate a fix for you. I thought it would be obvious

We made additional changes. We need a way to validate the fix. The curl you sent me doesnā€™t work - weā€™re getting an error about Json format. Could you please provide an instruction for how we could validate. Ideally, it would be through backendless console.

Thanks,
Mark

1 Like

thanks Mark, it seems that we are up and running

as the problem impacted all business logic, to test I could just hit GET under the users table

I tried also now with a purchaseorder and it worked fine

I appreciate the help on a weekend, if you have any recommendations for the migration, knowing that we would need to start with 2 parallel systems, Iā€™m all ears

hello team,
this issue is happening again

it does not happen on all calls, but somewhat randomly, sometimes it works, sometimes we get the usual

{
  "code": 0,
  "message": "Model Descriptor not found (/opt/backendless/repo/9088af67-1648-1726-ff09-a51862bf1a00/files/servercode/JS/v1/model.json)"
}

to test, from backendless console, under REST console, just call GET from the Users table, you will get sometimes ā€œnot authorizedā€, the correct response for your account, but then if you hit it another 2-3 times, you will get the error above.

The error happens because, as covered above, there is an issue when calling anything that has to do with the business logic. We use business logic right now only for the users table (which is what you can use to test) and for processing purchase orders, which are indeed also failing as reported by our users

thank you for your help in looking into this again

can you confirm that this is now offline because you are looking into it? thank you

Hello @Alessandra_Saviotti

We are taking care of your issue

Regards

1 Like

@Alessandra_Saviotti

We apologize for the inconvenience. Now the error should not happen again.

Regards

1 Like

@viktor.liablin would you be able to check this again? I am now getting again bad requests with the same errors covered above (business logic issues saying that it could not execute in 20 seconds, despite just doing a role check)

{
ā€œcodeā€: 15000,
ā€œmessageā€: ā€œCustom business logic execution has been terminated because it did not complete in permitted time - 20 secondsā€
}

thank you for your help

Hello,@Alessandra_Saviotti. So there was a bug, fixed.
We apologize for the inconvenience.

Could you check and confirm that everything is fine?

Seems okay now, thank you

@viktor.liablin @Marian_Koreniuk @mark-piller please double check this again, we are getting the same error

with 400 status code response
{ā€œcodeā€:0,ā€œmessageā€:ā€œModel Descriptor not found (/opt/backendless/repo/9088af67-1648-1726-ff09-a51862bf1a00/files/servercode/JS/v1/model.json)ā€}

as described above, you can replicate just running a GET on the users table. This is again preventing customers from buying our product, already for days

please resolve this and also let me know how we can make sure this does not happen, we keep having the same issue every few weeks

thank you for your help as always