App Id: 8149FCCE-07DA-F988-FFBB-6154872C9500
Can tables be recovered and restored under a different name? I’m missing records for 3/25 in 3 important tables, but if those tables are replaced I would lose important 3/26 records created after the outage.
If you can store them under different names, I would appreciate recovery of the following three tables:
schedules
schedrts
offers
If recovery would overwrite current data, I’d rather not recover them.
Thank you
Hello @Kelly_Oglesby
We’re currently focused on the restoration process. Please note that this might take some time due to the unique nature of each case. Rest assured, we are working diligently to complete the work as quickly as possible. We’ll keep you updated and let you know as soon as everything is restored.
Thank you for your patience and understanding.
I have provided instructions in a private message
https://support.backendless.com/t/re-outage-data-recovery/17931
I originally replied that the files contain duplicate records, but I think I now understand that the records repeat if they have relations. Can these files be imported “as-is” without violating Unique constraints, and will relations be maintained without me doing anything beyond importing them?
Also, do all files have to be imported in the same operation to maintain relationships, or can I do one at a time?
Thank you,
Kelly
I’m running out of time restoring the files you recovered, so I tried importing three related csv files all together, untouched. The CSVs are “schedules”, “schedrts” and “offers”. schedules and schedrts appear to have imported correctly. The offers table was not imported, I have no idea why. No errors in the import log file, as you can see below. See line 43.
I noticed a few things about the filed that failed.
1 - each record is repeated 3 times
2 - The offers table has three relation columns - “schedrt”, “offeree”, and “company”. The schedrt relation column contains a correct objectId in the first copy of the repeated records, but the other two relations are always null. Without those objectIds, I can’t even write a program to restore these records, nor would I be able to recreate them manually. So I’m stuck.
Any ideas?
1 21:51:16 IMPORT_DATA Importing Started.
2 21:51:16 IMPORT_DATA Preparing files to import
3 21:51:16 IMPORT_DATA Creating temporary tables
4 21:51:16 IMPORT_DATA Creating user's tables
5 21:51:16 IMPORT_DATA Checking for existing views with the same names as in imported tables
6 21:51:16 IMPORT_DATA Checking denied, duplicate and dataSize for columns.
7 21:51:16 IMPORT_DATA Preparing schedules table: initializing columns.
8 21:51:16 IMPORT_DATA Preparing schedrts table: initializing columns.
9 21:51:19 IMPORT_DATA Preparing offers table: initializing columns.
10 21:51:23 IMPORT_DATA Preparing schedules table: updating column related IDs.
11 21:51:23 IMPORT_DATA Preparing schedrts table: updating column related IDs.
12 21:51:23 IMPORT_DATA Preparing offers table: updating column related IDs.
13 21:51:23 IMPORT_DATA Preparing schedules table: initializing relations.
14 21:51:23 IMPORT_DATA Preparing schedrts table: initializing relations.
15 21:51:23 IMPORT_DATA Preparing offers table: initializing relations.
16 21:51:23 IMPORT_DATA Resolving related table.
17 21:51:23 IMPORT_DATA Getting meta-info about insetable tables.
18 21:51:24 IMPORT_DATA Start import table: schedules
19 21:51:24 IMPORT_DATA Started import data from csv schedules.csv
20 21:51:24 IMPORT_DATA Will perform Inserting or ignore (on duplicate by objectId).
21 21:51:24 IMPORT_DATA Reading next portion (0) of data from csv schedules.csv.
22 21:51:24 IMPORT_DATA Created new import subtask (1) for schedules.csv with 1 elements.
23 21:51:24 IMPORT_DATA Reading next portion (1) of data from csv schedules.csv.
24 21:51:24 IMPORT_DATA Started import subtask (1) for schedules table.
25 21:51:24 IMPORT_DATA Table 'schedules' was imported at 0 seconds. Saved 1 records.
26 21:51:24 IMPORT_DATA Finish import table: schedules
27 21:51:24 IMPORT_DATA Start import table: schedrts
28 21:51:24 IMPORT_DATA Started import data from csv schedrts.csv
29 21:51:24 IMPORT_DATA Will perform Inserting or ignore (on duplicate by objectId).
30 21:51:24 IMPORT_DATA Reading next portion (0) of data from csv schedrts.csv.
31 21:51:24 IMPORT_DATA Created new import subtask (1) for schedrts.csv with 222 elements.
32 21:51:24 IMPORT_DATA Reading next portion (1) of data from csv schedrts.csv.
33 21:51:24 IMPORT_DATA Started import subtask (1) for schedrts table.
34 21:51:25 IMPORT_DATA Table 'schedrts' was imported at 0 seconds. Saved 111 records.
35 21:51:25 IMPORT_DATA Finish import table: schedrts
36 21:51:25 IMPORT_DATA Start import table: offers
37 21:51:25 IMPORT_DATA Started import data from csv offers.csv
38 21:51:25 IMPORT_DATA Will perform Inserting or ignore (on duplicate by objectId).
39 21:51:25 IMPORT_DATA Reading next portion (0) of data from csv offers.csv.
40 21:51:25 IMPORT_DATA Created new import subtask (1) for offers.csv with 334 elements.
41 21:51:25 IMPORT_DATA Reading next portion (1) of data from csv offers.csv.
42 21:51:25 IMPORT_DATA Started import subtask (1) for offers table.
43 21:51:25 IMPORT_DATA Table 'offers' was imported at 0 seconds. Saved 0 records. <-------
44 21:51:25 IMPORT_DATA Finish import table: offers
45 21:51:26 IMPORT_DATA Started restoring relations.
46 21:51:26 IMPORT_DATA Counting relations.
47 21:51:26 IMPORT_DATA Importing 110 relations.
48 21:51:26 IMPORT_DATA Importing 110 relations from 'schedules(routes)' to 'schedrts', relation table 'schedules.schedrts.routes'.
49 21:51:26 IMPORT_DATA Will try by 10k records (1 batches):
50 21:51:26 IMPORT_DATA Preparing 10k-batch - 0
51 21:51:26 IMPORT_DATA 10k-batch - 0 has been inserted successfully.
52 21:51:26 IMPORT_DATA Imported 110 relations from 'schedules(routes)' to 'schedrts'.
53 21:51:26 IMPORT_DATA Total imported relations: 110
54 21:51:26 IMPORT_DATA Checking for existing tables with the same names as in imported views
55 21:51:26 IMPORT_DATA Clearing user data table cache.
56 21:51:27 IMPORT_DATA Deleting temporary tables.
57 21:51:27 IMPORT_DATA Finishing pointers export.
58 21:51:27 IMPORT_DATA Start import pointers for table: schedrts
59 21:51:27 IMPORT_DATA Finished import of table: schedrts
60 21:51:27 IMPORT_DATA Start import pointers for table: offers
61 21:51:27 IMPORT_DATA Finished import of table: offers
62 21:51:27 IMPORT_DATA Restoring expiration tasks for DeviceRegistrations.
63 21:51:27 IMPORT_DATA Import finished.
The zip I have provided may not have links to old data. Because what I have done is run bulk remove on each table with the following query: created < '03/24/2024 11:03' .
So if after 03/24/2024 11:03 there is added new data and linked to the old record, the link will be removed, because I have removed old data.
The other option that we can do for you I can provide you a zip with all data up until March 26, and you import it without overwriting option
You should unzip the file and add all files at the same time
@Kelly_Oglesby I have attached full zip to the private message https://support.backendless.com/t/re-outage-data-recovery/17931/2?u=sergey.kuk
