AH! - XenOrchestra Backups and Restore

hobbit666

OK so it's my fault for deleting the wrong VM! but why can't I restore from my XenOrchestra backups? It's showing 6 Delta available, it shows importing in XenCenter while restoring but when it finishes it just vanishes.

This is the log regarding the restore:-

vm.importDeltaBackup
{
  "remote": "remote-2",
  "filePath": "vm_delta_MainJob_0cf8f1a7-9c68-f57e-d3ce-6e055afe2803/20161005T203132Z_SnipeIT",
  "sr": "2a9ead76-51af-7c74-e44f-00bc645e4187"
}
{
  "message": "VDI_IO_ERROR(Device I/O errors)",
  "stack": "XapiError: VDI_IO_ERROR(Device I/O errors)\n    at wrapError (/opt/xo-server/node_modules/xen-api/src/index.js:97:34)\n    at /source/xapi/index.js:128:51\n    at /opt/xo-server/node_modules/lodash/_createBaseFor.js:17:11\n    at baseForOwn (/opt/xo-server/node_modules/lodash/_baseForOwn.js:13:20)\n    at /opt/xo-server/node_modules/lodash/_createBaseEach.js:17:14\n    at forEach (/opt/xo-server/node_modules/lodash/forEach.js:38:10)\n    at Collection.onAddOrUpdate (/source/xapi/index.js:100:14)\n    at Collection.patchedError [as emit] (/opt/xo-server/bin/xo-server:27:17)\n    at /opt/xo-server/node_modules/xo-collection/src/collection.js:280:15\n    at /opt/xo-server/node_modules/lodash._baseeach/index.js:110:11\n    at baseForOwn (/opt/xo-server/node_modules/lodash._baseeach/index.js:52:10)\n    at /opt/xo-server/node_modules/lodash._baseeach/index.js:80:14\n    at /opt/xo-server/node_modules/lodash.foreach/index.js:26:9\n    at /opt/xo-server/node_modules/xo-collection/src/collection.js:278:14\n    at _combinedTickCallback (internal/process/next_tick.js:67:7)\n    at process._tickCallback (internal/process/next_tick.js:98:9)",
  "code": "VDI_IO_ERROR",
  "params": [
    "Device I/O errors"
  ]
}

travisdh1

Is your storage repository in XenServer ok? That would be my first thing to check when looking at that VDI_IO_ERROR.

Paging @olivier, who should know a little more about why you're getting that error message.

hobbit666

@travisdh1 said in AHHHHHHHHHHHHHHHH!!!!!!! - XenOrch Backups and Restore:

Is your storage repository in XenServer ok? That would be my first thing to check when looking at that VDI_IO_ERROR.

As far as I can tell yes SR is ok and all other VM's are running.
Going to try a reboot on the host see what happens.

hobbit666

Rebooted still the same
Different VM

vm.importDeltaBackup
{
  "remote": "remote-2",
  "filePath": "vm_delta_MainJob_2240c4bd-2d96-b556-87f4-e2894c5a1292/20161008T202954Z_SnipeV3",
  "sr": "2a9ead76-51af-7c74-e44f-00bc645e4187"
}
{
  "message": "VDI_IO_ERROR(Device I/O errors)",
  "stack": "XapiError: VDI_IO_ERROR(Device I/O errors)\n    at wrapError (/opt/xo-server/node_modules/xen-api/src/index.js:97:34)\n    at /source/xapi/index.js:128:51\n    at /opt/xo-server/node_modules/lodash/_createBaseFor.js:17:11\n    at baseForOwn (/opt/xo-server/node_modules/lodash/_baseForOwn.js:13:20)\n    at /opt/xo-server/node_modules/lodash/_createBaseEach.js:17:14\n    at forEach (/opt/xo-server/node_modules/lodash/forEach.js:38:10)\n    at Collection.onAddOrUpdate (/source/xapi/index.js:100:14)\n    at Collection.patchedError [as emit] (/opt/xo-server/bin/xo-server:27:17)\n    at /opt/xo-server/node_modules/xo-collection/src/collection.js:280:15\n    at /opt/xo-server/node_modules/lodash._baseeach/index.js:110:11\n    at baseForOwn (/opt/xo-server/node_modules/lodash._baseeach/index.js:52:10)\n    at /opt/xo-server/node_modules/lodash._baseeach/index.js:80:14\n    at /opt/xo-server/node_modules/lodash.foreach/index.js:26:9\n    at /opt/xo-server/node_modules/xo-collection/src/collection.js:278:14\n    at _combinedTickCallback (internal/process/next_tick.js:67:7)\n    at process._tickCallback (internal/process/next_tick.js:98:9)",
  "code": "VDI_IO_ERROR",
  "params": [
    "Device I/O errors"
  ]
}

DustinB3403

Based on the error message the exported VDI may be corrupted.

Have you tried another of the 6 deltas?

hobbit666

@DustinB3403 said in AHHHHHHHHHHHHHHHH!!!!!!! - XenOrch Backups and Restore:

Based on the error message the exported VDI may be corrupted.

Have you tried another of the 6 deltas?

Not all but have tried 2-3 will try all 6 tomorrow.
Currently in a caravan an hour from home

scottalanmiller

Edited the title so that it could be found

Danp

What version of XO? There's a bug dealing with delta backups that was recently fixed in XO 5.3.

hobbit666

@Danp
Dam!
XO-Server 5.2.5 - XO-Web 5.2.3

DustinB3403

@hobbit666 said in AH! - XenOrchestra Backups and Restore:

@Danp
Dam!
XO-Server 5.2.5 - XO-Web 5.2.3

Well upgrading at this point won't "fix" your existing backups. But it would certainly help in the future. . .

As for the current situation, any luck with the other backups you have?

BRRABill

@Danp said in AH! - XenOrchestra Backups and Restore:

What version of XO? There's a bug dealing with delta backups that was recently fixed in XO 5.3.

You always have the XO answer!

Damn is right!

hobbit666

Not sure how or what ....... but just loaded up the XenCenter on laptop at home and my SnipeV3 VM is there ??? not sure which backup worked but i'm back.

OK missing about 20 days worth of assets but at least most are there.

Job for tomorrow sort my backup and get latest version of Xen Orchestra install. Also make a Backup review and test plan.

travisdh1

@hobbit666 said in AH! - XenOrchestra Backups and Restore:

Not sure how or what ....... but just loaded up the XenCenter on laptop at home and my SnipeV3 VM is there ??? not sure which backup worked but i'm back.

OK missing about 20 days worth of assets but at least most are there.

Job for tomorrow sort my backup and get latest version of Xen Orchestra install. Also make a Backup review and test plan.

Yep, unless you've restored from it, you don't really have a backup.

DustinB3403

A really nice thing about XO is you can import and not power on.

So you can remove the NIC and then power on. If it works, you know you're in good shape.