zfs send/recv invalid data

[Steven Hartland]

----- Original Message ----- 
From: "Larry Rosenman" <ler at lerctr.org>
>>>>>>> I received an "invalid data" in a zfs send (from 8.3) / zfs recv (to 
>>>>>>> 10.0) of a -R -I stream.
>>>>>>> What data do I need to gather to figure out what side and what's wrong?
>>>>>>> I've already started zpool scrubs on both sides.
>>>>>>> I can insert a tee to grab the stream on either/both sides if that 
>>>>>>> would  help.
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>> Is the problem repeatable or is it just a network glitch?
>>>>>> Ronald.
>>>>> Repeatable.......
>>>> 
>>>> Here is the exact error message:
>>>> receiving incremental stream of vault/home/ctr at 2013-03-05-test3 into 
>>>> zroot/backups/TBH/home/ctr at 2013-03-05-test3
>>>> cannot receive incremental stream: invalid backup stream
>>>> this is the script I'm running:
>>>> #!/bin/sh
>>>> DATE=`date "+%Y-%m-%d-BUG-REPRO"`
>>>> DATE2=`date -v "-1d" "+%Y-%m-%d"`
>>>> # snap the source
>>>> ssh root at tbh.lerctr.org zfs snapshot -r vault@${DATE}
>>>> # zfs copy the source to here.
>>>> ssh root at tbh.lerctr.org "zfs send  -R -D  -I vault@${DATE2} vault@${DATE} 
>>>> | \
>>>>      tee /tmp/backup.stream.send.${DATE} | \
>>>>      ssh home.lerctr.org \"tee /tmp/backup.stream.receive.${DATE} | zfs 
>>>> recv  -u -v -d zroot/backups/TBH\""
>>>> # make sure we NEVER allow the backup stuff to automount.
>>>> /sbin/zfs list -H -t filesystem -r zroot/backups/TBH| \
>>>>     awk '{printf "/sbin/zfs set canmount=noauto %s\n",$1}' | sh
>>>> both streams are in http://www.lerctr.org/~ler/ZFS_RECV
>>> 
>>> Your send and receive sides differ, which indicates your ssh
>>> shell my not be clean.
>>> 
>>> Looking at the receive side its got what looks like a mail
>>> message appended.
>>> 
>>> I suspect if you manually copy the receive copy to the 10 machine and
>>> the receive it will work fine.
>>
>> we're copying mail files........
>>
>> and it still fails....
>>
> I've put more example send/recv files in that directory.
> 
> we're copying home dirs, which include lots of mail.
> 
> (this one is my wife's)
> 
> Ideas?
> 
> I *CAN* give access to both sides via ssh.....

The copy of the data stream on both sides should be identical
though and its not, which leads me to believe something is
corrupting the data on the way. Try the following:-

>From source:-
zfs send -R -D -I vault@${DATE2} vault@${DATE} > test.stream
scp test.stream home.lerctr.org:~/
>From target:
zfs recv  -u -v -d zroot/backups/TBH < test.stream

If this works then there is something unclean about your ssh
shell.

    Regards
    Steve




================================================
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. 

In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337
or return the E.mail to postmaster at multiplay.co.uk.