Bug 1156448

Summary: btrfs: failed to load free space cache for block group
Product: [openSUSE] openSUSE Distribution Reporter: Jon Nelson <jnelson-suse>
Component: KernelAssignee: Wenruo Qu <wqu>
Status: RESOLVED NORESPONSE QA Contact: E-mail List <qa-bugs>
Severity: Normal    
Priority: P5 - None CC: jnelson-suse, nborisov, rgoldwyn
Version: Leap 15.1   
Target Milestone: ---   
Hardware: x86-64   
OS: Other   
Whiteboard:
Found By: --- Services Priority:
Business Priority: Blocker: ---
Marketing QA Status: --- IT Deployment: ---

Description Jon Nelson 2019-11-11 13:54:57 UTC
User-Agent:       Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Firefox/68.0
Build Identifier: 

Nov 10 09:37:20 turnip kernel: BTRFS warning (device sdc2): block group 3657307324416 has wrong amount of free space
Nov 10 09:37:20 turnip kernel: BTRFS warning (device sdc2): failed to load free space cache for block group 3657307324416, rebuilding it now
Nov 10 09:37:21 turnip kernel: BTRFS warning (device sdc2): block group 3659454808064 has wrong amount of free space
Nov 10 09:37:21 turnip kernel: BTRFS warning (device sdc2): failed to load free space cache for block group 3659454808064, rebuilding it now
Nov 10 09:37:21 turnip kernel: BTRFS warning (device sdc2): block group 3673581223936 has wrong amount of free space
Nov 10 09:37:21 turnip kernel: BTRFS warning (device sdc2): failed to load free space cache for block group 3673581223936, rebuilding it now
Nov 10 09:37:21 turnip kernel: BTRFS warning (device sdc2): block group 3676802449408 has wrong amount of free space
Nov 10 09:37:21 turnip kernel: BTRFS warning (device sdc2): failed to load free space cache for block group 3676802449408, rebuilding it now
Nov 10 09:37:21 turnip kernel: BTRFS warning (device sdc2): block group 3681097416704 has wrong amount of free space
Nov 10 09:37:21 turnip kernel: BTRFS warning (device sdc2): failed to load free space cache for block group 3681097416704, rebuilding it now
Nov 10 09:37:22 turnip kernel: BTRFS warning (device sdc2): block group 3715994025984 has wrong amount of free space
Nov 10 09:37:22 turnip kernel: BTRFS warning (device sdc2): failed to load free space cache for block group 3715994025984, rebuilding it now
Nov 10 09:37:22 turnip kernel: BTRFS warning (device sdc2): block group 3742837571584 has wrong amount of free space
Nov 10 09:37:22 turnip kernel: BTRFS warning (device sdc2): failed to load free space cache for block group 3742837571584, rebuilding it now
Nov 10 09:37:23 turnip kernel: BTRFS warning (device sdc2): block group 3751427506176 has wrong amount of free space
Nov 10 09:37:23 turnip kernel: BTRFS warning (device sdc2): failed to load free space cache for block group 3751427506176, rebuilding it now
Nov 10 09:37:23 turnip kernel: BTRFS warning (device sdc2): block group 3752501248000 has wrong amount of free space
Nov 10 09:37:23 turnip kernel: BTRFS warning (device sdc2): failed to load free space cache for block group 3752501248000, rebuilding it now


Reproducible: Sometimes

Steps to Reproduce:
1. perform heavy I/O + ????




Seems kinda scary.

This is on a four drive raid10 (not md raid 10, but btrfs raid10).
Comment 1 Wenruo Qu 2019-11-19 13:27:00 UTC
Would you mind to provide the kernel version?

And if possible please run a btrfs check --readonly on the device and provide the output.
It could provide more info than the kernel message.

BTW, this is indeed scary, but even some bad space cache sneaked into the kernel, at least latest upstream kernel can detect and error out more or less gracefully (by aborting current transaction and marking the fs RO, without writing the bad data onto disk).


If you want a quick workaround, you can try "btrfs check --clear-space-cache v1" then mount the fs with "-o nospace_cache" or "-o space_cache=v2".
Comment 2 Jon Nelson 2019-11-19 13:50:12 UTC
Kernel: probably  vmlinuz-4.12.14-lp151.28.25-default. I'm currently on vmlinuz-4.12.14-lp151.28.32-default.

Since this is the root fs of my primary server, it's somewhat difficult to run a filesystem check.

I'm going to try clearing the cache.

/me crosses fingers...
Comment 3 Wenruo Qu 2019-11-19 13:58:27 UTC
(In reply to Jon Nelson from comment #2)
> Kernel: probably  vmlinuz-4.12.14-lp151.28.25-default. I'm currently on
> vmlinuz-4.12.14-lp151.28.32-default.
> 
> Since this is the root fs of my primary server, it's somewhat difficult to
> run a filesystem check.
> 
> I'm going to try clearing the cache.
> 
> /me crosses fingers...

Then please note that, "-o clear_cache" will only clear the cache of modified block groups, not all (unless you run a full fs balance).

In your case, the kernel is SLE kernel, I'm not sure how good the v2 cache is supported.

So I would recommend nospace_cache mount option just to be safe.


BTW, is there any unexpected shutdown in the past?
Comment 4 Jon Nelson 2019-11-19 18:03:05 UTC
(In reply to Wenruo Qu from comment #3)
> (In reply to Jon Nelson from comment #2)
> > Kernel: probably  vmlinuz-4.12.14-lp151.28.25-default. I'm currently on
> > vmlinuz-4.12.14-lp151.28.32-default.
> > 
> > Since this is the root fs of my primary server, it's somewhat difficult to
> > run a filesystem check.
> > 
> > I'm going to try clearing the cache.
> > 
> > /me crosses fingers...
> 
> Then please note that, "-o clear_cache" will only clear the cache of
> modified block groups, not all (unless you run a full fs balance).
> 
> In your case, the kernel is SLE kernel, I'm not sure how good the v2 cache
> is supported.
> 
> So I would recommend nospace_cache mount option just to be safe.
> 
> 
> BTW, is there any unexpected shutdown in the past?

Yes. There have been unexpected shutdowns.
I've tried to zero the free-space cache with:

btrfs check --clear-space-cache v1  (and v2) /path/to/device

turnip:~/btrfs-stuff # btrfs check --clear-space-cache v1 --progress /dev/sdd                                                                       
Opening filesystem to check...
Checking filesystem on /dev/sdd
UUID: ee122800-2365-435f-98b6-43d87220eed3
Failed to find [458534305792, 168, 16384]
btrfs unable to find ref byte nr 458534322176 parent 0 root 2  owner 0 offset 0
transaction.c:195: btrfs_commit_transaction: BUG_ON `ret` triggered, value -5
btrfs(+0x517f9)[0x5617e68047f9]
btrfs(btrfs_commit_transaction+0x1ae)[0x5617e6804dee]
btrfs(btrfs_clear_free_space_cache+0xdc)[0x5617e67f791c]
btrfs(+0x1549a)[0x5617e67c849a]
btrfs(cmd_check+0x103a)[0x5617e681a2ba]
btrfs(main+0x8e)[0x5617e67d1cee]
/lib64/libc.so.6(__libc_start_main+0xea)[0x7fa7db7d2f8a]
btrfs(_start+0x2a)[0x5617e67d1eea]
Aborted (core dumped)
turnip:~/btrfs-stuff # 

and v2:

turnip:~/btrfs-stuff # btrfs check --clear-space-cache v2 --progress /dev/sdd
Opening filesystem to check...
Checking filesystem on /dev/sdd
UUID: ee122800-2365-435f-98b6-43d87220eed3
no free space cache v2 to clear
turnip:~/btrfs-stuff # 


However:

turnip:~/btrfs-stuff # btrfs check --progress --repair /dev/sdd
enabling repair mode
Opening filesystem to check...
Checking filesystem on /dev/sdd
UUID: ee122800-2365-435f-98b6-43d87220eed3
[1/7] checking root items                      (0:02:04 elapsed, 4421430 items checked)
Fixed 0 roots.
ref mismatch on [396233342976 16384] extent item 1, found 0psed, 534516 items checked)
backref 396233342976 root 2 not referenced back 0x559509e1cfd0
incorrect global backref count on 396233342976 found 1 wanted 0
backpointer mismatch on [396233342976 16384]
owner ref check failed [396233342976 16384]
repair deleting extent record: key [396233342976,169,0] elapsed, 534775 items checked)
Repaired extent references for 396233342976    (0:06:53 elapsed, 534775 items checked)
ref mismatch on [396233572352 16384] extent item 0, found 1
tree backref 396233572352 parent 2 root 2 not found in extent tree
backpointer mismatch on [396233572352 16384]
adding new tree backref on start 396233572352 len 16384 parent 0 root 2
Repaired extent references for 396233572352
ref mismatch on [458533601280 16384] extent item 1, found 0
backref 458533601280 root 2 not referenced back 0x5595319094a0
incorrect global backref count on 458533601280 found 1 wanted 0
backpointer mismatch on [458533601280 16384]
owner ref check failed [458533601280 16384]
repair deleting extent record: key [458533601280,169,0]
Repaired extent references for 458533601280
ref mismatch on [458533912576 16384] extent item 0, found 1
tree backref 458533912576 parent 2 root 2 not found in extent tree
backpointer mismatch on [458533912576 16384]
adding new tree backref on start 458533912576 len 16384 parent 0 root 2
Repaired extent references for 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 1145675 items checked)
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
ctree.c:1147: btrfs_search_slot: Warning: assertion `p->nodes[0] != NULL` failed, value 1
btrfs(btrfs_search_slot+0xcb)[0x5594e661061b]
btrfs(btrfs_write_dirty_block_groups+0x11d)[0x5594e661a6dd]
btrfs(commit_tree_roots+0x118)[0x5594e663ea18]
btrfs(btrfs_commit_transaction+0xc6)[0x5594e663ed06]
btrfs(+0x1e709)[0x5594e660b709]
btrfs(cmd_check+0x1124)[0x5594e66543a4]
btrfs(main+0x8e)[0x5594e660bcee]
/lib64/libc.so.6(__libc_start_main+0xea)[0x7f8d28ff7f8a]
btrfs(_start+0x2a)[0x5594e660beea]
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
parent transid verify failed on 458533912576 wanted 11409 found 11456
Ignoring transid failure
leaf parent key incorrect 458533912576
Failed to find [458534305792, 168, 16384]
btrfs unable to find ref byte nr 458534322176 parent 0 root 2  owner 0 offset 0
transaction.c:195: btrfs_commit_transaction: BUG_ON `ret` triggered, value -5
btrfs(+0x517f9)[0x5594e663e7f9]
btrfs(btrfs_commit_transaction+0x1ae)[0x5594e663edee]
btrfs(+0x1e709)[0x5594e660b709]
btrfs(cmd_check+0x1124)[0x5594e66543a4]
btrfs(main+0x8e)[0x5594e660bcee]
/lib64/libc.so.6(__libc_start_main+0xea)[0x7f8d28ff7f8a]
btrfs(_start+0x2a)[0x5594e660beea]
Aborted (core dumped)
turnip:~/btrfs-stuff # vi /etc/fstab ^C
turnip:~/btrfs-stuff #
Comment 5 Jon Nelson 2019-11-19 23:18:19 UTC
More info.
After booting into openSUSE Leap 15.1 rescue, and running a full `btrfs check ....` I got this after rebooting. :-(


[ 8948.993649] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8949.003792] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8949.020758] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8949.038369] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8949.049136] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8949.062321] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8949.083388] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8949.146457] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8953.263393] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8953.274083] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8953.282721] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8953.293688] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8953.303499] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8953.318200] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8953.333279] BTRFS info (device sda4): qgroup_rescan_init failed with -22
[ 8953.403384] BTRFS info (device sda4): qgroup_rescan_init failed with -22
Comment 6 Jon Nelson 2019-11-19 23:22:31 UTC
and one of the other btrfs filesystems.
This is a big bummer.


[ 9142.459271] ------------[ cut here ]------------
[ 9142.459347] WARNING: CPU: 1 PID: 14035 at ../fs/btrfs/extent-tree.c:6994 __btrfs_free_extent.isra.63+0x1df/0xd40 [btrfs]
[ 9142.459349] Modules linked in: xt_nat veth ip6t_REJECT ip6table_mangle ip6table_nat nf_nat_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_raw nf_log_ipv6 ip6table_filter ip6_tables xt_recent ipt_REJECT xt_comment xt_multiport ipt_rpfilter xt_hashlimit xt_mark iptable_mangle xt_REDIRECT nf_nat_redirect xt_tcpudp xt_CT iptable_raw xt_NFLOG nfnetlink_log nf_log_ipv4 nf_log_common xt_LOG nf_conntrack_sane nf_nat_tftp nf_nat_snmp_basic nf_conntrack_snmp nf_nat_sip nf_nat_pptp nf_nat_proto_gre nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat_amanda nf_conntrack_tftp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_proto_gre nf_conntrack_netbios_ns nf_conntrack_broadcast nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp ts_kmp nf_conntrack_amanda sctp ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink
[ 9142.459408]  nfnetlink xfrm_user xfrm_algo iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter ip_tables xt_conntrack x_tables nf_nat nf_conntrack libcrc32c br_netfilter bridge af_packet 8021q garp mrp stp llc tun msr nls_utf8 sch_fq_codel isofs loop radeon ttm drm_kms_helper edac_mce_amd kvm_amd drm drm_panel_orientation_quirks fb_sys_fops syscopyarea ccp sysfillrect kvm wmi_bmof sysimgblt acpi_cpufreq button i2c_algo_bit r8169 irqbypass mii pcspkr sp5100_tco wmi k10temp i2c_piix4 hid_generic btrfs usbhid xor zstd_decompress zstd_compress xxhash raid1 md_mod raid6_pq ata_generic ohci_pci pata_atiixp serio_raw ohci_hcd ehci_pci ehci_hcd ahci usbcore libahci sg nbd dm_multipath dm_mod scsi_dh_rdac scsi_dh_emc scsi_dh_alua
[ 9142.459494] CPU: 1 PID: 14035 Comm: btrfs Tainted: G        W        4.12.14-lp151.28.32-default #1 openSUSE Leap 15.1
[ 9142.459497] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./HZ03-GT-V2, BIOS 080015  12/24/2010
[ 9142.459501] task: ffff8800b7bae000 task.stack: ffffc90003414000
[ 9142.459556] RIP: 0010:__btrfs_free_extent.isra.63+0x1df/0xd40 [btrfs]
[ 9142.459560] RSP: 0018:ffffc900034179d8 EFLAGS: 00010246
[ 9142.459564] RAX: 00000000fffffffe RBX: 0000000000000000 RCX: 0000000000000008
[ 9142.459566] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff880034364af0
[ 9142.459568] RBP: 000002fe4cb00000 R08: 0000000000000000 R09: 0000000000000000
[ 9142.459570] R10: 0000000000000007 R11: ffff880034285620 R12: ffff880100490000
[ 9142.459573] R13: 00000000fffffffe R14: ffff88006017dd98 R15: ffff880034285620
[ 9142.459576] FS:  00007fddf09bd8c0(0000) GS:ffff88011fc40000(0000) knlGS:0000000000000000
[ 9142.459579] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 9142.459581] CR2: 00007fe78f30e000 CR3: 000000001ac2c000 CR4: 00000000000006e0
[ 9142.459583] Call Trace:
[ 9142.459655]  ? btrfs_merge_delayed_refs+0x323/0x380 [btrfs]
[ 9142.459707]  __btrfs_run_delayed_refs+0x2fe/0x1050 [btrfs]
[ 9142.459719]  ? __set_page_dirty_nobuffers+0xc5/0x140
[ 9142.459772]  btrfs_run_delayed_refs.part.69+0xd0/0x180 [btrfs]
[ 9142.459827]  btrfs_start_dirty_block_groups+0x3c8/0x4a0 [btrfs]
[ 9142.459885]  btrfs_commit_transaction+0xf6/0x960 [btrfs]
[ 9142.459943]  ? btrfs_record_root_in_trans+0x56/0x60 [btrfs]
[ 9142.459999]  ? start_transaction+0xb8/0x430 [btrfs]
[ 9142.460059]  btrfs_mksubvol+0x596/0x5b0 [btrfs]
[ 9142.460067]  ? wait_woken+0x80/0x80
[ 9142.460127]  btrfs_ioctl_snap_create_transid+0x189/0x190 [btrfs]
[ 9142.460189]  btrfs_ioctl_snap_create_v2+0x102/0x150 [btrfs]
[ 9142.460250]  btrfs_ioctl+0x5c9/0x1e70 [btrfs]
[ 9142.460258]  ? __handle_mm_fault+0x9c6/0x1210
[ 9142.460266]  ? do_vfs_ioctl+0x90/0x5f0
[ 9142.460269]  do_vfs_ioctl+0x90/0x5f0
[ 9142.460276]  SyS_ioctl+0x74/0x80
[ 9142.460284]  do_syscall_64+0x7b/0x160
[ 9142.460291]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[ 9142.460296] RIP: 0033:0x7fddefa39587
[ 9142.460298] RSP: 002b:00007ffd58f3b5b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 9142.460303] RAX: ffffffffffffffda RBX: 00007ffd58f4e8b0 RCX: 00007fddefa39587
[ 9142.460305] RDX: 00007ffd58f3b5d0 RSI: 0000000050009417 RDI: 0000000000000003
[ 9142.460307] RBP: 000055f5153558f0 R08: 000000000000ffff R09: feff2e333034362e
[ 9142.460310] R10: 0000000000000000 R11: 0000000000000246 R12: 000055f5153569f0
[ 9142.460312] R13: 00000000002c3f75 R14: 000055f515356920 R15: 00007ffd58f519a0
[ 9142.460316] Code: 49 89 d8 4c 8b 4c 24 20 48 89 e9 4c 89 f7 e8 69 c3 ff ff 41 89 c5 58 5a 45 85 ed 0f 84 85 00 00 00 41 83 fd fe 0f 85 12 ff ff ff <0f> 0b 49 8b 37 4c 89 e7 e8 14 de 00 00 ff b4 24 a8 00 00 00 4c 
[ 9142.460375] ---[ end trace 5a3a4511e923e402 ]---
[ 9142.460384] BTRFS info (device sdc2): leaf 41566208 total ptrs 183 free space 5264
[ 9142.460388] 	item 0 key (3291230535680 169 0) itemoff 16178 itemsize 105
[ 9142.460391] 		extent refs 9 gen 53116 flags 2
[ 9142.460393] 		ref#0: tree block backref root 20062
[ 9142.460396] 		ref#1: tree block backref root 18983
[ 9142.460399] 		ref#2: tree block backref root 17198
[ 9142.460401] 		ref#3: shared block backref parent 3454507909120
[ 9142.460404] 		ref#4: shared block backref parent 696277385216
[ 9142.460407] 		ref#5: shared block backref parent 893468672
[ 9142.460409] 		ref#6: shared block backref parent 834338816
[ 9142.460411] 		ref#7: shared block backref parent 834191360
[ 9142.460414] 		ref#8: shared block backref parent 831242240
[ 9142.460419] 	item 1 key (3291230552064 169 0) itemoff 16145 itemsize 33
[ 9142.460421] 		extent refs 1 gen 53116 flags 2
[ 9142.460422] 		ref#0: shared block backref parent 831242240
[ 9142.460427] 	item 2 key (3291230568448 169 0) itemoff 16040 itemsize 105
[ 9142.460429] 		extent refs 9 gen 53116 flags 2
[ 9142.460431] 		ref#0: tree block backref root 20062
[ 9142.460434] 		ref#1: tree block backref root 18983
[ 9142.460436] 		ref#2: shared block backref parent 479272075264
[ 9142.460439] 		ref#3: shared block backref parent 617398272
[ 9142.460441] 		ref#4: shared block backref parent 617332736
[ 9142.460443] 		ref#5: shared block backref parent 617005056
[ 9142.460446] 		ref#6: shared block backref parent 616775680
[ 9142.460448] 		ref#7: shared block backref parent 616529920
[ 9142.460450] 		ref#8: shared block backref parent 616497152
[ 9142.460455] 	item 3 key (3291230584832 169 0) itemoff 15935 itemsize 105
[ 9142.460457] 		extent refs 9 gen 53116 flags 2
[ 9142.460458] 		ref#0: tree block backref root 20062
[ 9142.460461] 		ref#1: tree block backref root 18983
[ 9142.460463] 		ref#2: shared block backref parent 479272075264
[ 9142.460465] 		ref#3: shared block backref parent 617398272
[ 9142.460468] 		ref#4: shared block backref parent 617332736
[ 9142.460470] 		ref#5: shared block backref parent 617005056
[ 9142.460472] 		ref#6: shared block backref parent 616775680
[ 9142.460475] 		ref#7: shared block backref parent 616529920
[ 9142.460477] 		ref#8: shared block backref parent 616497152
[ 9142.460481] 	item 4 key (3291230601216 169 0) itemoff 15830 itemsize 105
[ 9142.460485] 		extent refs 9 gen 53116 flags 2
[ 9142.460486] 		ref#0: tree block backref root 20062
[ 9142.460488] 		ref#1: tree block backref root 18983
[ 9142.460490] 		ref#2: shared block backref parent 479272075264
[ 9142.460493] 		ref#3: shared block backref parent 617398272
[ 9142.460495] 		ref#4: shared block backref parent 617332736
[ 9142.460497] 		ref#5: shared block backref parent 617005056
[ 9142.460500] 		ref#6: shared block backref parent 616775680
[ 9142.460502] 		ref#7: shared block backref parent 616529920
[ 9142.460504] 		ref#8: shared block backref parent 616497152
[ 9142.460509] 	item 5 key (3291230617600 169 0) itemoff 15725 itemsize 105
[ 9142.460511] 		extent refs 9 gen 53116 flags 2
[ 9142.460512] 		ref#0: tree block backref root 20062
[ 9142.460514] 		ref#1: tree block backref root 18983
[ 9142.460516] 		ref#2: tree block backref root 17198
[ 9142.460519] 		ref#3: shared block backref parent 3454507909120
[ 9142.460521] 		ref#4: shared block backref parent 696277385216
[ 9142.460523] 		ref#5: shared block backref parent 893468672
[ 9142.460526] 		ref#6: shared block backref parent 834338816
[ 9142.460528] 		ref#7: shared block backref parent 834191360
[ 9142.460530] 		ref#8: shared block backref parent 831242240
[ 9142.460535] 	item 6 key (3291230633984 169 1) itemoff 15692 itemsize 33
[ 9142.460537] 		extent refs 1 gen 95214 flags 2
[ 9142.460538] 		ref#0: tree block backref root 7
[ 9142.460542] 	item 7 key (3291230650368 169 0) itemoff 15587 itemsize 105
[ 9142.460544] 		extent refs 9 gen 53116 flags 2
[ 9142.460546] 		ref#0: tree block backref root 20062
[ 9142.460548] 		ref#1: tree block backref root 18983
[ 9142.460550] 		ref#2: tree block backref root 17198
[ 9142.460552] 		ref#3: shared block backref parent 3454507909120
[ 9142.460555] 		ref#4: shared block backref parent 696277385216
[ 9142.460557] 		ref#5: shared block backref parent 893468672
[ 9142.460560] 		ref#6: shared block backref parent 834338816
[ 9142.460562] 		ref#7: shared block backref parent 834191360
[ 9142.460564] 		ref#8: shared block backref parent 831242240
[ 9142.460569] 	item 8 key (3291230666752 169 0) itemoff 15482 itemsize 105
[ 9142.460571] 		extent refs 9 gen 53116 flags 2
[ 9142.460572] 		ref#0: tree block backref root 20062
[ 9142.460574] 		ref#1: tree block backref root 18983
[ 9142.460576] 		ref#2: tree block backref root 17198
[ 9142.460579] 		ref#3: shared block backref parent 3454507909120
[ 9142.460581] 		ref#4: shared block backref parent 696277385216
[ 9142.460583] 		ref#5: shared block backref parent 893468672
[ 9142.460586] 		ref#6: shared block backref parent 834338816
[ 9142.460588] 		ref#7: shared block backref parent 834191360
[ 9142.460590] 		ref#8: shared block backref parent 831242240
[ 9142.460595] 	item 9 key (3291230683136 169 0) itemoff 15449 itemsize 33
[ 9142.460597] 		extent refs 1 gen 95214 flags 2
[ 9142.460598] 		ref#0: tree block backref root 7
[ 9142.460602] 	item 10 key (3291230699520 169 0) itemoff 15344 itemsize 105
[ 9142.460604] 		extent refs 9 gen 53116 flags 2
[ 9142.460606] 		ref#0: tree block backref root 20062
[ 9142.460608] 		ref#1: tree block backref root 18983
[ 9142.460610] 		ref#2: shared block backref parent 479272075264
[ 9142.460613] 		ref#3: shared block backref parent 617398272
[ 9142.460615] 		ref#4: shared block backref parent 617332736
[ 9142.460617] 		ref#5: shared block backref parent 617005056
[ 9142.460620] 		ref#6: shared block backref parent 616775680
[ 9142.460622] 		ref#7: shared block backref parent 616529920
[ 9142.460624] 		ref#8: shared block backref parent 616497152
[ 9142.460629] 	item 11 key (3291230715904 169 0) itemoff 15239 itemsize 105
[ 9142.460631] 		extent refs 9 gen 53116 flags 2
[ 9142.460632] 		ref#0: tree block backref root 20062
[ 9142.460634] 		ref#1: tree block backref root 18983
[ 9142.460637] 		ref#2: tree block backref root 17198
[ 9142.460639] 		ref#3: shared block backref parent 3454507909120
[ 9142.460641] 		ref#4: shared block backref parent 696277385216
[ 9142.460644] 		ref#5: shared block backref parent 893468672
[ 9142.460646] 		ref#6: shared block backref parent 834338816
[ 9142.460648] 		ref#7: shared block backref parent 834191360
[ 9142.460650] 		ref#8: shared block backref parent 831242240
[ 9142.460655] 	item 12 key (3291230732288 169 0) itemoff 15134 itemsize 105
[ 9142.460657] 		extent refs 9 gen 53116 flags 2
[ 9142.460658] 		ref#0: tree block backref root 20062
[ 9142.460660] 		ref#1: tree block backref root 18983
[ 9142.460663] 		ref#2: tree block backref root 17198
[ 9142.460665] 		ref#3: shared block backref parent 3454507909120
[ 9142.460667] 		ref#4: shared block backref parent 696277385216
[ 9142.460670] 		ref#5: shared block backref parent 893468672
[ 9142.460672] 		ref#6: shared block backref parent 834338816
[ 9142.460674] 		ref#7: shared block backref parent 834191360
[ 9142.460677] 		ref#8: shared block backref parent 831242240
[ 9142.460681] 	item 13 key (3291230748672 169 0) itemoff 15029 itemsize 105
[ 9142.460683] 		extent refs 9 gen 53116 flags 2
[ 9142.460684] 		ref#0: tree block backref root 20062
[ 9142.460686] 		ref#1: tree block backref root 18983
[ 9142.460689] 		ref#2: tree block backref root 17198
[ 9142.460691] 		ref#3: shared block backref parent 3454507909120
[ 9142.460693] 		ref#4: shared block backref parent 696277385216
[ 9142.460696] 		ref#5: shared block backref parent 893468672
[ 9142.460698] 		ref#6: shared block backref parent 834338816
[ 9142.460700] 		ref#7: shared block backref parent 834191360
[ 9142.460703] 		ref#8: shared block backref parent 831242240
[ 9142.460707] 	item 14 key (3291230765056 169 0) itemoff 14924 itemsize 105
[ 9142.460709] 		extent refs 9 gen 53116 flags 2
[ 9142.460710] 		ref#0: tree block backref root 20062
[ 9142.460713] 		ref#1: tree block backref root 18983
[ 9142.460715] 		ref#2: shared block backref parent 479272075264
[ 9142.460717] 		ref#3: shared block backref parent 617398272
[ 9142.460720] 		ref#4: shared block backref parent 617332736
[ 9142.460722] 		ref#5: shared block backref parent 617005056
[ 9142.460724] 		ref#6: shared block backref parent 616775680
[ 9142.460726] 		ref#7: shared block backref parent 616529920
[ 9142.460729] 		ref#8: shared block backref parent 616497152
[ 9142.460733] 	item 15 key (3291230781440 169 0) itemoff 14891 itemsize 33
[ 9142.460735] 		extent refs 1 gen 95169 flags 2
[ 9142.460736] 		ref#0: tree block backref root 2
[ 9142.460741] 	item 16 key (3291230797824 169 0) itemoff 14858 itemsize 33
[ 9142.460743] 		extent refs 1 gen 95169 flags 2
[ 9142.460744] 		ref#0: tree block backref root 2
[ 9142.460748] 	item 17 key (3291230814208 169 0) itemoff 14825 itemsize 33
[ 9142.460750] 		extent refs 1 gen 95218 flags 2
[ 9142.460751] 		ref#0: tree block backref root 2
[ 9142.460755] 	item 18 key (3291230846976 169 0) itemoff 14720 itemsize 105
[ 9142.460757] 		extent refs 9 gen 53116 flags 2
[ 9142.460758] 		ref#0: tree block backref root 20062
[ 9142.460761] 		ref#1: tree block backref root 18983
[ 9142.460763] 		ref#2: tree block backref root 17198
[ 9142.460765] 		ref#3: tree block backref root 16157
[ 9142.460768] 		ref#4: shared block backref parent 3291604500480
[ 9142.460770] 		ref#5: shared block backref parent 1571036528640
[ 9142.460773] 		ref#6: shared block backref parent 1155614736384
[ 9142.460775] 		ref#7: shared block backref parent 479205081088
[ 9142.460777] 		ref#8: shared block backref parent 943112192
[ 9142.460782] 	item 19 key (3291230863360 169 0) itemoff 14687 itemsize 33
[ 9142.460784] 		extent refs 1 gen 95222 flags 2
[ 9142.460785] 		ref#0: tree block backref root 7
[ 9142.460789] 	item 20 key (3291230879744 169 0) itemoff 14582 itemsize 105
[ 9142.460791] 		extent refs 9 gen 53116 flags 2
[ 9142.460792] 		ref#0: tree block backref root 20062
[ 9142.460795] 		ref#1: tree block backref root 18983
[ 9142.460797] 		ref#2: tree block backref root 17198
[ 9142.460799] 		ref#3: shared block backref parent 3454507909120
[ 9142.460802] 		ref#4: shared block backref parent 696277385216
[ 9142.460804] 		ref#5: shared block backref parent 893468672
[ 9142.460806] 		ref#6: shared block backref parent 834338816
[ 9142.460809] 		ref#7: shared block backref parent 834191360
[ 9142.460811] 		ref#8: shared block backref parent 831242240
[ 9142.460815] 	item 21 key (3291230896128 169 0) itemoff 14477 itemsize 105
[ 9142.460818] 		extent refs 9 gen 53116 flags 2
[ 9142.460819] 		ref#0: tree block backref root 20062
[ 9142.460821] 		ref#1: tree block backref root 18983
[ 9142.460823] 		ref#2: shared block backref parent 479272075264
[ 9142.460826] 		ref#3: shared block backref parent 617398272
[ 9142.460828] 		ref#4: shared block backref parent 617332736
[ 9142.460830] 		ref#5: shared block backref parent 617005056
[ 9142.460833] 		ref#6: shared block backref parent 616775680
[ 9142.460835] 		ref#7: shared block backref parent 616529920
[ 9142.460837] 		ref#8: shared block backref parent 616497152
[ 9142.460842] 	item 22 key (3291230912512 169 0) itemoff 14444 itemsize 33
[ 9142.460844] 		extent refs 1 gen 95184 flags 2
[ 9142.460845] 		ref#0: tree block backref root 2
[ 9142.460849] 	item 23 key (3291230928896 169 0) itemoff 14411 itemsize 33
[ 9142.460851] 		extent refs 1 gen 95216 flags 2
[ 9142.460852] 		ref#0: tree block backref root 7
[ 9142.460856] 	item 24 key (3291230945280 169 0) itemoff 14306 itemsize 105
[ 9142.460858] 		extent refs 9 gen 53116 flags 2
[ 9142.460860] 		ref#0: tree block backref root 20062
[ 9142.460862] 		ref#1: tree block backref root 18983
[ 9142.460864] 		ref#2: tree block backref root 17198
[ 9142.460867] 		ref#3: tree block backref root 16157
[ 9142.460869] 		ref#4: shared block backref parent 3291604500480
[ 9142.460871] 		ref#5: shared block backref parent 1571036528640
[ 9142.460874] 		ref#6: shared block backref parent 1155614736384
[ 9142.460876] 		ref#7: shared block backref parent 479205081088
[ 9142.460878] 		ref#8: shared block backref parent 943112192
[ 9142.460883] 	item 25 key (3291230961664 169 0) itemoff 14201 itemsize 105
[ 9142.460885] 		extent refs 9 gen 53116 flags 2
[ 9142.460886] 		ref#0: tree block backref root 20062
[ 9142.460888] 		ref#1: tree block backref root 18983
[ 9142.460890] 		ref#2: tree block backref root 17198
[ 9142.460893] 		ref#3: tree block backref root 16157
[ 9142.460895] 		ref#4: shared block backref parent 3291604500480
[ 9142.460897] 		ref#5: shared block backref parent 1571036528640
[ 9142.460900] 		ref#6: shared block backref parent 1155614736384
[ 9142.460902] 		ref#7: shared block backref parent 479205081088
[ 9142.460904] 		ref#8: shared block backref parent 943112192
[ 9142.460909] 	item 26 key (3291230978048 169 0) itemoff 14168 itemsize 33
[ 9142.460911] 		extent refs 1 gen 95236 flags 2
[ 9142.460912] 		ref#0: tree block backref root 2
[ 9142.460916] 	item 27 key (3291231027200 169 0) itemoff 14063 itemsize 105
[ 9142.460918] 		extent refs 9 gen 53116 flags 2
[ 9142.460919] 		ref#0: tree block backref root 20062
[ 9142.460922] 		ref#1: tree block backref root 18983
[ 9142.460924] 		ref#2: tree block backref root 17198
[ 9142.460926] 		ref#3: tree block backref root 16157
[ 9142.460929] 		ref#4: shared block backref parent 3291604500480
[ 9142.460931] 		ref#5: shared block backref parent 1571036528640
[ 9142.460933] 		ref#6: shared block backref parent 1155614736384
[ 9142.460936] 		ref#7: shared block backref parent 479205081088
[ 9142.460938] 		ref#8: shared block backref parent 943112192
[ 9142.460942] 	item 28 key (3291231043584 169 0) itemoff 14021 itemsize 42
[ 9142.460944] 		extent refs 2 gen 53116 flags 2
[ 9142.460946] 		ref#0: shared block backref parent 2072475615232
[ 9142.460948] 		ref#1: shared block backref parent 2033551802368
[ 9142.460952] 	item 29 key (3291231076352 169 0) itemoff 13988 itemsize 33
[ 9142.460954] 		extent refs 1 gen 95218 flags 2
[ 9142.460955] 		ref#0: tree block backref root 7
[ 9142.460960] 	item 30 key (3291231125504 169 0) itemoff 13955 itemsize 33
[ 9142.460962] 		extent refs 1 gen 95182 flags 2
[ 9142.460963] 		ref#0: tree block backref root 2
[ 9142.460967] 	item 31 key (3291231141888 169 0) itemoff 13922 itemsize 33
[ 9142.460969] 		extent refs 1 gen 95214 flags 2
[ 9142.460970] 		ref#0: tree block backref root 2
[ 9142.460974] 	item 32 key (3291231174656 169 0) itemoff 13880 itemsize 42
[ 9142.460976] 		extent refs 2 gen 53116 flags 2
[ 9142.460977] 		ref#0: shared block backref parent 2072475615232
[ 9142.460980] 		ref#1: shared block backref parent 2033551802368
[ 9142.460984] 	item 33 key (3291231191040 169 0) itemoff 13847 itemsize 33
[ 9142.460986] 		extent refs 1 gen 95226 flags 2
[ 9142.460987] 		ref#0: tree block backref root 7
[ 9142.460992] 	item 34 key (3291231207424 169 0) itemoff 13805 itemsize 42
[ 9142.460994] 		extent refs 2 gen 53116 flags 2
[ 9142.460995] 		ref#0: shared block backref parent 2072475615232
[ 9142.460997] 		ref#1: shared block backref parent 2033551802368
[ 9142.461002] 	item 35 key (3291231223808 169 0) itemoff 13772 itemsize 33
[ 9142.461004] 		extent refs 1 gen 95228 flags 2
[ 9142.461005] 		ref#0: tree block backref root 7
[ 9142.461009] 	item 36 key (3291231240192 169 0) itemoff 13739 itemsize 33
[ 9142.461011] 		extent refs 1 gen 95184 flags 2
[ 9142.461012] 		ref#0: tree block backref root 2
[ 9142.461016] 	item 37 key (3291231256576 169 0) itemoff 13634 itemsize 105
[ 9142.461018] 		extent refs 9 gen 53116 flags 2
[ 9142.461019] 		ref#0: tree block backref root 20062
[ 9142.461022] 		ref#1: tree block backref root 18983
[ 9142.461024] 		ref#2: tree block backref root 17198
[ 9142.461026] 		ref#3: tree block backref root 16157
[ 9142.461029] 		ref#4: shared block backref parent 3291604500480
[ 9142.461031] 		ref#5: shared block backref parent 1571036528640
[ 9142.461033] 		ref#6: shared block backref parent 1155614736384
[ 9142.461036] 		ref#7: shared block backref parent 479205081088
[ 9142.461038] 		ref#8: shared block backref parent 943112192
[ 9142.461042] 	item 38 key (3291231272960 169 0) itemoff 13529 itemsize 105
[ 9142.461045] 		extent refs 9 gen 53116 flags 2
[ 9142.461046] 		ref#0: tree block backref root 20062
[ 9142.461048] 		ref#1: tree block backref root 18983
[ 9142.461050] 		ref#2: tree block backref root 17198
[ 9142.461052] 		ref#3: tree block backref root 16157
[ 9142.461055] 		ref#4: shared block backref parent 3291604500480
[ 9142.461057] 		ref#5: shared block backref parent 1571036528640
[ 9142.461059] 		ref#6: shared block backref parent 1155614736384
[ 9142.461062] 		ref#7: shared block backref parent 479205081088
[ 9142.461064] 		ref#8: shared block backref parent 943112192
[ 9142.461069] 	item 39 key (3291231289344 169 0) itemoff 13496 itemsize 33
[ 9142.461071] 		extent refs 1 gen 95184 flags 2
[ 9142.461072] 		ref#0: tree block backref root 2
[ 9142.461076] 	item 40 key (3291231305728 169 0) itemoff 13454 itemsize 42
[ 9142.461078] 		extent refs 2 gen 53116 flags 2
[ 9142.461079] 		ref#0: shared block backref parent 2072475615232
[ 9142.461082] 		ref#1: shared block backref parent 2033551802368
[ 9142.461086] 	item 41 key (3291231322112 169 0) itemoff 13421 itemsize 33
[ 9142.461088] 		extent refs 1 gen 95212 flags 2
[ 9142.461089] 		ref#0: tree block backref root 2
[ 9142.461093] 	item 42 key (3291231338496 169 1) itemoff 13388 itemsize 33
[ 9142.461095] 		extent refs 1 gen 95225 flags 2
[ 9142.461096] 		ref#0: tree block backref root 7
[ 9142.461101] 	item 43 key (3291231354880 169 0) itemoff 13355 itemsize 33
[ 9142.461103] 		extent refs 1 gen 95230 flags 2
[ 9142.461104] 		ref#0: tree block backref root 7
[ 9142.461108] 	item 44 key (3291231371264 169 0) itemoff 13322 itemsize 33
[ 9142.461110] 		extent refs 1 gen 95184 flags 2
[ 9142.461111] 		ref#0: tree block backref root 2
[ 9142.461115] 	item 45 key (3291231387648 169 0) itemoff 13217 itemsize 105
[ 9142.461117] 		extent refs 9 gen 53116 flags 2
[ 9142.461118] 		ref#0: tree block backref root 20062
[ 9142.461121] 		ref#1: tree block backref root 18983
[ 9142.461123] 		ref#2: shared block backref parent 479272075264
[ 9142.461125] 		ref#3: shared block backref parent 617398272
[ 9142.461128] 		ref#4: shared block backref parent 617332736
[ 9142.461130] 		ref#5: shared block backref parent 617005056
[ 9142.461132] 		ref#6: shared block backref parent 616775680
[ 9142.461135] 		ref#7: shared block backref parent 616529920
[ 9142.461137] 		ref#8: shared block backref parent 616497152
[ 9142.461141] 	item 46 key (3291231404032 169 0) itemoff 13112 itemsize 105
[ 9142.461143] 		extent refs 9 gen 53116 flags 2
[ 9142.461144] 		ref#0: tree block backref root 20062
[ 9142.461147] 		ref#1: tree block backref root 18983
[ 9142.461149] 		ref#2: tree block backref root 17198
[ 9142.461151] 		ref#3: shared block backref parent 3454507909120
[ 9142.461154] 		ref#4: shared block backref parent 696277385216
[ 9142.461156] 		ref#5: shared block backref parent 893468672
[ 9142.461158] 		ref#6: shared block backref parent 834338816
[ 9142.461161] 		ref#7: shared block backref parent 834191360
[ 9142.461163] 		ref#8: shared block backref parent 831242240
[ 9142.461168] 	item 47 key (3291231420416 169 0) itemoff 13079 itemsize 33
[ 9142.461170] 		extent refs 1 gen 53116 flags 2
[ 9142.461171] 		ref#0: shared block backref parent 831242240
[ 9142.461175] 	item 48 key (3291231436800 169 0) itemoff 12974 itemsize 105
[ 9142.461177] 		extent refs 9 gen 53116 flags 2
[ 9142.461178] 		ref#0: tree block backref root 20062
[ 9142.461181] 		ref#1: tree block backref root 18983
[ 9142.461183] 		ref#2: shared block backref parent 479272075264
[ 9142.461185] 		ref#3: shared block backref parent 617398272
[ 9142.461188] 		ref#4: shared block backref parent 617332736
[ 9142.461190] 		ref#5: shared block backref parent 617005056
[ 9142.461192] 		ref#6: shared block backref parent 616775680
[ 9142.461194] 		ref#7: shared block backref parent 616529920
[ 9142.461197] 		ref#8: shared block backref parent 616497152
[ 9142.461201] 	item 49 key (3291231453184 169 0) itemoff 12869 itemsize 105
[ 9142.461203] 		extent refs 9 gen 53116 flags 2
[ 9142.461204] 		ref#0: tree block backref root 20062
[ 9142.461207] 		ref#1: tree block backref root 18983
[ 9142.461209] 		ref#2: shared block backref parent 479272075264
[ 9142.461211] 		ref#3: shared block backref parent 617398272
[ 9142.461214] 		ref#4: shared block backref parent 617332736
[ 9142.461216] 		ref#5: shared block backref parent 617005056
[ 9142.461218] 		ref#6: shared block backref parent 616775680
[ 9142.461220] 		ref#7: shared block backref parent 616529920
[ 9142.461223] 		ref#8: shared block backref parent 616497152
[ 9142.461227] 	item 50 key (3291231469568 169 0) itemoff 12764 itemsize 105
[ 9142.461229] 		extent refs 9 gen 53116 flags 2
[ 9142.461230] 		ref#0: tree block backref root 20062
[ 9142.461233] 		ref#1: tree block backref root 18983
[ 9142.461235] 		ref#2: shared block backref parent 479272075264
[ 9142.461237] 		ref#3: shared block backref parent 617398272
[ 9142.461240] 		ref#4: shared block backref parent 617332736
[ 9142.461242] 		ref#5: shared block backref parent 617005056
[ 9142.461244] 		ref#6: shared block backref parent 616775680
[ 9142.461246] 		ref#7: shared block backref parent 616529920
[ 9142.461249] 		ref#8: shared block backref parent 616497152
[ 9142.461253] 	item 51 key (3291231485952 169 0) itemoff 12659 itemsize 105
[ 9142.461255] 		extent refs 9 gen 53116 flags 2
[ 9142.461256] 		ref#0: tree block backref root 20062
[ 9142.461259] 		ref#1: tree block backref root 18983
[ 9142.461261] 		ref#2: shared block backref parent 479272075264
[ 9142.461263] 		ref#3: shared block backref parent 617398272
[ 9142.461266] 		ref#4: shared block backref parent 617332736
[ 9142.461268] 		ref#5: shared block backref parent 617005056
[ 9142.461270] 		ref#6: shared block backref parent 616775680
[ 9142.461272] 		ref#7: shared block backref parent 616529920
[ 9142.461275] 		ref#8: shared block backref parent 616497152
[ 9142.461279] 	item 52 key (3291231502336 169 0) itemoff 12626 itemsize 33
[ 9142.461281] 		extent refs 1 gen 53116 flags 2
[ 9142.461282] 		ref#0: shared block backref parent 831242240
[ 9142.461287] 	item 53 key (3291231518720 169 0) itemoff 12521 itemsize 105
[ 9142.461289] 		extent refs 9 gen 53116 flags 2
[ 9142.461290] 		ref#0: tree block backref root 20062
[ 9142.461292] 		ref#1: tree block backref root 18983
[ 9142.461294] 		ref#2: tree block backref root 17198
[ 9142.461297] 		ref#3: shared block backref parent 3454507909120
[ 9142.461299] 		ref#4: shared block backref parent 696277385216
[ 9142.461301] 		ref#5: shared block backref parent 893468672
[ 9142.461304] 		ref#6: shared block backref parent 834338816
[ 9142.461306] 		ref#7: shared block backref parent 834191360
[ 9142.461308] 		ref#8: shared block backref parent 831242240
[ 9142.461313] 	item 54 key (3291231535104 169 0) itemoff 12488 itemsize 33
[ 9142.461315] 		extent refs 1 gen 95184 flags 2
[ 9142.461316] 		ref#0: tree block backref root 2
[ 9142.461320] 	item 55 key (3291231567872 169 0) itemoff 12455 itemsize 33
[ 9142.461322] 		extent refs 1 gen 53116 flags 2
[ 9142.461323] 		ref#0: shared block backref parent 2072475615232
[ 9142.461328] 	item 56 key (3291231584256 169 0) itemoff 12413 itemsize 42
[ 9142.461330] 		extent refs 2 gen 53116 flags 2
[ 9142.461331] 		ref#0: shared block backref parent 2072475615232
[ 9142.461333] 		ref#1: shared block backref parent 2033551802368
[ 9142.461338] 	item 57 key (3291231600640 169 0) itemoff 12371 itemsize 42
[ 9142.461340] 		extent refs 2 gen 53116 flags 2
[ 9142.461341] 		ref#0: shared block backref parent 2072475615232
[ 9142.461343] 		ref#1: shared block backref parent 2033551802368
[ 9142.461348] 	item 58 key (3291231617024 169 0) itemoff 12329 itemsize 42
[ 9142.461350] 		extent refs 2 gen 53116 flags 2
[ 9142.461351] 		ref#0: shared block backref parent 2072475615232
[ 9142.461353] 		ref#1: shared block backref parent 2033551802368
[ 9142.461358] 	item 59 key (3291231633408 169 0) itemoff 12287 itemsize 42
[ 9142.461360] 		extent refs 2 gen 53116 flags 2
[ 9142.461361] 		ref#0: shared block backref parent 2072475615232
[ 9142.461363] 		ref#1: shared block backref parent 2033551802368
[ 9142.461367] 	item 60 key (3291231649792 169 0) itemoff 12245 itemsize 42
[ 9142.461369] 		extent refs 2 gen 53116 flags 2
[ 9142.461371] 		ref#0: shared block backref parent 2072475615232
[ 9142.461373] 		ref#1: shared block backref parent 2033551802368
[ 9142.461377] 	item 61 key (3291231666176 169 0) itemoff 12212 itemsize 33
[ 9142.461379] 		extent refs 1 gen 53116 flags 2
[ 9142.461380] 		ref#0: shared block backref parent 2072475615232
[ 9142.461385] 	item 62 key (3291231682560 169 0) itemoff 12179 itemsize 33
[ 9142.461387] 		extent refs 1 gen 95223 flags 2
[ 9142.461388] 		ref#0: tree block backref root 7
[ 9142.461392] 	item 63 key (3291231698944 169 0) itemoff 12137 itemsize 42
[ 9142.461394] 		extent refs 2 gen 53116 flags 2
[ 9142.461395] 		ref#0: shared block backref parent 2072475615232
[ 9142.461398] 		ref#1: shared block backref parent 2033551802368
[ 9142.461402] 	item 64 key (3291231715328 169 0) itemoff 12095 itemsize 42
[ 9142.461404] 		extent refs 2 gen 53116 flags 2
[ 9142.461405] 		ref#0: shared block backref parent 2072475615232
[ 9142.461408] 		ref#1: shared block backref parent 2033551802368
[ 9142.461412] 	item 65 key (3291231731712 169 0) itemoff 12062 itemsize 33
[ 9142.461414] 		extent refs 1 gen 95233 flags 2
[ 9142.461415] 		ref#0: tree block backref root 7
[ 9142.461419] 	item 66 key (3291231764480 169 0) itemoff 12029 itemsize 33
[ 9142.461422] 		extent refs 1 gen 95225 flags 2
[ 9142.461423] 		ref#0: tree block backref root 7
[ 9142.461427] 	item 67 key (3291231780864 169 0) itemoff 11996 itemsize 33
[ 9142.461429] 		extent refs 1 gen 95209 flags 2
[ 9142.461430] 		ref#0: tree block backref root 2
[ 9142.461434] 	item 68 key (3291231797248 169 0) itemoff 11963 itemsize 33
[ 9142.461436] 		extent refs 1 gen 95215 flags 2
[ 9142.461437] 		ref#0: tree block backref root 2
[ 9142.461441] 	item 69 key (3291231813632 169 0) itemoff 11930 itemsize 33
[ 9142.461443] 		extent refs 1 gen 95237 flags 2
[ 9142.461444] 		ref#0: tree block backref root 2
[ 9142.461449] 	item 70 key (3291231862784 169 0) itemoff 11897 itemsize 33
[ 9142.461451] 		extent refs 1 gen 95234 flags 2
[ 9142.461452] 		ref#0: tree block backref root 7
[ 9142.461456] 	item 71 key (3291231879168 169 1) itemoff 11864 itemsize 33
[ 9142.461458] 		extent refs 1 gen 95207 flags 2
[ 9142.461459] 		ref#0: tree block backref root 2
[ 9142.461463] 	item 72 key (3291231895552 169 0) itemoff 11831 itemsize 33
[ 9142.461465] 		extent refs 1 gen 95207 flags 2
[ 9142.461466] 		ref#0: tree block backref root 2
[ 9142.461470] 	item 73 key (3291231911936 169 0) itemoff 11798 itemsize 33
[ 9142.461472] 		extent refs 1 gen 95237 flags 2
[ 9142.461473] 		ref#0: tree block backref root 2
[ 9142.461477] 	item 74 key (3291231928320 169 1) itemoff 11765 itemsize 33
[ 9142.461480] 		extent refs 1 gen 95213 flags 2
[ 9142.461481] 		ref#0: tree block backref root 2
[ 9142.461485] 	item 75 key (3291231944704 169 0) itemoff 11732 itemsize 33
[ 9142.461487] 		extent refs 1 gen 95213 flags 2
[ 9142.461488] 		ref#0: tree block backref root 2
[ 9142.461492] 	item 76 key (3291231961088 169 1) itemoff 11699 itemsize 33
[ 9142.461494] 		extent refs 1 gen 95239 flags 2
[ 9142.461495] 		ref#0: tree block backref root 2
[ 9142.461499] 	item 77 key (3291231977472 169 0) itemoff 11666 itemsize 33
[ 9142.461501] 		extent refs 1 gen 95209 flags 2
[ 9142.461502] 		ref#0: tree block backref root 2
[ 9142.461506] 	item 78 key (3291231993856 169 1) itemoff 11633 itemsize 33
[ 9142.461508] 		extent refs 1 gen 95236 flags 2
[ 9142.461509] 		ref#0: tree block backref root 7
[ 9142.461514] 	item 79 key (3291232010240 169 0) itemoff 11600 itemsize 33
[ 9142.461516] 		extent refs 1 gen 95236 flags 2
[ 9142.461517] 		ref#0: tree block backref root 7
[ 9142.461521] 	item 80 key (3291232026624 169 0) itemoff 11567 itemsize 33
[ 9142.461523] 		extent refs 1 gen 95239 flags 2
[ 9142.461524] 		ref#0: tree block backref root 2
[ 9142.461528] 	item 81 key (3291232043008 169 0) itemoff 11534 itemsize 33
[ 9142.461530] 		extent refs 1 gen 95212 flags 2
[ 9142.461531] 		ref#0: tree block backref root 2
[ 9142.461535] 	item 82 key (3291232174080 169 1) itemoff 11501 itemsize 33
[ 9142.461537] 		extent refs 1 gen 95238 flags 2
[ 9142.461538] 		ref#0: tree block backref root 2
[ 9142.461542] 	item 83 key (3291232206848 169 0) itemoff 11468 itemsize 33
[ 9142.461544] 		extent refs 1 gen 95215 flags 2
[ 9142.461546] 		ref#0: tree block backref root 2
[ 9142.461550] 	item 84 key (3291232239616 169 0) itemoff 11435 itemsize 33
[ 9142.461552] 		extent refs 1 gen 95238 flags 2
[ 9142.461553] 		ref#0: tree block backref root 2
[ 9142.461557] 	item 85 key (3291232256000 169 0) itemoff 11402 itemsize 33
[ 9142.461559] 		extent refs 1 gen 95227 flags 2
[ 9142.461560] 		ref#0: tree block backref root 2
[ 9142.461564] 	item 86 key (3291232288768 169 0) itemoff 11369 itemsize 33
[ 9142.461566] 		extent refs 1 gen 95220 flags 2
[ 9142.461567] 		ref#0: tree block backref root 2
[ 9142.461571] 	item 87 key (3291232321536 169 0) itemoff 11336 itemsize 33
[ 9142.461573] 		extent refs 1 gen 95238 flags 2
[ 9142.461574] 		ref#0: tree block backref root 2
[ 9142.461579] 	item 88 key (3291232370688 169 0) itemoff 11303 itemsize 33
[ 9142.461581] 		extent refs 1 gen 95225 flags 2
[ 9142.461582] 		ref#0: tree block backref root 2
[ 9142.461586] 	item 89 key (3291232518144 169 0) itemoff 11270 itemsize 33
[ 9142.461588] 		extent refs 1 gen 95236 flags 2
[ 9142.461589] 		ref#0: tree block backref root 2
[ 9142.461593] 	item 90 key (3291232583680 169 0) itemoff 11237 itemsize 33
[ 9142.461595] 		extent refs 1 gen 95231 flags 2
[ 9142.461596] 		ref#0: tree block backref root 2
[ 9142.461600] 	item 91 key (3291232649216 169 0) itemoff 11204 itemsize 33
[ 9142.461602] 		extent refs 1 gen 95237 flags 2
[ 9142.461603] 		ref#0: tree block backref root 2
[ 9142.461607] 	item 92 key (3291232681984 169 0) itemoff 11171 itemsize 33
[ 9142.461609] 		extent refs 1 gen 95239 flags 2
[ 9142.461611] 		ref#0: tree block backref root 2
[ 9142.461615] 	item 93 key (3291232829440 169 0) itemoff 11138 itemsize 33
[ 9142.461617] 		extent refs 1 gen 95238 flags 2
[ 9142.461618] 		ref#0: tree block backref root 2
[ 9142.461622] 	item 94 key (3291232878592 169 0) itemoff 11105 itemsize 33
[ 9142.461624] 		extent refs 1 gen 95238 flags 2
[ 9142.461625] 		ref#0: tree block backref root 2
[ 9142.461629] 	item 95 key (3291234009088 169 0) itemoff 11072 itemsize 33
[ 9142.461631] 		extent refs 1 gen 54354 flags 258
[ 9142.461632] 		ref#0: tree block backref root 14300
[ 9142.461637] 	item 96 key (3291234025472 169 0) itemoff 11039 itemsize 33
[ 9142.461639] 		extent refs 1 gen 54354 flags 258
[ 9142.461640] 		ref#0: tree block backref root 14300
[ 9142.461644] 	item 97 key (3291234058240 169 0) itemoff 11006 itemsize 33
[ 9142.461646] 		extent refs 1 gen 54354 flags 258
[ 9142.461647] 		ref#0: tree block backref root 14300
[ 9142.461651] 	item 98 key (3291234074624 169 0) itemoff 10973 itemsize 33
[ 9142.461654] 		extent refs 1 gen 54354 flags 258
[ 9142.461655] 		ref#0: tree block backref root 14300
[ 9142.461659] 	item 99 key (3291234205696 169 0) itemoff 10940 itemsize 33
[ 9142.461661] 		extent refs 1 gen 54352 flags 258
[ 9142.461662] 		ref#0: tree block backref root 14300
[ 9142.461666] 	item 100 key (3291234385920 169 0) itemoff 10907 itemsize 33
[ 9142.461668] 		extent refs 1 gen 54353 flags 258
[ 9142.461669] 		ref#0: tree block backref root 14300
[ 9142.461674] 	item 101 key (3291234516992 169 0) itemoff 10874 itemsize 33
[ 9142.461676] 		extent refs 1 gen 54354 flags 258
[ 9142.461677] 		ref#0: tree block backref root 14300
[ 9142.461681] 	item 102 key (3291235074048 169 0) itemoff 10841 itemsize 33
[ 9142.461683] 		extent refs 1 gen 52945 flags 258
[ 9142.461684] 		ref#0: shared block backref parent 533258141696
[ 9142.461689] 	item 103 key (3291235106816 169 0) itemoff 10808 itemsize 33
[ 9142.461691] 		extent refs 1 gen 52945 flags 258
[ 9142.461692] 		ref#0: shared block backref parent 533258141696
[ 9142.461696] 	item 104 key (3291235188736 169 0) itemoff 10775 itemsize 33
[ 9142.461698] 		extent refs 1 gen 52945 flags 258
[ 9142.461699] 		ref#0: shared block backref parent 533258141696
[ 9142.461704] 	item 105 key (3291235303424 169 0) itemoff 10742 itemsize 33
[ 9142.461706] 		extent refs 1 gen 52945 flags 258
[ 9142.461707] 		ref#0: shared block backref parent 533258141696
[ 9142.461711] 	item 106 key (3291235352576 169 0) itemoff 10682 itemsize 60
[ 9142.461713] 		extent refs 4 gen 55544 flags 258
[ 9142.461714] 		ref#0: tree block backref root 18514
[ 9142.461717] 		ref#1: tree block backref root 17216
[ 9142.461719] 		ref#2: tree block backref root 16552
[ 9142.461721] 		ref#3: shared block backref parent 1684697202688
[ 9142.461726] 	item 107 key (3291236155392 169 0) itemoff 10649 itemsize 33
[ 9142.461728] 		extent refs 1 gen 54354 flags 258
[ 9142.461729] 		ref#0: tree block backref root 14300
[ 9142.461733] 	item 108 key (3291236171776 169 0) itemoff 10616 itemsize 33
[ 9142.461735] 		extent refs 1 gen 54354 flags 258
[ 9142.461736] 		ref#0: tree block backref root 14300
[ 9142.461741] 	item 109 key (3291236220928 169 0) itemoff 10583 itemsize 33
[ 9142.461743] 		extent refs 1 gen 54354 flags 258
[ 9142.461744] 		ref#0: shared block backref parent 1684556005376
[ 9142.461748] 	item 110 key (3291236352000 169 0) itemoff 10550 itemsize 33
[ 9142.461750] 		extent refs 1 gen 54353 flags 258
[ 9142.461751] 		ref#0: tree block backref root 14300
[ 9142.461756] 	item 111 key (3291236384768 169 0) itemoff 10517 itemsize 33
[ 9142.461758] 		extent refs 1 gen 54353 flags 258
[ 9142.461759] 		ref#0: tree block backref root 14300
[ 9142.461763] 	item 112 key (3291236483072 169 0) itemoff 10484 itemsize 33
[ 9142.461765] 		extent refs 1 gen 54354 flags 258
[ 9142.461766] 		ref#0: shared block backref parent 646733774848
[ 9142.461770] 	item 113 key (3291236859904 169 0) itemoff 10451 itemsize 33
[ 9142.461772] 		extent refs 1 gen 54353 flags 258
[ 9142.461774] 		ref#0: tree block backref root 14300
[ 9142.461778] 	item 114 key (3291236909056 169 0) itemoff 10418 itemsize 33
[ 9142.461780] 		extent refs 1 gen 54353 flags 258
[ 9142.461781] 		ref#0: shared block backref parent 646733774848
[ 9142.461785] 	item 115 key (3291237007360 169 0) itemoff 10385 itemsize 33
[ 9142.461787] 		extent refs 1 gen 69081 flags 258
[ 9142.461788] 		ref#0: shared block backref parent 3454658232320
[ 9142.461793] 	item 116 key (3291237023744 169 0) itemoff 10352 itemsize 33
[ 9142.461795] 		extent refs 1 gen 54353 flags 258
[ 9142.461796] 		ref#0: shared block backref parent 646763347968
[ 9142.461800] 	item 117 key (3291237089280 169 0) itemoff 10319 itemsize 33
[ 9142.461803] 		extent refs 1 gen 69081 flags 258
[ 9142.461804] 		ref#0: shared block backref parent 3454658232320
[ 9142.461808] 	item 118 key (3291237105664 169 0) itemoff 10286 itemsize 33
[ 9142.461810] 		extent refs 1 gen 54354 flags 258
[ 9142.461811] 		ref#0: tree block backref root 14300
[ 9142.461815] 	item 119 key (3291237154816 169 0) itemoff 10253 itemsize 33
[ 9142.461817] 		extent refs 1 gen 69081 flags 258
[ 9142.461818] 		ref#0: shared block backref parent 3454658232320
[ 9142.461823] 	item 120 key (3291237236736 169 0) itemoff 10220 itemsize 33
[ 9142.461825] 		extent refs 1 gen 54354 flags 258
[ 9142.461826] 		ref#0: tree block backref root 14300
[ 9142.461830] 	item 121 key (3291237285888 169 0) itemoff 10187 itemsize 33
[ 9142.461832] 		extent refs 1 gen 54353 flags 258
[ 9142.461833] 		ref#0: shared block backref parent 646733774848
[ 9142.461838] 	item 122 key (3291237384192 169 0) itemoff 10154 itemsize 33
[ 9142.461840] 		extent refs 1 gen 52863 flags 2
[ 9142.461841] 		ref#0: tree block backref root 7
[ 9142.461967] 	item 123 key (3291237466112 169 0) itemoff 10049 itemsize 105
[ 9142.461983] 		extent refs 9 gen 53116 flags 2
[ 9142.461989] 		ref#0: tree block backref root 20062
[ 9142.462002] 		ref#1: tree block backref root 18983
[ 9142.462018] 		ref#2: tree block backref root 17198
[ 9142.462029] 		ref#3: tree block backref root 16157
[ 9142.462041] 		ref#4: shared block backref parent 3291604500480
[ 9142.462053] 		ref#5: shared block backref parent 1571036528640
[ 9142.462067] 		ref#6: shared block backref parent 1155614736384
[ 9142.462080] 		ref#7: shared block backref parent 479205081088
[ 9142.462093] 		ref#8: shared block backref parent 943112192
[ 9142.462117] 	item 124 key (3291237695488 169 0) itemoff 10016 itemsize 33
[ 9142.462127] 		extent refs 1 gen 54964 flags 258
[ 9142.462135] 		ref#0: shared block backref parent 3454403067904
[ 9142.462154] 	item 125 key (3291237711872 169 0) itemoff 9965 itemsize 51
[ 9142.462161] 		extent refs 3 gen 74030 flags 258
[ 9142.462167] 		ref#0: shared block backref parent 479443681280
[ 9142.462177] 		ref#1: shared block backref parent 479443337216
[ 9142.462190] 		ref#2: shared block backref parent 479443189760
[ 9142.462208] 	item 126 key (3291237728256 169 0) itemoff 9914 itemsize 51
[ 9142.462217] 		extent refs 3 gen 74030 flags 258
[ 9142.462223] 		ref#0: shared block backref parent 479443681280
[ 9142.462239] 		ref#1: shared block backref parent 479443337216
[ 9142.462255] 		ref#2: shared block backref parent 479443189760
[ 9142.462264] 	item 127 key (3291237810176 169 0) itemoff 9863 itemsize 51
[ 9142.462267] 		extent refs 3 gen 74030 flags 258
[ 9142.462268] 		ref#0: shared block backref parent 479443681280
[ 9142.462271] 		ref#1: shared block backref parent 479443337216
[ 9142.462274] 		ref#2: shared block backref parent 479443189760
[ 9142.462278] 	item 128 key (3291238105088 169 0) itemoff 9839 itemsize 24
[ 9142.462281] 		extent refs 67 gen 54964 flags 258
[ 9142.462284] 	item 129 key (3291238105088 176 18915) itemoff 9839 itemsize 0
[ 9142.462285] 		tree block backref
[ 9142.462288] 	item 130 key (3291238105088 176 19262) itemoff 9839 itemsize 0
[ 9142.462289] 		tree block backref
[ 9142.462293] 	item 131 key (3291238105088 176 21356) itemoff 9839 itemsize 0
[ 9142.462294] 		tree block backref
[ 9142.462297] 	item 132 key (3291238105088 176 21366) itemoff 9839 itemsize 0
[ 9142.462297] 		tree block backref
[ 9142.462300] 	item 133 key (3291238105088 176 22034) itemoff 9839 itemsize 0
[ 9142.462301] 		tree block backref
[ 9142.462304] 	item 134 key (3291238105088 176 22038) itemoff 9839 itemsize 0
[ 9142.462305] 		tree block backref
[ 9142.462308] 	item 135 key (3291238105088 176 22042) itemoff 9839 itemsize 0
[ 9142.462309] 		tree block backref
[ 9142.462312] 	item 136 key (3291238105088 176 22046) itemoff 9839 itemsize 0
[ 9142.462313] 		tree block backref
[ 9142.462316] 	item 137 key (3291238105088 176 22050) itemoff 9839 itemsize 0
[ 9142.462317] 		tree block backref
[ 9142.462320] 	item 138 key (3291238105088 176 22054) itemoff 9839 itemsize 0
[ 9142.462321] 		tree block backref
[ 9142.462324] 	item 139 key (3291238105088 176 22057) itemoff 9839 itemsize 0
[ 9142.462325] 		tree block backref
[ 9142.462328] 	item 140 key (3291238105088 176 22061) itemoff 9839 itemsize 0
[ 9142.462329] 		tree block backref
[ 9142.462332] 	item 141 key (3291238105088 176 22065) itemoff 9839 itemsize 0
[ 9142.462333] 		tree block backref
[ 9142.462336] 	item 142 key (3291238105088 176 22067) itemoff 9839 itemsize 0
[ 9142.462337] 		tree block backref
[ 9142.462340] 	item 143 key (3291238105088 176 22071) itemoff 9839 itemsize 0
[ 9142.462341] 		tree block backref
[ 9142.462344] 	item 144 key (3291238105088 176 22074) itemoff 9839 itemsize 0
[ 9142.462345] 		tree block backref
[ 9142.462348] 	item 145 key (3291238105088 176 22077) itemoff 9839 itemsize 0
[ 9142.462349] 		tree block backref
[ 9142.462352] 	item 146 key (3291238105088 176 22108) itemoff 9839 itemsize 0
[ 9142.462353] 		tree block backref
[ 9142.462356] 	item 147 key (3291238105088 176 22154) itemoff 9839 itemsize 0
[ 9142.462357] 		tree block backref
[ 9142.462360] 	item 148 key (3291238105088 176 22162) itemoff 9839 itemsize 0
[ 9142.462361] 		tree block backref
[ 9142.462364] 	item 149 key (3291238105088 176 22166) itemoff 9839 itemsize 0
[ 9142.462365] 		tree block backref
[ 9142.462368] 	item 150 key (3291238105088 176 22169) itemoff 9839 itemsize 0
[ 9142.462370] 		tree block backref
[ 9142.462373] 	item 151 key (3291238105088 176 22172) itemoff 9839 itemsize 0
[ 9142.462374] 		tree block backref
[ 9142.462377] 	item 152 key (3291238105088 176 22174) itemoff 9839 itemsize 0
[ 9142.462386] 		tree block backref
[ 9142.462389] 	item 153 key (3291238105088 176 22176) itemoff 9839 itemsize 0
[ 9142.462390] 		tree block backref
[ 9142.462394] 	item 154 key (3291238105088 176 22178) itemoff 9839 itemsize 0
[ 9142.462394] 		tree block backref
[ 9142.462398] 	item 155 key (3291238105088 176 22181) itemoff 9839 itemsize 0
[ 9142.462398] 		tree block backref
[ 9142.462401] 	item 156 key (3291238105088 176 22183) itemoff 9839 itemsize 0
[ 9142.462402] 		tree block backref
[ 9142.462406] 	item 157 key (3291238105088 176 22185) itemoff 9839 itemsize 0
[ 9142.462406] 		tree block backref
[ 9142.462410] 	item 158 key (3291238105088 176 22188) itemoff 9839 itemsize 0
[ 9142.462410] 		tree block backref
[ 9142.462414] 	item 159 key (3291238105088 176 22190) itemoff 9839 itemsize 0
[ 9142.462415] 		tree block backref
[ 9142.462418] 	item 160 key (3291238105088 176 22195) itemoff 9839 itemsize 0
[ 9142.462419] 		tree block backref
[ 9142.462423] 	item 161 key (3291238105088 176 22200) itemoff 9839 itemsize 0
[ 9142.462423] 		tree block backref
[ 9142.462427] 	item 162 key (3291238105088 176 22203) itemoff 9839 itemsize 0
[ 9142.462428] 		tree block backref
[ 9142.462431] 	item 163 key (3291238105088 176 22207) itemoff 9839 itemsize 0
[ 9142.462433] 		tree block backref
[ 9142.462437] 	item 164 key (3291238105088 176 22209) itemoff 9839 itemsize 0
[ 9142.462438] 		tree block backref
[ 9142.462441] 	item 165 key (3291238105088 176 22213) itemoff 9839 itemsize 0
[ 9142.462442] 		tree block backref
[ 9142.462445] 	item 166 key (3291238105088 176 22216) itemoff 9839 itemsize 0
[ 9142.462474] 		tree block backref
[ 9142.462477] 	item 167 key (3291238105088 176 22218) itemoff 9839 itemsize 0
[ 9142.462478] 		tree block backref
[ 9142.462482] 	item 168 key (3291238105088 176 22221) itemoff 9839 itemsize 0
[ 9142.462483] 		tree block backref
[ 9142.462486] 	item 169 key (3291238105088 176 22224) itemoff 9839 itemsize 0
[ 9142.462488] 		tree block backref
[ 9142.462491] 	item 170 key (3291238105088 176 22227) itemoff 9839 itemsize 0
[ 9142.462492] 		tree block backref
[ 9142.462495] 	item 171 key (3291238105088 176 22231) itemoff 9839 itemsize 0
[ 9142.462495] 		tree block backref
[ 9142.462498] 	item 172 key (3291238105088 176 22233) itemoff 9839 itemsize 0
[ 9142.462499] 		tree block backref
[ 9142.462502] 	item 173 key (3291238105088 176 22235) itemoff 9839 itemsize 0
[ 9142.462504] 		tree block backref
[ 9142.462518] 	item 174 key (3291238105088 176 22238) itemoff 9839 itemsize 0
[ 9142.462520] 		tree block backref
[ 9142.462523] 	item 175 key (3291238105088 176 22240) itemoff 9839 itemsize 0
[ 9142.462524] 		tree block backref
[ 9142.462526] 	item 176 key (3291238105088 176 22243) itemoff 9839 itemsize 0
[ 9142.462528] 		tree block backref
[ 9142.462532] 	item 177 key (3291238105088 176 22247) itemoff 9839 itemsize 0
[ 9142.462544] 		tree block backref
[ 9142.462547] 	item 178 key (3291238105088 176 22250) itemoff 9839 itemsize 0
[ 9142.462555] 		tree block backref
[ 9142.462558] 	item 179 key (3291238105088 176 22254) itemoff 9839 itemsize 0
[ 9142.462559] 		tree block backref
[ 9142.462562] 	item 180 key (3291238105088 176 22257) itemoff 9839 itemsize 0
[ 9142.462563] 		tree block backref
[ 9142.462566] 	item 181 key (3291238105088 176 22259) itemoff 9839 itemsize 0
[ 9142.462566] 		tree block backref
[ 9142.462569] 	item 182 key (3291238105088 182 698302464) itemoff 9839 itemsize 0
[ 9142.462570] 		shared block backref
[ 9142.462575] BTRFS error (device sdc2): unable to find ref byte nr 3291231551488 parent 0 root 2  owner 0 offset 0
[ 9142.462577] BTRFS: Transaction aborted (error -2)
[ 9142.462626] ------------[ cut here ]------------
[ 9142.462684] WARNING: CPU: 1 PID: 14035 at ../fs/btrfs/extent-tree.c:7000 __btrfs_free_extent.isra.63+0x23a/0xd40 [btrfs]
[ 9142.462689] Modules linked in: xt_nat veth ip6t_REJECT ip6table_mangle ip6table_nat nf_nat_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_raw nf_log_ipv6 ip6table_filter ip6_tables xt_recent ipt_REJECT xt_comment xt_multiport ipt_rpfilter xt_hashlimit xt_mark iptable_mangle xt_REDIRECT nf_nat_redirect xt_tcpudp xt_CT iptable_raw xt_NFLOG nfnetlink_log nf_log_ipv4 nf_log_common xt_LOG nf_conntrack_sane nf_nat_tftp nf_nat_snmp_basic nf_conntrack_snmp nf_nat_sip nf_nat_pptp nf_nat_proto_gre nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat_amanda nf_conntrack_tftp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_proto_gre nf_conntrack_netbios_ns nf_conntrack_broadcast nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp ts_kmp nf_conntrack_amanda sctp ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink
[ 9142.462982]  nfnetlink xfrm_user xfrm_algo iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter ip_tables xt_conntrack x_tables nf_nat nf_conntrack libcrc32c br_netfilter bridge af_packet 8021q garp mrp stp llc tun msr nls_utf8 sch_fq_codel isofs loop radeon ttm drm_kms_helper edac_mce_amd kvm_amd drm drm_panel_orientation_quirks fb_sys_fops syscopyarea ccp sysfillrect kvm wmi_bmof sysimgblt acpi_cpufreq button i2c_algo_bit r8169 irqbypass mii pcspkr sp5100_tco wmi k10temp i2c_piix4 hid_generic btrfs usbhid xor zstd_decompress zstd_compress xxhash raid1 md_mod raid6_pq ata_generic ohci_pci pata_atiixp serio_raw ohci_hcd ehci_pci ehci_hcd ahci usbcore libahci sg nbd dm_multipath dm_mod scsi_dh_rdac scsi_dh_emc scsi_dh_alua
[ 9142.463108] CPU: 1 PID: 14035 Comm: btrfs Tainted: G        W        4.12.14-lp151.28.32-default #1 openSUSE Leap 15.1
[ 9142.463110] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./HZ03-GT-V2, BIOS 080015  12/24/2010
[ 9142.463120] task: ffff8800b7bae000 task.stack: ffffc90003414000
[ 9142.463171] RIP: 0010:__btrfs_free_extent.isra.63+0x23a/0xd40 [btrfs]
[ 9142.463177] RSP: 0018:ffffc900034179d8 EFLAGS: 00010296
[ 9142.463188] RAX: 0000000000000025 RBX: 0000000000000000 RCX: 0000000000000002
[ 9142.463192] RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000000202
[ 9142.463194] RBP: 000002fe4cb00000 R08: 0000000000000004 R09: 0000000000023d40
[ 9142.463196] R10: 0000000000000000 R11: 0000000000000000 R12: ffff880100490000
[ 9142.463199] R13: 00000000fffffffe R14: ffff88006017dd98 R15: ffff880034285620
[ 9142.463210] FS:  00007fddf09bd8c0(0000) GS:ffff88011fc40000(0000) knlGS:0000000000000000
[ 9142.463214] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 9142.463216] CR2: 00007fe78f30e000 CR3: 000000001ac2c000 CR4: 00000000000006e0
[ 9142.463218] Call Trace:
[ 9142.463282]  ? btrfs_merge_delayed_refs+0x323/0x380 [btrfs]
[ 9142.463334]  __btrfs_run_delayed_refs+0x2fe/0x1050 [btrfs]
[ 9142.463353]  ? __set_page_dirty_nobuffers+0xc5/0x140
[ 9142.463405]  btrfs_run_delayed_refs.part.69+0xd0/0x180 [btrfs]
[ 9142.463460]  btrfs_start_dirty_block_groups+0x3c8/0x4a0 [btrfs]
[ 9142.463518]  btrfs_commit_transaction+0xf6/0x960 [btrfs]
[ 9142.463578]  ? btrfs_record_root_in_trans+0x56/0x60 [btrfs]
[ 9142.463634]  ? start_transaction+0xb8/0x430 [btrfs]
[ 9142.463695]  btrfs_mksubvol+0x596/0x5b0 [btrfs]
[ 9142.463703]  ? wait_woken+0x80/0x80
[ 9142.463764]  btrfs_ioctl_snap_create_transid+0x189/0x190 [btrfs]
[ 9142.463825]  btrfs_ioctl_snap_create_v2+0x102/0x150 [btrfs]
[ 9142.463887]  btrfs_ioctl+0x5c9/0x1e70 [btrfs]
[ 9142.463896]  ? __handle_mm_fault+0x9c6/0x1210
[ 9142.463903]  ? do_vfs_ioctl+0x90/0x5f0
[ 9142.463907]  do_vfs_ioctl+0x90/0x5f0
[ 9142.463913]  SyS_ioctl+0x74/0x80
[ 9142.463919]  do_syscall_64+0x7b/0x160
[ 9142.463924]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[ 9142.463944] RIP: 0033:0x7fddefa39587
[ 9142.463946] RSP: 002b:00007ffd58f3b5b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 9142.463951] RAX: ffffffffffffffda RBX: 00007ffd58f4e8b0 RCX: 00007fddefa39587
[ 9142.463953] RDX: 00007ffd58f3b5d0 RSI: 0000000050009417 RDI: 0000000000000003
[ 9142.463955] RBP: 000055f5153558f0 R08: 000000000000ffff R09: feff2e333034362e
[ 9142.463958] R10: 0000000000000000 R11: 0000000000000246 R12: 000055f5153569f0
[ 9142.463961] R13: 00000000002c3f75 R14: 000055f515356920 R15: 00007ffd58f519a0
[ 9142.463965] Code: e7 e8 0b c6 fe ff 49 8b 46 60 f0 0f ba a8 40 17 00 00 02 0f 92 c0 84 c0 41 59 75 11 44 89 ee 48 c7 c7 90 9f 36 a0 e8 76 7d f0 e0 <0f> 0b b9 fe ff ff ff ba 58 1b 00 00 48 c7 c6 a0 09 36 a0 4c 89 
[ 9142.464047] ---[ end trace 5a3a4511e923e403 ]---
[ 9142.464070] BTRFS: error (device sdc2) in __btrfs_free_extent:7000: errno=-2 No such entry
[ 9142.464072] BTRFS info (device sdc2): forced readonly
[ 9142.464079] BTRFS: error (device sdc2) in btrfs_run_delayed_refs:3088: errno=-2 No such entry
[ 9142.464375] BTRFS warning (device sdc2): Skipping commit of aborted transaction.
[ 9142.464377] BTRFS: error (device sdc2) in cleanup_transaction:1881: errno=-2 No such entry
[ 9152.169974] BTRFS error (device sdc2): cleaner transaction attach returned -30
Comment 7 Wenruo Qu 2019-11-20 00:27:41 UTC
> turnip:~/btrfs-stuff # btrfs check --clear-space-cache v1 --progress /dev/sdd                                                                       
> Opening filesystem to check...
> Checking filesystem on /dev/sdd
> UUID: ee122800-2365-435f-98b6-43d87220eed3
> Failed to find [458534305792, 168, 16384]
> btrfs unable to find ref byte nr 458534322176 parent 0 root 2  owner 0 offset 0
> transaction.c:195: btrfs_commit_transaction: BUG_ON `ret` triggered, value -5

At this point, it shows the fs is already corrupted before "btrfs check" doing anything to it.

I'm afraid that why the space cache is corrupted, because the metadata of the fs is already corrupted. And All later output also proves that.
Feel sorry for it.

I'm afraid you'd better try to salvage your data, as the chance of fully recovery is pretty low. (You can try btrfs check --repair, but that's not ensured to completely fix it, especially when there are transid mismatch)
Comment 8 Wenruo Qu 2019-12-23 02:18:48 UTC
Close due to no response from the reporter.