Error while writing data to zpool

[mag-]

Zpool with enabled deduplication and compression, stack trace below:

[ 8690.148764] BUG: unable to handle kernel paging request at ffff8821a7674960
[ 8690.154843] IP: [] down_read+0x19/0x30
[ 8690.154843] PGD 1a04063 PUD 0
[ 8690.154843] Oops: 0002 [#1] SMP
[ 8690.154843] last sysfs file: /sys/devices/pci0000:00/0000:00:1f.2/host9/target9:0:0/9:0:0:0/block/sdf/sdf1/alignment_offset
[ 8690.154843] CPU 2
[ 8690.154843] Modules linked in: zfs(P) zcommon(P) znvpair(P) zavl(P) zunicode(P) spl xfs binfmt_misc nfsd lockd nfs_acl auth_rpcgss sunrpc exportfs ip6table_filter ip6_tables ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp iptable_filter ip_tables x_tables bridge stp vmnet vmblock vmci vmmon kvm_intel kvm sha256_generic cryptd aes_x86_64 aes_generic parport_pc ppdev dm_crypt vesafb arc4 zd1211rw mac80211 cfg80211 snd_hda_codec_realtek uvcvideo snd_usb_audio videodev v4l2_compat_ioctl32 snd_usbmidi_lib nvidia(P) snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_timer snd_seq_device snd psmouse serio_raw soundcore snd_page_alloc asus_atk0110 lp parport raid456 async_pq async_xor xor async_memcpy async_raid6_recov raid6_pq async_tx raid1 raid0 multipath linear btrfs zlib_deflate libcrc32c raid10 usbhid hid firewire_ohci r8169 firewire_core ahci libahci crc_itu_t pata_jmicron e1000e
[ 8690.191311]
[ 8690.191311] Pid: 8349, comm: z_wr_iss/2 Tainted: P 2.6.38-8-generic #42-Ubuntu System manufacturer P5E-VM DO/P5E-VM DO
[ 8690.191311] RIP: 0010:[] [] down_read+0x19/0x30
[ 8690.191311] RSP: 0018:ffff8802176db8f0 EFLAGS: 00010246
[ 8690.191311] RAX: ffff8821a7674960 RBX: ffff8821a7674960 RCX: 0000000000000000
[ 8690.191311] RDX: ffff8802176dbfd8 RSI: ffffffffa1277ced RDI: ffff8821a7674960
[ 8690.191311] RBP: ffff8802176db900 R08: 1c0ed5dc81643628 R09: ffff880213577800
[ 8690.191311] R10: dead000000100100 R11: dead000000200200 R12: 000000000001524e
[ 8690.191311] R13: 0000000000000002 R14: ffff8821a7674960 R15: ffff8802176db9f8
[ 8690.191311] FS: 0000000000000000(0000) GS:ffff8800cfb00000(0000) knlGS:0000000000000000
[ 8690.191311] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 8690.191311] CR2: ffff8821a7674960 CR3: 000000019f0b7000 CR4: 00000000000006e0
[ 8690.191311] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 8690.191311] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 8690.191311] Process z_wr_iss/2 (pid: 8349, threadinfo ffff8802176da000, task ffff880216a3c4a0)
[ 8690.191311] Stack:
[ 8690.191311] ffff8802176db9f8 0000000000000000 ffff8802176db970 ffffffffa123c980
[ 8690.191311] ffff8802176db970 ffffffffa123c4e1 ffff880200000000 0000000000000000
[ 8690.191311] ffff8802176db990 ffff88009c510040 0000000000000000 ffff880216f2b0c0
[ 8690.191311] Call Trace:
[ 8690.191311] [] zap_get_leaf_byblk+0xd0/0x290 [zfs]
[ 8690.191311] [] ? zap_idx_to_blk+0xe1/0x140 [zfs]
[ 8690.191311] [] ? ddt_zap_lookup+0x0/0xe0 [zfs]
[ 8690.191311] [] zap_deref_leaf+0x6d/0x80 [zfs]
[ 8690.191311] [] fzap_length+0x39/0xa0 [zfs]
[ 8690.191311] [] ? zap_name_alloc_uint64+0x76/0xa0 [zfs]
[ 8690.191311] [] zap_length_uint64+0x84/0xb0 [zfs]
[ 8690.191311] [] ? ddt_zap_lookup+0x0/0xe0 [zfs]
[ 8690.191311] [] ? kmem_alloc_debug+0xeb/0x130 [spl]
[ 8690.191311] [] ddt_zap_lookup+0x69/0xe0 [zfs]
[ 8690.191311] [] ? __cv_init+0xb2/0xd0 [spl]
[ 8690.191311] [] ? ddt_zap_lookup+0x0/0xe0 [zfs]
[ 8690.191311] [] ddt_lookup+0xec/0x1b0 [zfs]
[ 8690.191311] [] ? __switch_to+0xc0/0x2f0
[ 8690.191311] [] ? finish_task_switch+0x41/0xe0
[ 8690.191311] [] ? schedule+0x3ec/0x760
[ 8690.191311] [] ? __cond_resched+0x2a/0x40
[ 8690.191311] [] zio_ddt_write+0x67/0x470 [zfs]
[ 8690.191311] [] zio_execute+0xb0/0x150 [zfs]
[ 8690.191311] [] ? default_spin_lock_flags+0x9/0x10
[ 8690.191311] [] taskq_thread+0x1c0/0x390 [spl]
[ 8690.191311] [] ? default_wake_function+0x0/0x20
[ 8690.191311] [] ? taskq_thread+0x0/0x390 [spl]
[ 8690.191311] [] kthread+0x96/0xa0
[ 8690.191311] [] kernel_thread_helper+0x4/0x10
[ 8690.191311] [] ? kthread+0x0/0xa0
[ 8690.191311] [] ? kernel_thread_helper+0x0/0x10
[ 8690.191311] Code: de 4c d2 ff 48 83 c4 08 5b c9 c3 0f 1f 80 00 00 00 00 55 48 89 e5 53 48 83 ec 08 0f 1f 44 00 00 48 89 fb e8 2a ec ff ff 48 89 d8 48 ff 00 79 05 e8 7c 4c d2 ff 48 83 c4 08 5b c9 c3 00 00 00
[ 8690.191311] RIP [] down_read+0x19/0x30
[ 8690.191311] RSP
[ 8690.191311] CR2: ffff8821a7674960
[ 8690.191311] ---[ end trace edada6bedae9cdf1 ]---

[behlendorf]

Thanks we'll look in to it.

[behlendorf]

This is getting pretty stale and we've fixed at least one issue which could have been the root cause. I'm closing the issue, please open a new one if you observe this failure again with the latest code.