[Bug 209571] ZFS and NVMe performing poorly. TRIM requests stall I/O

[b***@freebsd.org]

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=209571

Mark Linimon <***@FreeBSD.org> changed:

What |Removed |Added
----------------------------------------------------------------------------
Assignee|freebsd-***@FreeBSD.org |freebsd-***@FreeBSD.org

[b***@freebsd.org]

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=209571

David NewHamlet <***@gmail.com> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |***@gmail.com

--- Comment #2 from David NewHamlet <***@gmail.com> ---
I believe that this issue still on FreeBSD-12-CURRENT with dmesg log:

nvme0: async event occurred (log page id=0x2)
nvme0: temperature above threshold

and iostat -x 5
extended device statistics
device r/s w/s kr/s kw/s ms/r ms/w ms/o ms/t qlen %b
nvd0 0 1 0.6 153.6 2384 3287 0 2664 80 99

I am glad to test any patch for this in my test environment.

ref:
https://lists.freebsd.org/pipermail/freebsd-stable/2015-January/081621.html

FreeBSD david-al.localdomain 12.0-CURRENT FreeBSD 12.0-CURRENT #11
5ea1f67b4ad(master)-dirty: Fri Nov 24 09:14:41 NZDT 2017
***@n550jk.localdomain:/tank/cross/obj/12.0-amd64.amd64/sys/INITZ-NODEBUG
amd64

01:00.0 Non-Volatile memory controller: Intel Corporation Device f1a5 (rev 03)

nvme0: <Generic NVMe Device> mem 0xdf200000-0xdf203fff irq 16 at device 0.0 on
pci1

nvd0: <INTEL SSDPEKKW512G7> NVMe namespace

[b***@freebsd.org]

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=209571

Jim Phillips <***@ks.uiuc.edu> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |***@ks.uiuc.edu

--- Comment #3 from Jim Phillips <***@ks.uiuc.edu> ---
I'm going to post this as a separate issue, but will add it here since it is
related. We were seeing non-NVMe SSDs on ZFS timing out on TRIM operations and
have been able to greatly reduce the incidence by setting (for all drives)
sysctl kern.cam.da.0.delete_max=536870912 based on the advice here:
https://lists.freebsd.org/pipermail/freebsd-scsi/2015-July/006777.html