NUC7i5BNB vs RS300, R200, D435, ZR300

[seath49]

Required Info
Camera Model	{ R200 / SR300 / ZR300 / D435 }
Firmware Version	(3.21)
Operating System & Version	{Linux (OpenSuSe 42.3)
Kernel Version (Linux Only)	(4.1, 4.4, 4.9, 4.15 Suse and Vanilla)
Platform	Intel NUC7i5BNB bios v60
SDK Version	{ 2.10.0, 1.12}

Hi,
I am trying to run realsense cameras on a NUC7i5BNB. I tried various kernel versions (4.1, 4.4, 4.9 and 4.15), both SuSe and Vanilla. Some of the kernels were patched and tested on other machines
where the cameras were working correctly.

On NUC7i5BNB, no IR or depth streams work.

dmesg:

[ 112.077457] Linux video capture interface: v2.00
[ 112.092054] uvcvideo: Found UVC 1.10 device Intel(R) RealSense(TM) Camera SR300 (8086:0aa5)
[ 112.094674] input: Intel(R) RealSense(TM) Camera S as /devices/pci0000:00/0000:00:14.0/usb2/2-3/2-3.1/2-3.1.2/2-3.1.2.1/2-3.1.2.1:1.0/input/input11
[ 112.167868] uvcvideo: Unknown video format 435a4e49-b602-480f-978c-e4e88ae89b89
[ 112.168797] uvcvideo: Unknown video format 52494150-8536-4841-b6bf-8fc6ffb083a8
[ 112.169797] uvcvideo: Found UVC 1.10 device Intel(R) RealSense(TM) Camera SR300 (8086:0aa5)
[ 112.172060] uvcvideo: Unable to create debugfs 2-5 directory.
[ 112.173000] input: Intel(R) RealSense(TM) Camera S as /devices/pci0000:00/0000:00:14.0/usb2/2-3/2-3.1/2-3.1.2/2-3.1.2.1/2-3.1.2.1:1.2/input/input12
[ 112.174380] usbcore: registered new interface driver uvcvideo
[ 112.175640] USB Video Class driver (1.1.1)

dmesg when I try to run realsense-viewer: v4l crash on Unknown pixel format:

[ 118.633681] WARNING: CPU: 3 PID: 2402 at drivers/media/v4l2-core/v4l2-ioctl.c:1297 v4l_enum_fmt+0xefe/0x1290 [videodev]
[ 118.635397] Unknown pixelformat 0x00000000
[ 118.637113] Modules linked in: uvcvideo(E) videobuf2_vmalloc(E) videobuf2_memops(E) videobuf2_v4l2(E) videobuf2_core(E) videodev(E) af_packet(E) ext4(E) snd_hda_codec_hdmi(E) crc16(E) jbd2(E) mbcache(E) input_leds(E) led_class(E) snd_hda_codec_realtek(E) snd_hda_codec_generic(E) hid_generic(E) usbhid(E) battery(E) thermal(E) snd_hda_intel(E) snd_hda_codec(E) coretemp(E) snd_hwdep(E) crct10dif_pclmul(E) iTCO_wdt(E) crc32_pclmul(E) snd_hda_core(E) iTCO_vendor_support(E) aesni_intel(E) snd_pcm(E) aes_x86_64(E) glue_helper(E) lrw(E) snd_timer(E) gf128mul(E) e1000e(E) ablk_helper(E) snd(E) i2c_i801(E) ptp(E) cryptd(E) mei_me(E) soundcore(E) pps_core(E) i2c_smbus(E) pcspkr(E) shpchp(E) mei(E) wmi(E) xfs(E) libcrc32c(E) sd_mod(E) i915(E) i2c_algo_bit(E) xhci_pci(E) drm_kms_helper(E) syscopyarea(E) xhci_hcd(E)
[ 118.637147] ahci(E)
[ 118.637147] sysfillrect(E)
[ 118.637148] sysimgblt(E)
[ 118.637148] libahci(E)
[ 118.637148] fb_sys_fops(E)
[ 118.637149] usbcore(E)
[ 118.637149] crc32c_intel(E)
[ 118.637150] libata(E)
[ 118.637150] usb_common(E)
[ 118.637150] drm(E)
[ 118.637151] video(E)
[ 118.637151] button(E)
[ 118.637151] sg(E)
[ 118.637152] scsi_mod(E)
[ 118.637152] autofs4(E)
[ 118.645066] CPU: 3 PID: 2402 Comm: realsense-viewe Tainted: G E 4.9.35-rt25-CR0-rt+ #11
[ 118.645066] Hardware name: Intel Corporation NUC7i5BNK/NUC7i5BNB, BIOS BNKBL357.86A.0060.2017.1214.2013 12/14/2017
[ 118.645069] 0000000000000000 ffffffff812f6f7b ffffc9000322fc70 0000000000000000
[ 118.645070] ffffffff8106c67f ffffc9000322fdc0 ffffc9000322fcc0 0000000000000000
[ 118.645071] ffff880456765240 0000000000000000 ffffffffa0711160 ffffffff8106c6ef
[ 118.645072] Call Trace:
[ 118.645076] [] ? dump_stack+0x5c/0x81
[ 118.645078] [] ? __warn+0xdf/0x100
[ 118.645080] [] ? warn_slowpath_fmt+0x4f/0x60
[ 118.645082] [] ? __kmalloc+0x26/0x200
[ 118.645084] [] ? strlcpy+0x37/0x50
[ 118.645090] [] ? v4l_enum_fmt+0xefe/0x1290 [videodev]
[ 118.645093] [] ? __video_do_ioctl+0x252/0x2d0 [videodev]
[ 118.645095] [] ? path_openat+0x5f3/0x12b0
[ 118.645098] [] ? v4l_enum_fmt+0x1290/0x1290 [videodev]
[ 118.645102] [] ? video_usercopy+0x1dc/0x510 [videodev]
[ 118.645105] [] ? v4l2_ioctl+0x95/0xb0 [videodev]
[ 118.645107] [] ? do_vfs_ioctl+0x8f/0x5d0
[ 118.645108] [] ? __alloc_fd+0xab/0x160
[ 118.645110] [] ? __fget+0x70/0xb0
[ 118.645111] [] ? SyS_ioctl+0x74/0x80
[ 118.645113] [] ? entry_SYSCALL_64_fastpath+0x1a/0xa9
[ 118.645114] ---[ end trace 0000000000000002 ]---
[ 118.691527] ------------[ cut here ]------------
[ 118.692697] WARNING: CPU: 3 PID: 2402 at drivers/media/v4l2-core/v4l2-ioctl.c:1297 v4l_enum_fmt+0xefe/0x1290 [videodev]
[ 118.693855] Unknown pixelformat 0x00000000
[ 118.694938] Modules linked in: uvcvideo(E) videobuf2_vmalloc(E) videobuf2_memops(E) videobuf2_v4l2(E) videobuf2_core(E) videodev(E) af_packet(E) ext4(E) snd_hda_codec_hdmi(E) crc16(E) jbd2(E) mbcache(E) input_leds(E) led_class(E) snd_hda_codec_realtek(E) snd_hda_codec_generic(E) hid_generic(E) usbhid(E) battery(E) thermal(E) snd_hda_intel(E) snd_hda_codec(E) coretemp(E) snd_hwdep(E) crct10dif_pclmul(E) iTCO_wdt(E) crc32_pclmul(E) snd_hda_core(E) iTCO_vendor_support(E) aesni_intel(E) snd_pcm(E) aes_x86_64(E) glue_helper(E) lrw(E) snd_timer(E) gf128mul(E) e1000e(E) ablk_helper(E) snd(E) i2c_i801(E) ptp(E) cryptd(E) mei_me(E) soundcore(E) pps_core(E) i2c_smbus(E) pcspkr(E) shpchp(E) mei(E) wmi(E) xfs(E) libcrc32c(E) sd_mod(E) i915(E) i2c_algo_bit(E) xhci_pci(E) drm_kms_helper(E) syscopyarea(E) xhci_hcd(E)
[ 118.694960] ahci(E)
[ 118.694960] sysfillrect(E)
[ 118.694961] sysimgblt(E)
[ 118.694961] libahci(E)
[ 118.694961] fb_sys_fops(E)
[ 118.694961] usbcore(E)
[ 118.694962] crc32c_intel(E)
[ 118.694962] libata(E)
[ 118.694962] usb_common(E)
[ 118.694962] drm(E)
[ 118.694963] video(E)
[ 118.694963] button(E)
[ 118.694963] sg(E)
[ 118.694963] scsi_mod(E)
[ 118.694964] autofs4(E)
[ 118.700097] CPU: 3 PID: 2402 Comm: realsense-viewe Tainted: G W E 4.9.35-rt25-CR0-rt+ #11
[ 118.700097] Hardware name: Intel Corporation NUC7i5BNK/NUC7i5BNB, BIOS BNKBL357.86A.0060.2017.1214.2013 12/14/2017
[ 118.700099] 0000000000000000 ffffffff812f6f7b ffffc9000322fc70 0000000000000000
[ 118.700100] ffffffff8106c67f ffffc9000322fdc0 ffffc9000322fcc0 0000000000000000
[ 118.700100] ffff880456765240 0000000000000000 ffffffffa0711160 ffffffff8106c6ef
[ 118.700100] Call Trace:
[ 118.700103] [] ? dump_stack+0x5c/0x81
[ 118.700105] [] ? __warn+0xdf/0x100
[ 118.700106] [] ? warn_slowpath_fmt+0x4f/0x60
[ 118.700107] [] ? __kmalloc+0x26/0x200
[ 118.700108] [] ? strlcpy+0x37/0x50
[ 118.700111] [] ? v4l_enum_fmt+0xefe/0x1290 [videodev]
[ 118.700114] [] ? __video_do_ioctl+0x252/0x2d0 [videodev]
[ 118.700116] [] ? v4l_enum_fmt+0x1290/0x1290 [videodev]
[ 118.700118] [] ? video_usercopy+0x1dc/0x510 [videodev]
[ 118.700120] [] ? finish_task_switch+0x7d/0x220
[ 118.700122] [] ? v4l2_ioctl+0x95/0xb0 [videodev]
[ 118.700123] [] ? do_vfs_ioctl+0x8f/0x5d0
[ 118.700124] [] ? __fget+0x70/0xb0
[ 118.700125] [] ? SyS_ioctl+0x74/0x80
[ 118.700127] [] ? entry_SYSCALL_64_fastpath+0x1a/0xa9
[ 118.700128] ---[ end trace 0000000000000003 ]---

v4l-info report:

v4l2 device info [/dev/video0]

general info
VIDIOC_QUERYCAP
driver : "uvcvideo"
card : "Intel(R) RealSense(TM) Camera S"
bus_info : "usb-0000:00:14.0-3.1.2.1"
version : 4.9.35
capabilities : 0x84200001 [VIDEO_CAPTURE,?,STREAMING,(null)]

standards

inputs
VIDIOC_ENUMINPUT(0)
index : 0
name : "Camera 1"
type : CAMERA
audioset : 0
tuner : 0
std : 0x0 []
status : 0x0 []

video capture
VIDIOC_ENUM_FMT(0,VIDEO_CAPTURE)
index : 0
type : VIDEO_CAPTURE
flags : 0
description : "YUYV 4:2:2"
pixelformat : 0x56595559 [YUYV]
VIDIOC_G_FMT(VIDEO_CAPTURE)
type : VIDEO_CAPTURE
fmt.pix.width : 320
fmt.pix.height : 180
fmt.pix.pixelformat : 0x56595559 [YUYV]
fmt.pix.field : NONE
fmt.pix.bytesperline : 640
fmt.pix.sizeimage : 115200
fmt.pix.colorspace : unknown
fmt.pix.priv : 4276996862

controls
VIDIOC_QUERYCTRL(BASE+0)
id : 9963776
type : INTEGER
name : "Brightness"
minimum : -64
maximum : 64
step : 1
default_value : 0
flags : 0
VIDIOC_QUERYCTRL(BASE+1)
id : 9963777
type : INTEGER
name : "Contrast"
minimum : 0
maximum : 100
step : 1
default_value : 50
flags : 0
VIDIOC_QUERYCTRL(BASE+2)
id : 9963778
type : INTEGER
name : "Saturation"
minimum : 0
maximum : 100
step : 1
default_value : 64
flags : 0
VIDIOC_QUERYCTRL(BASE+3)
id : 9963779
type : INTEGER
name : "Hue"
minimum : -180
maximum : 180
step : 1
default_value : 0
flags : 0
VIDIOC_QUERYCTRL(BASE+12)
id : 9963788
type : BOOLEAN
name : "White Balance Temperature, Auto"
minimum : 0
maximum : 1
step : 1
default_value : 1
flags : 0
VIDIOC_QUERYCTRL(BASE+16)
id : 9963792
type : INTEGER
name : "Gamma"
minimum : 100
maximum : 500
step : 1
default_value : 300
flags : 0
VIDIOC_QUERYCTRL(BASE+19)
id : 9963795
type : INTEGER
name : "Gain"
minimum : 0
maximum : 128
step : 1
default_value : 64
flags : 0
VIDIOC_QUERYCTRL(BASE+26)
id : 9963802
type : INTEGER
name : "White Balance Temperature"
minimum : 2800
maximum : 6500
step : 10
default_value : 4600
flags : 16
VIDIOC_QUERYCTRL(BASE+27)
id : 9963803
type : INTEGER
name : "Sharpness"
minimum : 0
maximum : 100
step : 1
default_value : 50
flags : 0
VIDIOC_QUERYCTRL(BASE+28)
id : 9963804
type : INTEGER
name : "Backlight Compensation"
minimum : 0
maximum : 4
step : 1
default_value : 0
flags : 0

realsense-viewer reports:

WARNING [140299746359040] (sensor.cpp:315) Unregistered Media formats : [ INZC PAIR YUYV ]; Supported: [ ]

v4l-info has some funny reports e.g.:
capabilities : 0x84200001 [VIDEO_CAPTURE,?,STREAMING,(null)]
fmt.pix.colorspace : unknown

Also, the camera (SR300) reports two formats which are nowhere in the patches or documentation
(fourcc: INZC and PAIR).
BIOS is at the newest version (v60), I tried the cameras plugged in directly or through a powered USB hub, same result. Any help would be appreciated.
Thanks,
Seath

[ev-mp]

Hello @seath49 ,
SR300 depth video formats were upstreamed into 4.12 kernel. Running Vanilla kernel with that version or later should allow you to receive both the depth and infrared data.
There are additional utility formats that are not intended for upstream that are the warnings and kernel logs. (See a related 1137 for details).

As for the logs attached -
Though you haven't specified the kernel version/distribution used when the logs there issued, I would assume it would the 4.15 kernel (otherwise you'd receive more than two uvcvideo: Unknown video format messages). As mentioned above - with 4.12+ streaming of SR300 Depth + IR should be available out of the box with all distributions.
In order to understand what went wrong please perform the following -

• Run dmesg -wT
• Reconnect SR300
• Run 'realsense-viewer' with Depth+IR configuration.
• Post the kernel and Application log for analysis

[ev-mp]

Hi @seath49, do you still need assistance with this issue ?

[RealSense-Customer-Engineering]

[Realsense Customer Engineering Team Comment]
Hi @seath49,
Once the patch for INZC and PAIR formats applied, still see any issue?

[seath49]

Hi,

@RealSense-Customer-Engineering
correct me if I'm wrong, but there are no PAIR or INZC fourcc codes in the patches provided.
These codes missing are not reported on other computers where the cameras work flawlessly.

@ev-mp
Sorry for the late reply. The message here is that there seems to be a USB problem on NUC7i5BNB.
So I reached out for help, hoping somebody already went down this road. The missing formats are
reported by the camera, however, they are not reported missing on other computers with identical kernel. So I assume that the cameras don't play well with the NUC chipset?

Thanks,
Seath

[RealSense-Customer-Engineering]

[Realsense Customer Engineering Team Comment]
Hi @seach49

As @ev-mp mentioned, you can refer to a related 1137 for details to patch INZC and PAIR (missing SR300 formats) in the related source codes to generate uvc drivers. Not sure how your other computers have no these two formats missing issue if no manual patches in kernel 4.14. You can run the command "v4l2-ctl --list-formats-ext -d /dev/video1" to show the result.

After the manual patches, you should see below format showing correctly.

Index : 3
Type : Video Capture
Pixel Format: 'INZC'
Name : IR with Confidence
Size: Discrete 640x480
Interval: Discrete 0.017s (60.000 fps)
Interval: Discrete 0.033s (30.000 fps)
Interval: Discrete 0.100s (10.000 fps)
Size: Discrete 640x240
Interval: Discrete 0.009s (110.000 fps)
Interval: Discrete 0.017s (60.000 fps)
Interval: Discrete 0.033s (30.000 fps)
Interval: Discrete 0.100s (10.000 fps)

Index : 5
Type : Video Capture
Pixel Format: 'PAIR'
Name : Custom IR
Size: Discrete 640x480
Interval: Discrete 0.017s (60.000 fps)

[RealSense-Customer-Engineering]

[Realsense Customer Engineering Team Comment]
Hi @seach49,

Still need any support for this topic? If not, will close this issue.