| .. SPDX-License-Identifier: GPL-2.0 | |
| i.MX7 Video Capture Driver | |
| ========================== | |
| Introduction | |
| ------------ | |
| The i.MX7 contrary to the i.MX5/6 family does not contain an Image Processing | |
| Unit (IPU); because of that the capabilities to perform operations or | |
| manipulation of the capture frames are less feature rich. | |
| For image capture the i.MX7 has three units: | |
| - CMOS Sensor Interface (CSI) | |
| - Video Multiplexer | |
| - MIPI CSI-2 Receiver | |
| .. code-block:: none | |
| MIPI Camera Input ---> MIPI CSI-2 --- > |\ | |
| | \ | |
| | \ | |
| | M | | |
| | U | ------> CSI ---> Capture | |
| | X | | |
| | / | |
| Parallel Camera Input ----------------> | / | |
| |/ | |
| For additional information, please refer to the latest versions of the i.MX7 | |
| reference manual [#f1]_. | |
| Entities | |
| -------- | |
| imx-mipi-csi2 | |
| -------------- | |
| This is the MIPI CSI-2 receiver entity. It has one sink pad to receive the pixel | |
| data from MIPI CSI-2 camera sensor. It has one source pad, corresponding to the | |
| virtual channel 0. This module is compliant to previous version of Samsung | |
| D-phy, and supports two D-PHY Rx Data lanes. | |
| csi-mux | |
| ------- | |
| This is the video multiplexer. It has two sink pads to select from either camera | |
| sensor with a parallel interface or from MIPI CSI-2 virtual channel 0. It has | |
| a single source pad that routes to the CSI. | |
| csi | |
| --- | |
| The CSI enables the chip to connect directly to external CMOS image sensor. CSI | |
| can interface directly with Parallel and MIPI CSI-2 buses. It has 256 x 64 FIFO | |
| to store received image pixel data and embedded DMA controllers to transfer data | |
| from the FIFO through AHB bus. | |
| This entity has one sink pad that receives from the csi-mux entity and a single | |
| source pad that routes video frames directly to memory buffers. This pad is | |
| routed to a capture device node. | |
| Usage Notes | |
| ----------- | |
| To aid in configuration and for backward compatibility with V4L2 applications | |
| that access controls only from video device nodes, the capture device interfaces | |
| inherit controls from the active entities in the current pipeline, so controls | |
| can be accessed either directly from the subdev or from the active capture | |
| device interface. For example, the sensor controls are available either from the | |
| sensor subdevs or from the active capture device. | |
| Warp7 with OV2680 | |
| ----------------- | |
| On this platform an OV2680 MIPI CSI-2 module is connected to the internal MIPI | |
| CSI-2 receiver. The following example configures a video capture pipeline with | |
| an output of 800x600, and BGGR 10 bit bayer format: | |
| .. code-block:: none | |
| # Setup links | |
| media-ctl -l "'ov2680 1-0036':0 -> 'imx7-mipi-csis.0':0[1]" | |
| media-ctl -l "'imx7-mipi-csis.0':1 -> 'csi-mux':1[1]" | |
| media-ctl -l "'csi-mux':2 -> 'csi':0[1]" | |
| media-ctl -l "'csi':1 -> 'csi capture':0[1]" | |
| # Configure pads for pipeline | |
| media-ctl -V "'ov2680 1-0036':0 [fmt:SBGGR10_1X10/800x600 field:none]" | |
| media-ctl -V "'csi-mux':1 [fmt:SBGGR10_1X10/800x600 field:none]" | |
| media-ctl -V "'csi-mux':2 [fmt:SBGGR10_1X10/800x600 field:none]" | |
| media-ctl -V "'imx7-mipi-csis.0':0 [fmt:SBGGR10_1X10/800x600 field:none]" | |
| media-ctl -V "'csi':0 [fmt:SBGGR10_1X10/800x600 field:none]" | |
| After this streaming can start. The v4l2-ctl tool can be used to select any of | |
| the resolutions supported by the sensor. | |
| .. code-block:: none | |
| # media-ctl -p | |
| Media controller API version 5.2.0 | |
| Media device information | |
| ------------------------ | |
| driver imx7-csi | |
| model imx-media | |
| serial | |
| bus info | |
| hw revision 0x0 | |
| driver version 5.2.0 | |
| Device topology | |
| - entity 1: csi (2 pads, 2 links) | |
| type V4L2 subdev subtype Unknown flags 0 | |
| device node name /dev/v4l-subdev0 | |
| pad0: Sink | |
| [fmt:SBGGR10_1X10/800x600 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:full-range] | |
| <- "csi-mux":2 [ENABLED] | |
| pad1: Source | |
| [fmt:SBGGR10_1X10/800x600 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:full-range] | |
| -> "csi capture":0 [ENABLED] | |
| - entity 4: csi capture (1 pad, 1 link) | |
| type Node subtype V4L flags 0 | |
| device node name /dev/video0 | |
| pad0: Sink | |
| <- "csi":1 [ENABLED] | |
| - entity 10: csi-mux (3 pads, 2 links) | |
| type V4L2 subdev subtype Unknown flags 0 | |
| device node name /dev/v4l-subdev1 | |
| pad0: Sink | |
| [fmt:Y8_1X8/1x1 field:none] | |
| pad1: Sink | |
| [fmt:SBGGR10_1X10/800x600 field:none] | |
| <- "imx7-mipi-csis.0":1 [ENABLED] | |
| pad2: Source | |
| [fmt:SBGGR10_1X10/800x600 field:none] | |
| -> "csi":0 [ENABLED] | |
| - entity 14: imx7-mipi-csis.0 (2 pads, 2 links) | |
| type V4L2 subdev subtype Unknown flags 0 | |
| device node name /dev/v4l-subdev2 | |
| pad0: Sink | |
| [fmt:SBGGR10_1X10/800x600 field:none] | |
| <- "ov2680 1-0036":0 [ENABLED] | |
| pad1: Source | |
| [fmt:SBGGR10_1X10/800x600 field:none] | |
| -> "csi-mux":1 [ENABLED] | |
| - entity 17: ov2680 1-0036 (1 pad, 1 link) | |
| type V4L2 subdev subtype Sensor flags 0 | |
| device node name /dev/v4l-subdev3 | |
| pad0: Source | |
| [fmt:SBGGR10_1X10/800x600@1/30 field:none colorspace:srgb] | |
| -> "imx7-mipi-csis.0":0 [ENABLED] | |
| i.MX6ULL-EVK with OV5640 | |
| ------------------------ | |
| On this platform a parallel OV5640 sensor is connected to the CSI port. | |
| The following example configures a video capture pipeline with an output | |
| of 640x480 and UYVY8_2X8 format: | |
| .. code-block:: none | |
| # Setup links | |
| media-ctl -l "'ov5640 1-003c':0 -> 'csi':0[1]" | |
| media-ctl -l "'csi':1 -> 'csi capture':0[1]" | |
| # Configure pads for pipeline | |
| media-ctl -v -V "'ov5640 1-003c':0 [fmt:UYVY8_2X8/640x480 field:none]" | |
| After this streaming can start: | |
| .. code-block:: none | |
| gst-launch-1.0 -v v4l2src device=/dev/video1 ! video/x-raw,format=UYVY,width=640,height=480 ! v4l2convert ! fbdevsink | |
| .. code-block:: none | |
| # media-ctl -p | |
| Media controller API version 5.14.0 | |
| Media device information | |
| ------------------------ | |
| driver imx7-csi | |
| model imx-media | |
| serial | |
| bus info | |
| hw revision 0x0 | |
| driver version 5.14.0 | |
| Device topology | |
| - entity 1: csi (2 pads, 2 links) | |
| type V4L2 subdev subtype Unknown flags 0 | |
| device node name /dev/v4l-subdev0 | |
| pad0: Sink | |
| [fmt:UYVY8_2X8/640x480 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:full-range] | |
| <- "ov5640 1-003c":0 [ENABLED,IMMUTABLE] | |
| pad1: Source | |
| [fmt:UYVY8_2X8/640x480 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:full-range] | |
| -> "csi capture":0 [ENABLED,IMMUTABLE] | |
| - entity 4: csi capture (1 pad, 1 link) | |
| type Node subtype V4L flags 0 | |
| device node name /dev/video1 | |
| pad0: Sink | |
| <- "csi":1 [ENABLED,IMMUTABLE] | |
| - entity 10: ov5640 1-003c (1 pad, 1 link) | |
| type V4L2 subdev subtype Sensor flags 0 | |
| device node name /dev/v4l-subdev1 | |
| pad0: Source | |
| [fmt:UYVY8_2X8/640x480@1/30 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:full-range] | |
| -> "csi":0 [ENABLED,IMMUTABLE] | |
| References | |
| ---------- | |
| .. [#f1] https://www.nxp.com/docs/en/reference-manual/IMX7SRM.pdf |