| Network Devices, the Kernel, and You! | |
| Introduction | |
| ============ | |
| The following is a random collection of documentation regarding | |
| network devices. | |
| struct net_device allocation rules | |
| ================================== | |
| Network device structures need to persist even after module is unloaded and | |
| must be allocated with alloc_netdev_mqs() and friends. | |
| If device has registered successfully, it will be freed on last use | |
| by free_netdev(). This is required to handle the pathologic case cleanly | |
| (example: rmmod mydriver </sys/class/net/myeth/mtu ) | |
| alloc_netdev_mqs()/alloc_netdev() reserve extra space for driver | |
| private data which gets freed when the network device is freed. If | |
| separately allocated data is attached to the network device | |
| (netdev_priv(dev)) then it is up to the module exit handler to free that. | |
| MTU | |
| === | |
| Each network device has a Maximum Transfer Unit. The MTU does not | |
| include any link layer protocol overhead. Upper layer protocols must | |
| not pass a socket buffer (skb) to a device to transmit with more data | |
| than the mtu. The MTU does not include link layer header overhead, so | |
| for example on Ethernet if the standard MTU is 1500 bytes used, the | |
| actual skb will contain up to 1514 bytes because of the Ethernet | |
| header. Devices should allow for the 4 byte VLAN header as well. | |
| Segmentation Offload (GSO, TSO) is an exception to this rule. The | |
| upper layer protocol may pass a large socket buffer to the device | |
| transmit routine, and the device will break that up into separate | |
| packets based on the current MTU. | |
| MTU is symmetrical and applies both to receive and transmit. A device | |
| must be able to receive at least the maximum size packet allowed by | |
| the MTU. A network device may use the MTU as mechanism to size receive | |
| buffers, but the device should allow packets with VLAN header. With | |
| standard Ethernet mtu of 1500 bytes, the device should allow up to | |
| 1518 byte packets (1500 + 14 header + 4 tag). The device may either: | |
| drop, truncate, or pass up oversize packets, but dropping oversize | |
| packets is preferred. | |
| struct net_device synchronization rules | |
| ======================================= | |
| ndo_open: | |
| Synchronization: rtnl_lock() semaphore. | |
| Context: process | |
| ndo_stop: | |
| Synchronization: rtnl_lock() semaphore. | |
| Context: process | |
| Note: netif_running() is guaranteed false | |
| ndo_do_ioctl: | |
| Synchronization: rtnl_lock() semaphore. | |
| Context: process | |
| ndo_get_stats: | |
| Synchronization: dev_base_lock rwlock. | |
| Context: nominally process, but don't sleep inside an rwlock | |
| ndo_start_xmit: | |
| Synchronization: __netif_tx_lock spinlock. | |
| When the driver sets NETIF_F_LLTX in dev->features this will be | |
| called without holding netif_tx_lock. In this case the driver | |
| has to lock by itself when needed. | |
| The locking there should also properly protect against | |
| set_rx_mode. WARNING: use of NETIF_F_LLTX is deprecated. | |
| Don't use it for new drivers. | |
| Context: Process with BHs disabled or BH (timer), | |
| will be called with interrupts disabled by netconsole. | |
| Return codes: | |
| o NETDEV_TX_OK everything ok. | |
| o NETDEV_TX_BUSY Cannot transmit packet, try later | |
| Usually a bug, means queue start/stop flow control is broken in | |
| the driver. Note: the driver must NOT put the skb in its DMA ring. | |
| ndo_tx_timeout: | |
| Synchronization: netif_tx_lock spinlock; all TX queues frozen. | |
| Context: BHs disabled | |
| Notes: netif_queue_stopped() is guaranteed true | |
| ndo_set_rx_mode: | |
| Synchronization: netif_addr_lock spinlock. | |
| Context: BHs disabled | |
| struct napi_struct synchronization rules | |
| ======================================== | |
| napi->poll: | |
| Synchronization: NAPI_STATE_SCHED bit in napi->state. Device | |
| driver's ndo_stop method will invoke napi_disable() on | |
| all NAPI instances which will do a sleeping poll on the | |
| NAPI_STATE_SCHED napi->state bit, waiting for all pending | |
| NAPI activity to cease. | |
| Context: softirq | |
| will be called with interrupts disabled by netconsole. |