| .. include:: <isonum.txt> |
| |
| ========================== |
| Linux generic IRQ handling |
| ========================== |
| |
| :Copyright: |copy| 2005-2010: Thomas Gleixner |
| :Copyright: |copy| 2005-2006: Ingo Molnar |
| |
| Introduction |
| ============ |
| |
| The generic interrupt handling layer is designed to provide a complete |
| abstraction of interrupt handling for device drivers. It is able to |
| handle all the different types of interrupt controller hardware. Device |
| drivers use generic API functions to request, enable, disable and free |
| interrupts. The drivers do not have to know anything about interrupt |
| hardware details, so they can be used on different platforms without |
| code changes. |
| |
| This documentation is provided to developers who want to implement an |
| interrupt subsystem based for their architecture, with the help of the |
| generic IRQ handling layer. |
| |
| Rationale |
| ========= |
| |
| The original implementation of interrupt handling in Linux uses the |
| :c:func:`__do_IRQ` super-handler, which is able to deal with every type of |
| interrupt logic. |
| |
| Originally, Russell King identified different types of handlers to build |
| a quite universal set for the ARM interrupt handler implementation in |
| Linux 2.5/2.6. He distinguished between: |
| |
| - Level type |
| |
| - Edge type |
| |
| - Simple type |
| |
| During the implementation we identified another type: |
| |
| - Fast EOI type |
| |
| In the SMP world of the :c:func:`__do_IRQ` super-handler another type was |
| identified: |
| |
| - Per CPU type |
| |
| This split implementation of high-level IRQ handlers allows us to |
| optimize the flow of the interrupt handling for each specific interrupt |
| type. This reduces complexity in that particular code path and allows |
| the optimized handling of a given type. |
| |
| The original general IRQ implementation used hw_interrupt_type |
| structures and their ``->ack``, ``->end`` [etc.] callbacks to differentiate |
| the flow control in the super-handler. This leads to a mix of flow logic |
| and low-level hardware logic, and it also leads to unnecessary code |
| duplication: for example in i386, there is an ``ioapic_level_irq`` and an |
| ``ioapic_edge_irq`` IRQ-type which share many of the low-level details but |
| have different flow handling. |
| |
| A more natural abstraction is the clean separation of the 'irq flow' and |
| the 'chip details'. |
| |
| Analysing a couple of architecture's IRQ subsystem implementations |
| reveals that most of them can use a generic set of 'irq flow' methods |
| and only need to add the chip-level specific code. The separation is |
| also valuable for (sub)architectures which need specific quirks in the |
| IRQ flow itself but not in the chip details - and thus provides a more |
| transparent IRQ subsystem design. |
| |
| Each interrupt descriptor is assigned its own high-level flow handler, |
| which is normally one of the generic implementations. (This high-level |
| flow handler implementation also makes it simple to provide |
| demultiplexing handlers which can be found in embedded platforms on |
| various architectures.) |
| |
| The separation makes the generic interrupt handling layer more flexible |
| and extensible. For example, an (sub)architecture can use a generic |
| IRQ-flow implementation for 'level type' interrupts and add a |
| (sub)architecture specific 'edge type' implementation. |
| |
| To make the transition to the new model easier and prevent the breakage |
| of existing implementations, the :c:func:`__do_IRQ` super-handler is still |
| available. This leads to a kind of duality for the time being. Over time |
| the new model should be used in more and more architectures, as it |
| enables smaller and cleaner IRQ subsystems. It's deprecated for three |
| years now and about to be removed. |
| |
| Known Bugs And Assumptions |
| ========================== |
| |
| None (knock on wood). |
| |
| Abstraction layers |
| ================== |
| |
| There are three main levels of abstraction in the interrupt code: |
| |
| 1. High-level driver API |
| |
| 2. High-level IRQ flow handlers |
| |
| 3. Chip-level hardware encapsulation |
| |
| Interrupt control flow |
| ---------------------- |
| |
| Each interrupt is described by an interrupt descriptor structure |
| irq_desc. The interrupt is referenced by an 'unsigned int' numeric |
| value which selects the corresponding interrupt description structure in |
| the descriptor structures array. The descriptor structure contains |
| status information and pointers to the interrupt flow method and the |
| interrupt chip structure which are assigned to this interrupt. |
| |
| Whenever an interrupt triggers, the low-level architecture code calls |
| into the generic interrupt code by calling :c:func:`desc->handle_irq`. This |
| high-level IRQ handling function only uses desc->irq_data.chip |
| primitives referenced by the assigned chip descriptor structure. |
| |
| High-level Driver API |
| --------------------- |
| |
| The high-level Driver API consists of following functions: |
| |
| - :c:func:`request_irq` |
| |
| - :c:func:`free_irq` |
| |
| - :c:func:`disable_irq` |
| |
| - :c:func:`enable_irq` |
| |
| - :c:func:`disable_irq_nosync` (SMP only) |
| |
| - :c:func:`synchronize_irq` (SMP only) |
| |
| - :c:func:`irq_set_irq_type` |
| |
| - :c:func:`irq_set_irq_wake` |
| |
| - :c:func:`irq_set_handler_data` |
| |
| - :c:func:`irq_set_chip` |
| |
| - :c:func:`irq_set_chip_data` |
| |
| See the autogenerated function documentation for details. |
| |
| High-level IRQ flow handlers |
| ---------------------------- |
| |
| The generic layer provides a set of pre-defined irq-flow methods: |
| |
| - :c:func:`handle_level_irq` |
| |
| - :c:func:`handle_edge_irq` |
| |
| - :c:func:`handle_fasteoi_irq` |
| |
| - :c:func:`handle_simple_irq` |
| |
| - :c:func:`handle_percpu_irq` |
| |
| - :c:func:`handle_edge_eoi_irq` |
| |
| - :c:func:`handle_bad_irq` |
| |
| The interrupt flow handlers (either pre-defined or architecture |
| specific) are assigned to specific interrupts by the architecture either |
| during bootup or during device initialization. |
| |
| Default flow implementations |
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
| |
| Helper functions |
| ^^^^^^^^^^^^^^^^ |
| |
| The helper functions call the chip primitives and are used by the |
| default flow implementations. The following helper functions are |
| implemented (simplified excerpt):: |
| |
| default_enable(struct irq_data *data) |
| { |
| desc->irq_data.chip->irq_unmask(data); |
| } |
| |
| default_disable(struct irq_data *data) |
| { |
| if (!delay_disable(data)) |
| desc->irq_data.chip->irq_mask(data); |
| } |
| |
| default_ack(struct irq_data *data) |
| { |
| chip->irq_ack(data); |
| } |
| |
| default_mask_ack(struct irq_data *data) |
| { |
| if (chip->irq_mask_ack) { |
| chip->irq_mask_ack(data); |
| } else { |
| chip->irq_mask(data); |
| chip->irq_ack(data); |
| } |
| } |
| |
| noop(struct irq_data *data)) |
| { |
| } |
| |
| |
| |
| Default flow handler implementations |
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
| |
| Default Level IRQ flow handler |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| |
| handle_level_irq provides a generic implementation for level-triggered |
| interrupts. |
| |
| The following control flow is implemented (simplified excerpt):: |
| |
| desc->irq_data.chip->irq_mask_ack(); |
| handle_irq_event(desc->action); |
| desc->irq_data.chip->irq_unmask(); |
| |
| |
| Default Fast EOI IRQ flow handler |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| |
| handle_fasteoi_irq provides a generic implementation for interrupts, |
| which only need an EOI at the end of the handler. |
| |
| The following control flow is implemented (simplified excerpt):: |
| |
| handle_irq_event(desc->action); |
| desc->irq_data.chip->irq_eoi(); |
| |
| |
| Default Edge IRQ flow handler |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| |
| handle_edge_irq provides a generic implementation for edge-triggered |
| interrupts. |
| |
| The following control flow is implemented (simplified excerpt):: |
| |
| if (desc->status & running) { |
| desc->irq_data.chip->irq_mask_ack(); |
| desc->status |= pending | masked; |
| return; |
| } |
| desc->irq_data.chip->irq_ack(); |
| desc->status |= running; |
| do { |
| if (desc->status & masked) |
| desc->irq_data.chip->irq_unmask(); |
| desc->status &= ~pending; |
| handle_irq_event(desc->action); |
| } while (status & pending); |
| desc->status &= ~running; |
| |
| |
| Default simple IRQ flow handler |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| |
| handle_simple_irq provides a generic implementation for simple |
| interrupts. |
| |
| .. note:: |
| |
| The simple flow handler does not call any handler/chip primitives. |
| |
| The following control flow is implemented (simplified excerpt):: |
| |
| handle_irq_event(desc->action); |
| |
| |
| Default per CPU flow handler |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| |
| handle_percpu_irq provides a generic implementation for per CPU |
| interrupts. |
| |
| Per CPU interrupts are only available on SMP and the handler provides a |
| simplified version without locking. |
| |
| The following control flow is implemented (simplified excerpt):: |
| |
| if (desc->irq_data.chip->irq_ack) |
| desc->irq_data.chip->irq_ack(); |
| handle_irq_event(desc->action); |
| if (desc->irq_data.chip->irq_eoi) |
| desc->irq_data.chip->irq_eoi(); |
| |
| |
| EOI Edge IRQ flow handler |
| ^^^^^^^^^^^^^^^^^^^^^^^^^ |
| |
| handle_edge_eoi_irq provides an abnomination of the edge handler |
| which is solely used to tame a badly wreckaged irq controller on |
| powerpc/cell. |
| |
| Bad IRQ flow handler |
| ^^^^^^^^^^^^^^^^^^^^ |
| |
| handle_bad_irq is used for spurious interrupts which have no real |
| handler assigned.. |
| |
| Quirks and optimizations |
| ~~~~~~~~~~~~~~~~~~~~~~~~ |
| |
| The generic functions are intended for 'clean' architectures and chips, |
| which have no platform-specific IRQ handling quirks. If an architecture |
| needs to implement quirks on the 'flow' level then it can do so by |
| overriding the high-level irq-flow handler. |
| |
| Delayed interrupt disable |
| ~~~~~~~~~~~~~~~~~~~~~~~~~ |
| |
| This per interrupt selectable feature, which was introduced by Russell |
| King in the ARM interrupt implementation, does not mask an interrupt at |
| the hardware level when :c:func:`disable_irq` is called. The interrupt is kept |
| enabled and is masked in the flow handler when an interrupt event |
| happens. This prevents losing edge interrupts on hardware which does not |
| store an edge interrupt event while the interrupt is disabled at the |
| hardware level. When an interrupt arrives while the IRQ_DISABLED flag |
| is set, then the interrupt is masked at the hardware level and the |
| IRQ_PENDING bit is set. When the interrupt is re-enabled by |
| :c:func:`enable_irq` the pending bit is checked and if it is set, the interrupt |
| is resent either via hardware or by a software resend mechanism. (It's |
| necessary to enable CONFIG_HARDIRQS_SW_RESEND when you want to use |
| the delayed interrupt disable feature and your hardware is not capable |
| of retriggering an interrupt.) The delayed interrupt disable is not |
| configurable. |
| |
| Chip-level hardware encapsulation |
| --------------------------------- |
| |
| The chip-level hardware descriptor structure :c:type:`irq_chip` contains all |
| the direct chip relevant functions, which can be utilized by the irq flow |
| implementations. |
| |
| - ``irq_ack`` |
| |
| - ``irq_mask_ack`` - Optional, recommended for performance |
| |
| - ``irq_mask`` |
| |
| - ``irq_unmask`` |
| |
| - ``irq_eoi`` - Optional, required for EOI flow handlers |
| |
| - ``irq_retrigger`` - Optional |
| |
| - ``irq_set_type`` - Optional |
| |
| - ``irq_set_wake`` - Optional |
| |
| These primitives are strictly intended to mean what they say: ack means |
| ACK, masking means masking of an IRQ line, etc. It is up to the flow |
| handler(s) to use these basic units of low-level functionality. |
| |
| __do_IRQ entry point |
| ==================== |
| |
| The original implementation :c:func:`__do_IRQ` was an alternative entry point |
| for all types of interrupts. It no longer exists. |
| |
| This handler turned out to be not suitable for all interrupt hardware |
| and was therefore reimplemented with split functionality for |
| edge/level/simple/percpu interrupts. This is not only a functional |
| optimization. It also shortens code paths for interrupts. |
| |
| Locking on SMP |
| ============== |
| |
| The locking of chip registers is up to the architecture that defines the |
| chip primitives. The per-irq structure is protected via desc->lock, by |
| the generic layer. |
| |
| Generic interrupt chip |
| ====================== |
| |
| To avoid copies of identical implementations of IRQ chips the core |
| provides a configurable generic interrupt chip implementation. |
| Developers should check carefully whether the generic chip fits their |
| needs before implementing the same functionality slightly differently |
| themselves. |
| |
| .. kernel-doc:: kernel/irq/generic-chip.c |
| :export: |
| |
| Structures |
| ========== |
| |
| This chapter contains the autogenerated documentation of the structures |
| which are used in the generic IRQ layer. |
| |
| .. kernel-doc:: include/linux/irq.h |
| :internal: |
| |
| .. kernel-doc:: include/linux/interrupt.h |
| :internal: |
| |
| Public Functions Provided |
| ========================= |
| |
| This chapter contains the autogenerated documentation of the kernel API |
| functions which are exported. |
| |
| .. kernel-doc:: kernel/irq/manage.c |
| |
| .. kernel-doc:: kernel/irq/chip.c |
| |
| Internal Functions Provided |
| =========================== |
| |
| This chapter contains the autogenerated documentation of the internal |
| functions. |
| |
| .. kernel-doc:: kernel/irq/irqdesc.c |
| |
| .. kernel-doc:: kernel/irq/handle.c |
| |
| .. kernel-doc:: kernel/irq/chip.c |
| |
| Credits |
| ======= |
| |
| The following people have contributed to this document: |
| |
| 1. Thomas Gleixner tglx@linutronix.de |
| |
| 2. Ingo Molnar mingo@elte.hu |