Find the answer to your Linux question:
Results 1 to 2 of 2
Hi All, We are using the following cat /proc/cpuinfo Processor : ARMv7 Processor rev 7 (v7l) BogoMIPS : 597.64 Features : swp half thumb fastmult vfp edsp neon vfpv3 CPU ...
Enjoy an ad free experience by logging in. Not a member yet? Register.
  1. #1
    Just Joined!
    Join Date
    Dec 2012
    Posts
    1

    Serial Driver HW FIFO over flow and 64K tty buffer over flow


    Hi All,

    We are using the following
    cat /proc/cpuinfo Processor : ARMv7 Processor rev 7 (v7l) BogoMIPS : 597.64 Features : swp half thumb fastmult vfp edsp neon vfpv3 CPU implementer : 0x41 CPU architecture: 7 CPU variant : 0x1 CPU part : 0xc08 CPU revision : 7

    Hardware : OMAP3517/AM3517 EVM Revision : 0020 Serial : 0000000000000000

    We are using Linux kernel version 2.6.32
    # uname -a Linux ti-omap3-am3517-evm 2.6.32.8 #71 PREEMPT Mon Nov 5 15:37:19 EST 2012 armv7l unknown

    The issue (HW FIFO over flow) we are facing is with serial driver (driver/serial/8250.c) uart_rx_char(). The serial port has 64 bytes FIFO and it is configured to generate interrupt upon receiving 32 bytes.

    We are reading/writing data from/to serial port at 460800 baud rate. The regression test runs over the period of 7-8 hours in which we send and receive data to/from the serial port. After a couple of hours what we see is that HWFIFO over flow happens and we have no clue why it is happening. We are assuming that either one of the following two things are happening.

    1) The serial interrupt is skipped because other interrupts (Ethernet/ i2c and MMC (out of which we don't use MMC and i2c during the regression test ) in the systems takes too long that serial interrupts are skipped and by the time the serial ISR gets a chance to run the HW FIFO is already full.

    2) The other assumption is that we must process the ISR in less than 1msec (one milisecond) as such 460800 bits per second => 460800/1000 ms ~= 460 bits/ms ~= 52bytes/ms and since we have configured serial port to generate interrupt at every 32 bytes it gives us 32/50 ms ~= 0.64 ms to complete ISR. ( I have ignred start and stop bit) but it gives rough estimated ball park.

    How do I confirm the point 1 and point 2 I mentioned above? Any pointers will be appreciated.

    We also assume that the 8250.c (serial driver) is fairly old and robust and it shouldn't behave the way it is for us.

    Let me know if you need more information.

    The 8250.c driver can be found at this lxr free electron arm v 2.6.32

    One more question I have is that the serial port used on our target board is ST16654 based which has following configuration.

    [PORT_16654] = { .name = "ST16654", .fifo_size = 64, .tx_loadsz = 32, .fcr = UART_FCR_ENABLE_FIFO | UART_FCR_R_TRIG_01 | UART_FCR_T_TRIG_10, .flags = UART_CAP_FIFO | UART_CAP_EFR | UART_CAP_SLEEP }

    I checked the code and to me it looks rx trigger is set for 16 bytes wheres as tx trigger is set to 32 bytes defined this lxr free electron arm v 2.6.32

    I recompiled the kernel with FTRACE support. Also, I made changes in 8250.c so that serial port rx and tx interrupt happens when the FIFO is 8 bytes full. (It was 16 bytes in rx direction and 32 bytes in tx direction). I observed that the HW FIFO overflow happened followed by 64k buffer over flow and I had a program that triggered the cat trace.


    Attached are the information about trace and current kernel configuration.
    Does any one know why this HW over flow and 64k buffer over flow are happening? As far as 64K buffer over run is concerned I found that flush_to_ldisc keeps requesting buffers for a long time , but why I don't understand. Any pointers?

    # hrtimer: interrupt took 610352 ns
    HWFIFO OVERFLOW

    [12/03/2012|23:04:27.899] : checkOverRun : buf_overrun(0) overrun(1) frame(0) parity(0) brk(0) buffer(-820453800)
    [12/03/2012|23:04:27.906] : Begin Dump)
    # tracer: preemptoff
    #
    # preemptoff latency trace v1.1.5 on 2.6.32.8
    # --------------------------------------------------------------------
    # latency: 2288 us, #713/713, CPU#0 | (Mreempt VP:0, KP:0, SP:0 HP:0)
    # -----------------
    # | task: -1251 (uid:0 nice:0 policy:0 rt_prio:0)
    # -----------------
    # => started at: schedule
    # => ended at: schedule
    #
    #
    # _------=> CPU#
    # / _-----=> irqs-off
    # | / _----=> need-resched
    # || / _---=> hardirq/softirq
    # ||| / _--=> preempt-depth
    # |||| /_--=> lock-depth
    # |||||/ delay
    # cmd pid |||||| time | caller
    # \ / |||||| \ | /
    <...>-1252 0d..1. 0us : enqueue_hrtimer <-__hrtimer_start_range_ns
    <...>-1252 0...1. 0us : __hrtimer_start_range_ns
    <...>-1252 0...1. 0us : trace_preempt_on <-__hrtimer_start_range_ns
    <...>-1252 0...1. 0us : schedule
    <...>-1252 0d..1. 0us : add_preempt_count <-schedule
    <...>-1252 0d..2. 0us : omap34xx_32k_read <-sched_clock
    <...>-1252 0d..2. 0us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d..2. 0us+: deactivate_task <-schedule
    <...>-1252 0d..2. 31us : dequeue_task <-deactivate_task
    <...>-1252 0d..2. 31us : update_avg <-dequeue_task
    <...>-1252 0d..2. 31us : dequeue_task_fair <-dequeue_task
    <...>-1252 0d..2. 31us : dequeue_entity <-dequeue_task_fair
    <...>-1252 0d..2. 31us : update_curr <-dequeue_entity
    <...>-1252 0d..2. 31us : update_min_vruntime <-update_curr
    <...>-1252 0d..2. 31us : clear_buddies <-dequeue_entity
    <...>-1252 0d..2. 31us : update_min_vruntime <-dequeue_entity
    <...>-1252 0d..2. 31us : put_prev_task_fair <-schedule
    <...>-1252 0d..2. 31us+: check_spread <-put_prev_task_fair
    <...>-1252 0d..2. 61us : update_curr <-put_prev_task_fair
    <...>-1252 0d..2. 61us : calc_delta_mine <-update_curr
    <...>-1252 0d..2. 61us : update_min_vruntime <-update_curr
    <...>-1252 0d..2. 61us : check_spread <-put_prev_task_fair
    <...>-1252 0d..2. 61us : __enqueue_entity <-put_prev_task_fair
    <...>-1252 0d..2. 61us : pick_next_task_fair <-schedule
    <...>-1252 0d..2. 61us : __pick_next_entity <-pick_next_task_fair
    <...>-1252 0d..2. 61us : clear_buddies <-pick_next_task_fair
    <...>-1252 0d..2. 61us : set_next_entity <-pick_next_task_fair
    <...>-1252 0d..2. 61us : update_stats_wait_end <-set_next_entity
    <...>-1252 0d..2. 61us+: __dequeue_entity <-set_next_entity
    <...>-1252 0d..2. 92us : __pick_next_entity <-pick_next_task_fair
    <...>-1252 0d..2. 92us : clear_buddies <-pick_next_task_fair
    <...>-1252 0d..2. 92us : set_next_entity <-pick_next_task_fair
    <...>-1252 0d..2. 92us : update_stats_wait_end <-set_next_entity
    <...>-1252 0d..2. 92us : __dequeue_entity <-set_next_entity
    <...>-1252 0d..3. 92us : asm_do_IRQ <-__irq_svc
    <...>-1252 0d..3. 92us : irq_enter <-asm_do_IRQ
    <...>-1252 0d..3. 92us : rcu_irq_enter <-irq_enter
    <...>-1252 0d..3. 92us+: idle_cpu <-irq_enter
    <...>-1252 0d..3. 122us : add_preempt_count <-irq_enter
    <...>-1252 0d.h3. 122us : irq_to_desc <-asm_do_IRQ
    <...>-1252 0d.h3. 122us : handle_level_irq <-asm_do_IRQ
    <...>-1252 0d.h3. 122us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.h4. 122us : omap_mask_irq <-handle_level_irq
    <...>-1252 0d.h4. 122us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.h4. 122us : omap_mask_ack_irq <-handle_level_irq
    <...>-1252 0d.h4. 122us : omap_mask_irq <-omap_mask_ack_irq
    <...>-1252 0d.h4. 122us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.h4. 122us : omap_ack_irq <-omap_mask_ack_irq
    <...>-1252 0d.h4. 122us+: intc_bank_write_reg <-omap_ack_irq
    <...>-1252 0d.h4. 153us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.h3. 153us : handle_IRQ_event <-handle_level_irq
    <...>-1252 0d.h3. 153us : omap2_gp_timer_interrupt <-handle_IRQ_event
    <...>-1252 0d.h3. 153us : omap_dm_timer_write_status <-omap2_gp_timer_interrupt
    <...>-1252 0d.h3. 153us : omap_dm_timer_write_reg <-omap_dm_timer_write_status
    <...>-1252 0d.h3. 153us : hrtimer_interrupt <-omap2_gp_timer_interrupt
    <...>-1252 0d.h3. 153us+: ktime_get <-hrtimer_interrupt
    <...>-1252 0d.h3. 183us : omap34xx_32k_read <-ktime_get
    <...>-1252 0d.h3. 183us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h3. 183us : ktime_add_ns <-ktime_get
    <...>-1252 0d.h3. 183us : add_preempt_count <-hrtimer_interrupt
    <...>-1252 0d.h4. 183us : __run_hrtimer <-hrtimer_interrupt
    <...>-1252 0d.h4. 183us : __remove_hrtimer <-__run_hrtimer
    <...>-1252 0d.h4. 183us : sub_preempt_count <-__run_hrtimer
    <...>-1252 0d.h3. 183us : hrtimer_wakeup <-__run_hrtimer
    <...>-1252 0d.h3. 183us : wake_up_process <-hrtimer_wakeup
    <...>-1252 0d.h3. 183us+: try_to_wake_up <-wake_up_process
    <...>-1252 0d.h3. 214us : add_preempt_count <-try_to_wake_up
    <...>-1252 0d.h4. 214us : task_rq_lock <-try_to_wake_up
    <...>-1252 0d.h4. 214us : add_preempt_count <-task_rq_lock
    <...>-1252 0d.h5. 214us : omap34xx_32k_read <-sched_clock
    <...>-1252 0d.h5. 214us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h5. 214us : activate_task <-try_to_wake_up
    <...>-1252 0d.h5. 214us : enqueue_task <-activate_task
    <...>-1252 0d.h5. 214us : enqueue_task_fair <-enqueue_task
    <...>-1252 0d.h5. 214us+: enqueue_entity <-enqueue_task_fair
    <...>-1252 0d.h5. 244us : update_curr <-enqueue_entity
    <...>-1252 0d.h5. 244us : update_min_vruntime <-update_curr
    <...>-1252 0d.h5. 244us : place_entity <-enqueue_entity
    <...>-1252 0d.h5. 244us : check_spread <-enqueue_entity
    <...>-1252 0d.h5. 244us : __enqueue_entity <-enqueue_entity
    <...>-1252 0d.h5. 244us : check_preempt_wakeup <-try_to_wake_up
    <...>-1252 0d.h5. 244us : update_curr <-check_preempt_wakeup
    <...>-1252 0d.h5. 244us : wakeup_preempt_entity <-check_preempt_wakeup
    <...>-1252 0d.h5. 244us+: resched_task <-check_preempt_wakeup
    <...>-1252 0d.h5. 275us : sub_preempt_count <-try_to_wake_up
    <...>-1252 0d.h4. 275us : sub_preempt_count <-try_to_wake_up
    <...>-1252 0d.h3. 275us : add_preempt_count <-__run_hrtimer
    <...>-1252 0d.h4. 275us : sub_preempt_count <-hrtimer_interrupt
    <...>-1252 0d.h3. 275us : tick_program_event <-hrtimer_interrupt
    <...>-1252 0d.h3. 275us : tick_dev_program_event <-tick_program_event
    <...>-1252 0d.h3. 275us : ktime_get <-tick_dev_program_event
    <...>-1252 0d.h3. 275us : omap34xx_32k_read <-ktime_get
    <...>-1252 0d.h3. 275us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h3. 275us+: ktime_add_ns <-ktime_get
    <...>-1252 0d.h3. 305us : clockevents_program_event <-tick_dev_program_event
    <...>-1252 0d.h3. 305us : omap2_gp_timer_set_next_event <-clockevents_program_event
    <...>-1252 0d.h3. 305us : omap_dm_timer_set_load_start <-omap2_gp_timer_set_next_event
    <...>-1252 0d.h3. 305us : omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    <...>-1252 0d.h3. 305us : omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    <...>-1252 0d.h3. 305us : note_interrupt <-handle_level_irq
    <...>-1252 0d.h3. 305us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.h4. 305us : omap_unmask_irq <-handle_level_irq
    <...>-1252 0d.h4. 305us+: intc_bank_write_reg <-omap_unmask_irq
    <...>-1252 0d.h4. 336us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.h3. 336us : irq_exit <-asm_do_IRQ
    <...>-1252 0d.h3. 336us : sub_preempt_count <-irq_exit
    <...>-1252 0d..4. 336us : rcu_irq_exit <-irq_exit
    <...>-1252 0d..4. 336us : idle_cpu <-irq_exit
    <...>-1252 0d..4. 336us : sub_preempt_count <-irq_exit
    <...>-1252 0d..3. 336us : asm_do_IRQ <-__irq_svc
    <...>-1252 0d..3. 336us : irq_enter <-asm_do_IRQ
    <...>-1252 0d..3. 336us : rcu_irq_enter <-irq_enter
    <...>-1252 0d..3. 336us+: idle_cpu <-irq_enter
    <...>-1252 0d..3. 366us : add_preempt_count <-irq_enter
    <...>-1252 0d.h3. 366us : irq_to_desc <-asm_do_IRQ
    <...>-1252 0d.h3. 366us : handle_level_irq <-asm_do_IRQ
    <...>-1252 0d.h3. 366us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.h4. 366us : omap_mask_irq <-handle_level_irq
    <...>-1252 0d.h4. 366us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.h4. 366us : omap_mask_ack_irq <-handle_level_irq
    <...>-1252 0d.h4. 366us : omap_mask_irq <-omap_mask_ack_irq
    <...>-1252 0d.h4. 366us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.h4. 366us : omap_ack_irq <-omap_mask_ack_irq
    <...>-1252 0d.h4. 366us+: intc_bank_write_reg <-omap_ack_irq
    <...>-1252 0d.h4. 397us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.h3. 397us : handle_IRQ_event <-handle_level_irq
    <...>-1252 0d.h4. 397us : add_preempt_count <-serial8250_handle_port
    <...>-1252 0d.h5. 397us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 397us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 397us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 397us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 427us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 427us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 427us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 427us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 427us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 427us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 427us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 427us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 427us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 427us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 458us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 458us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 458us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 458us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 458us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 458us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 458us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 458us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 458us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 458us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 488us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 488us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 488us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 488us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 488us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 488us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 488us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 488us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 488us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 488us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 519us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 519us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 519us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 519us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 519us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 519us : sub_preempt_count <-serial8250_handle_port
    <...>-1252 0d.h4. 519us : tty_flip_buffer_push <-serial8250_handle_port
    <...>-1252 0d.h4. 519us : add_preempt_count <-tty_flip_buffer_push
    <...>-1252 0d.h5. 519us+: sub_preempt_count <-tty_flip_buffer_push
    <...>-1252 0d.h4. 549us : schedule_delayed_work <-tty_flip_buffer_push
    <...>-1252 0d.h4. 549us : queue_delayed_work <-schedule_delayed_work
    <...>-1252 0d.h4. 549us : queue_delayed_work_on <-queue_delayed_work
    <...>-1252 0d.h4. 549us : add_timer <-queue_delayed_work_on
    <...>-1252 0d.h4. 549us : mod_timer <-add_timer
    <...>-1252 0d.h4. 549us : lock_timer_base <-mod_timer
    <...>-1252 0d.h4. 549us : add_preempt_count <-lock_timer_base
    <...>-1252 0d.h5. 549us : internal_add_timer <-mod_timer
    <...>-1252 0d.h5. 549us : sub_preempt_count <-mod_timer
    <...>-1252 0d.h4. 549us+: add_preempt_count <-serial8250_handle_port
    <...>-1252 0d.h5. 580us : check_modem_status <-serial8250_handle_port
    <...>-1252 0d.h5. 580us : mem_serial_in <-check_modem_status
    <...>-1252 0d.h5. 580us : transmit_chars <-serial8250_handle_port
    <...>-1252 0d.h3. 580us : note_interrupt <-handle_level_irq
    <...>-1252 0d.h3. 580us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.h4. 580us : omap_unmask_irq <-handle_level_irq
    <...>-1252 0d.h4. 580us : intc_bank_write_reg <-omap_unmask_irq
    <...>-1252 0d.h4. 580us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.h3. 580us+: irq_exit <-asm_do_IRQ
    <...>-1252 0d.h3. 610us : sub_preempt_count <-irq_exit
    <...>-1252 0d..4. 610us : rcu_irq_exit <-irq_exit
    <...>-1252 0d..4. 610us : idle_cpu <-irq_exit
    <...>-1252 0d..4. 610us : sub_preempt_count <-irq_exit
    <...>-1252 0d..3. 610us : asm_do_IRQ <-__irq_svc
    <...>-1252 0d..3. 610us : irq_enter <-asm_do_IRQ
    <...>-1252 0d..3. 610us : rcu_irq_enter <-irq_enter
    <...>-1252 0d..3. 610us : idle_cpu <-irq_enter
    <...>-1252 0d..3. 610us : add_preempt_count <-irq_enter
    <...>-1252 0d.h3. 610us : irq_to_desc <-asm_do_IRQ
    <...>-1252 0d.h3. 610us+: handle_level_irq <-asm_do_IRQ
    <...>-1252 0d.h3. 641us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.h4. 641us : omap_mask_irq <-handle_level_irq
    <...>-1252 0d.h4. 641us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.h4. 641us : omap_mask_ack_irq <-handle_level_irq
    <...>-1252 0d.h4. 641us : omap_mask_irq <-omap_mask_ack_irq
    <...>-1252 0d.h4. 641us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.h4. 641us : omap_ack_irq <-omap_mask_ack_irq
    <...>-1252 0d.h4. 641us : intc_bank_write_reg <-omap_ack_irq
    <...>-1252 0d.h4. 641us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.h3. 641us+: handle_IRQ_event <-handle_level_irq
    <...>-1252 0d.h3. 671us : omap2_gp_timer_interrupt <-handle_IRQ_event
    <...>-1252 0d.h3. 671us : omap_dm_timer_write_status <-omap2_gp_timer_interrupt
    <...>-1252 0d.h3. 671us : omap_dm_timer_write_reg <-omap_dm_timer_write_status
    <...>-1252 0d.h3. 671us : hrtimer_interrupt <-omap2_gp_timer_interrupt
    <...>-1252 0d.h3. 671us : ktime_get <-hrtimer_interrupt
    <...>-1252 0d.h3. 671us : omap34xx_32k_read <-ktime_get
    <...>-1252 0d.h3. 671us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h3. 671us : ktime_add_ns <-ktime_get
    <...>-1252 0d.h3. 671us : add_preempt_count <-hrtimer_interrupt
    <...>-1252 0d.h4. 671us+: __run_hrtimer <-hrtimer_interrupt
    <...>-1252 0d.h4. 702us : __remove_hrtimer <-__run_hrtimer
    <...>-1252 0d.h4. 702us : sub_preempt_count <-__run_hrtimer
    <...>-1252 0d.h3. 702us : hrtimer_wakeup <-__run_hrtimer
    <...>-1252 0d.h3. 702us : wake_up_process <-hrtimer_wakeup
    <...>-1252 0d.h3. 702us : try_to_wake_up <-wake_up_process
    <...>-1252 0d.h3. 702us : add_preempt_count <-try_to_wake_up
    <...>-1252 0d.h4. 702us : task_rq_lock <-try_to_wake_up
    <...>-1252 0d.h4. 702us : add_preempt_count <-task_rq_lock
    <...>-1252 0d.h5. 702us+: omap34xx_32k_read <-sched_clock
    <...>-1252 0d.h5. 732us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h5. 732us : activate_task <-try_to_wake_up
    <...>-1252 0d.h5. 732us : enqueue_task <-activate_task
    <...>-1252 0d.h5. 732us : enqueue_task_fair <-enqueue_task
    <...>-1252 0d.h5. 732us : enqueue_entity <-enqueue_task_fair
    <...>-1252 0d.h5. 732us : update_curr <-enqueue_entity
    <...>-1252 0d.h5. 732us : update_min_vruntime <-update_curr
    <...>-1252 0d.h5. 732us : place_entity <-enqueue_entity
    <...>-1252 0d.h5. 732us+: check_spread <-enqueue_entity
    <...>-1252 0d.h5. 763us : __enqueue_entity <-enqueue_entity
    <...>-1252 0d.h5. 763us : check_preempt_wakeup <-try_to_wake_up
    <...>-1252 0d.h5. 763us : sub_preempt_count <-try_to_wake_up
    <...>-1252 0d.h4. 763us : sub_preempt_count <-try_to_wake_up
    <...>-1252 0d.h3. 763us : add_preempt_count <-__run_hrtimer
    <...>-1252 0d.h4. 763us : sub_preempt_count <-hrtimer_interrupt
    <...>-1252 0d.h3. 763us : tick_program_event <-hrtimer_interrupt
    <...>-1252 0d.h3. 763us : tick_dev_program_event <-tick_program_event
    <...>-1252 0d.h3. 763us : ktime_get <-tick_dev_program_event
    <...>-1252 0d.h3. 763us+: omap34xx_32k_read <-ktime_get
    <...>-1252 0d.h3. 793us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h3. 793us : ktime_add_ns <-ktime_get
    <...>-1252 0d.h3. 793us : clockevents_program_event <-tick_dev_program_event
    <...>-1252 0d.h3. 793us : omap2_gp_timer_set_next_event <-clockevents_program_event
    <...>-1252 0d.h3. 793us : omap_dm_timer_set_load_start <-omap2_gp_timer_set_next_event
    <...>-1252 0d.h3. 793us : omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    <...>-1252 0d.h3. 793us : omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    <...>-1252 0d.h3. 793us : note_interrupt <-handle_level_irq
    <...>-1252 0d.h3. 793us+: add_preempt_count <-handle_level_irq
    <...>-1252 0d.h4. 824us : omap_unmask_irq <-handle_level_irq
    <...>-1252 0d.h4. 824us : intc_bank_write_reg <-omap_unmask_irq
    <...>-1252 0d.h4. 824us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.h3. 824us : irq_exit <-asm_do_IRQ
    <...>-1252 0d.h3. 824us : sub_preempt_count <-irq_exit
    <...>-1252 0d..4. 824us : rcu_irq_exit <-irq_exit
    <...>-1252 0d..4. 824us : idle_cpu <-irq_exit
    <...>-1252 0d..4. 824us : sub_preempt_count <-irq_exit
    <...>-1252 0d..3. 824us : asm_do_IRQ <-__irq_svc
    <...>-1252 0d..3. 824us+: irq_enter <-asm_do_IRQ
    <...>-1252 0d..3. 854us : rcu_irq_enter <-irq_enter
    <...>-1252 0d..3. 854us : idle_cpu <-irq_enter
    <...>-1252 0d..3. 854us : add_preempt_count <-irq_enter
    <...>-1252 0d.h3. 854us : irq_to_desc <-asm_do_IRQ
    <...>-1252 0d.h3. 854us : handle_level_irq <-asm_do_IRQ
    <...>-1252 0d.h3. 854us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.h4. 854us : omap_mask_irq <-handle_level_irq
    <...>-1252 0d.h4. 854us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.h4. 854us : omap_mask_ack_irq <-handle_level_irq
    <...>-1252 0d.h4. 854us : omap_mask_irq <-omap_mask_ack_irq
    <...>-1252 0d.h4. 854us+: intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.h4. 885us : omap_ack_irq <-omap_mask_ack_irq
    <...>-1252 0d.h4. 885us : intc_bank_write_reg <-omap_ack_irq
    <...>-1252 0d.h4. 885us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.h3. 885us : handle_IRQ_event <-handle_level_irq
    <...>-1252 0d.h4. 885us : add_preempt_count <-serial8250_handle_port
    <...>-1252 0d.h5. 885us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 885us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 885us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 885us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 916us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 916us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 916us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 916us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 916us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 916us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 916us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 916us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 916us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 916us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 946us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 946us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 946us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 946us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 946us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 946us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 946us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 946us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 946us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 977us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 977us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 977us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 977us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 977us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 977us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 977us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 977us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 977us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 977us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1007us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1007us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1007us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1007us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1007us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1007us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1007us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1007us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1007us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1038us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1038us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1038us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1038us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1038us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1038us : sub_preempt_count <-serial8250_handle_port
    <...>-1252 0d.h4. 1038us : tty_flip_buffer_push <-serial8250_handle_port
    <...>-1252 0d.h4. 1038us : add_preempt_count <-tty_flip_buffer_push
    <...>-1252 0d.h5. 1038us : sub_preempt_count <-tty_flip_buffer_push
    <...>-1252 0d.h4. 1038us+: schedule_delayed_work <-tty_flip_buffer_push
    <...>-1252 0d.h4. 1068us : queue_delayed_work <-schedule_delayed_work
    <...>-1252 0d.h4. 1068us : queue_delayed_work_on <-queue_delayed_work
    <...>-1252 0d.h4. 1068us : add_preempt_count <-serial8250_handle_port
    <...>-1252 0d.h5. 1068us : check_modem_status <-serial8250_handle_port
    <...>-1252 0d.h5. 1068us : mem_serial_in <-check_modem_status
    <...>-1252 0d.h5. 1068us : transmit_chars <-serial8250_handle_port
    <...>-1252 0d.h6. 1068us : asm_do_IRQ <-__irq_svc
    <...>-1252 0d.h6. 1068us : irq_enter <-asm_do_IRQ
    <...>-1252 0d.h6. 1068us : rcu_irq_enter <-irq_enter
    <...>-1252 0d.h6. 1068us : idle_cpu <-irq_enter
    <...>-1252 0d.h6. 1068us+: add_preempt_count <-irq_enter
    <...>-1252 0d.h6. 1099us : irq_to_desc <-asm_do_IRQ
    <...>-1252 0d.h6. 1099us : handle_level_irq <-asm_do_IRQ
    <...>-1252 0d.h6. 1099us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.h7. 1099us : omap_mask_irq <-handle_level_irq
    <...>-1252 0d.h7. 1099us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.h7. 1099us : omap_mask_ack_irq <-handle_level_irq
    <...>-1252 0d.h7. 1099us : omap_mask_irq <-omap_mask_ack_irq
    <...>-1252 0d.h7. 1099us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.h7. 1099us : omap_ack_irq <-omap_mask_ack_irq
    <...>-1252 0d.h7. 1099us+: intc_bank_write_reg <-omap_ack_irq
    <...>-1252 0d.h7. 1129us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.h6. 1129us : handle_IRQ_event <-handle_level_irq
    <...>-1252 0d.h6. 1129us : omap2_gp_timer_interrupt <-handle_IRQ_event
    <...>-1252 0d.h6. 1129us : omap_dm_timer_write_status <-omap2_gp_timer_interrupt
    <...>-1252 0d.h6. 1129us : omap_dm_timer_write_reg <-omap_dm_timer_write_status
    <...>-1252 0d.h6. 1129us : hrtimer_interrupt <-omap2_gp_timer_interrupt
    <...>-1252 0d.h6. 1129us : ktime_get <-hrtimer_interrupt
    <...>-1252 0d.h6. 1129us : omap34xx_32k_read <-ktime_get
    <...>-1252 0d.h6. 1129us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h6. 1129us+: ktime_add_ns <-ktime_get
    <...>-1252 0d.h6. 1160us : add_preempt_count <-hrtimer_interrupt
    <...>-1252 0d.h7. 1160us : __run_hrtimer <-hrtimer_interrupt
    <...>-1252 0d.h7. 1160us : __remove_hrtimer <-__run_hrtimer
    <...>-1252 0d.h7. 1160us : sub_preempt_count <-__run_hrtimer
    <...>-1252 0d.h6. 1160us : tick_sched_timer <-__run_hrtimer
    <...>-1252 0d.h6. 1160us : ktime_get <-tick_sched_timer
    <...>-1252 0d.h6. 1160us : omap34xx_32k_read <-ktime_get
    <...>-1252 0d.h6. 1160us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h6. 1160us+: ktime_add_ns <-ktime_get
    <...>-1252 0d.h6. 1190us : tick_do_update_jiffies64 <-tick_sched_timer
    <...>-1252 0d.h6. 1190us : add_preempt_count <-tick_do_update_jiffies64
    <...>-1252 0d.h7. 1190us : do_timer <-tick_do_update_jiffies64
    <...>-1252 0d.h7. 1190us : update_wall_time <-do_timer
    <...>-1252 0d.h7. 1190us : omap34xx_32k_read <-update_wall_time
    <...>-1252 0d.h7. 1190us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h7. 1190us : calc_global_load <-do_timer
    <...>-1252 0d.h7. 1190us+: sub_preempt_count <-tick_do_update_jiffies64
    <...>-1252 0d.h6. 1221us : update_process_times <-tick_sched_timer
    <...>-1252 0d.h6. 1221us : account_process_tick <-update_process_times
    <...>-1252 0d.h6. 1221us : account_system_time <-account_process_tick
    <...>-1252 0d.h6. 1221us : run_local_timers <-update_process_times
    <...>-1252 0d.h6. 1221us : hrtimer_run_queues <-run_local_timers
    <...>-1252 0d.h6. 1221us : raise_softirq <-run_local_timers
    <...>-1252 0d.h6. 1221us : softlockup_tick <-run_local_timers
    <...>-1252 0d.h6. 1221us : get_timestamp <-softlockup_tick
    <...>-1252 0d.h6. 1221us+: omap34xx_32k_read <-sched_clock
    <...>-1252 0d.h6. 1251us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h6. 1251us : rcu_check_callbacks <-update_process_times
    <...>-1252 0d.h6. 1251us : __rcu_pending <-rcu_check_callbacks
    <...>-1252 0d.h6. 1251us : cpu_has_callbacks_ready_to_invoke <-__rcu_pending
    <...>-1252 0d.h6. 1251us : cpu_needs_another_gp <-__rcu_pending
    <...>-1252 0d.h6. 1251us : rcu_gp_in_progress <-__rcu_pending
    <...>-1252 0d.h6. 1251us : __rcu_pending <-rcu_check_callbacks
    <...>-1252 0d.h6. 1251us+: cpu_has_callbacks_ready_to_invoke <-__rcu_pending
    <...>-1252 0d.h6. 1282us : cpu_needs_another_gp <-__rcu_pending
    <...>-1252 0d.h6. 1282us : rcu_gp_in_progress <-__rcu_pending
    <...>-1252 0d.h6. 1282us : printk_tick <-update_process_times
    <...>-1252 0d.h6. 1282us : scheduler_tick <-update_process_times
    <...>-1252 0d.h6. 1282us : add_preempt_count <-scheduler_tick
    <...>-1252 0d.h7. 1282us : omap34xx_32k_read <-sched_clock
    <...>-1252 0d.h7. 1282us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h7. 1282us : task_tick_fair <-scheduler_tick
    <...>-1252 0d.h7. 1282us+: update_curr <-task_tick_fair
    <...>-1252 0d.h7. 1312us : update_min_vruntime <-update_curr
    <...>-1252 0d.h7. 1312us : sched_slice <-task_tick_fair
    <...>-1252 0d.h7. 1312us : calc_delta_mine <-sched_slice
    <...>-1252 0d.h7. 1312us : calc_delta_mine <-sched_slice
    <...>-1252 0d.h7. 1312us : __pick_next_entity <-task_tick_fair
    <...>-1252 0d.h7. 1312us : resched_task <-task_tick_fair
    <...>-1252 0d.h7. 1312us : update_curr <-task_tick_fair
    <...>-1252 0d.h7. 1312us : calc_delta_mine <-update_curr
    <...>-1252 0d.h7. 1312us : update_min_vruntime <-update_curr
    <...>-1252 0d.h7. 1312us+: sub_preempt_count <-scheduler_tick
    <...>-1252 0d.h6. 1343us : run_posix_cpu_timers <-update_process_times
    <...>-1252 0d.h6. 1343us : profile_tick <-tick_sched_timer
    <...>-1252 0d.h6. 1343us : hrtimer_forward <-tick_sched_timer
    <...>-1252 0d.h6. 1343us : ktime_add_safe <-hrtimer_forward
    <...>-1252 0d.h6. 1343us : ktime_add_safe <-hrtimer_forward
    <...>-1252 0d.h6. 1343us : add_preempt_count <-__run_hrtimer
    <...>-1252 0d.h7. 1343us : enqueue_hrtimer <-__run_hrtimer
    <...>-1252 0d.h7. 1343us : sub_preempt_count <-hrtimer_interrupt
    <...>-1252 0d.h6. 1343us+: tick_program_event <-hrtimer_interrupt
    <...>-1252 0d.h6. 1373us : tick_dev_program_event <-tick_program_event
    <...>-1252 0d.h6. 1373us : ktime_get <-tick_dev_program_event
    <...>-1252 0d.h6. 1373us : omap34xx_32k_read <-ktime_get
    <...>-1252 0d.h6. 1373us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.h6. 1373us : ktime_add_ns <-ktime_get
    <...>-1252 0d.h6. 1373us : clockevents_program_event <-tick_dev_program_event
    <...>-1252 0d.h6. 1373us : omap2_gp_timer_set_next_event <-clockevents_program_event
    <...>-1252 0d.h6. 1373us : omap_dm_timer_set_load_start <-omap2_gp_timer_set_next_event
    <...>-1252 0d.h6. 1373us+: omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    <...>-1252 0d.h6. 1404us : omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    <...>-1252 0d.h6. 1404us : note_interrupt <-handle_level_irq
    <...>-1252 0d.h6. 1404us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.h7. 1404us : omap_unmask_irq <-handle_level_irq
    <...>-1252 0d.h7. 1404us : intc_bank_write_reg <-omap_unmask_irq
    <...>-1252 0d.h7. 1404us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.h6. 1404us : irq_exit <-asm_do_IRQ
    <...>-1252 0d.h6. 1404us : sub_preempt_count <-irq_exit
    <...>-1252 0d.h7. 1404us : rcu_irq_exit <-irq_exit
    <...>-1252 0d.h7. 1404us+: idle_cpu <-irq_exit
    <...>-1252 0d.h7. 1434us : sub_preempt_count <-irq_exit
    <...>-1252 0d.h4. 1434us : add_preempt_count <-serial8250_handle_port
    <...>-1252 0d.h5. 1434us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1434us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1434us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1434us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1434us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1434us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1434us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1465us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1465us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1465us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1465us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1465us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1465us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1465us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1465us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1465us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1465us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1495us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1495us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1495us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1495us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1495us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1495us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1495us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1495us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1495us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1495us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1526us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1526us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1526us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1526us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1526us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1526us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1526us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1526us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1526us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1556us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1556us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1556us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1556us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1556us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1556us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1556us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1556us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1556us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1556us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1587us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1587us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1587us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1587us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1587us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.h5. 1587us : sub_preempt_count <-serial8250_handle_port
    <...>-1252 0d.h4. 1587us : tty_flip_buffer_push <-serial8250_handle_port
    <...>-1252 0d.h4. 1587us : add_preempt_count <-tty_flip_buffer_push
    <...>-1252 0d.h5. 1587us : sub_preempt_count <-tty_flip_buffer_push
    <...>-1252 0d.h4. 1587us+: schedule_delayed_work <-tty_flip_buffer_push
    <...>-1252 0d.h4. 1617us : queue_delayed_work <-schedule_delayed_work
    <...>-1252 0d.h4. 1617us : queue_delayed_work_on <-queue_delayed_work
    <...>-1252 0d.h4. 1617us : add_preempt_count <-serial8250_handle_port
    <...>-1252 0d.h5. 1617us : check_modem_status <-serial8250_handle_port
    <...>-1252 0d.h5. 1617us : mem_serial_in <-check_modem_status
    <...>-1252 0d.h5. 1617us : transmit_chars <-serial8250_handle_port
    <...>-1252 0d.h3. 1617us : note_interrupt <-handle_level_irq
    <...>-1252 0d.h3. 1617us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.h4. 1617us : omap_unmask_irq <-handle_level_irq
    <...>-1252 0d.h4. 1617us+: intc_bank_write_reg <-omap_unmask_irq
    <...>-1252 0d.h4. 1648us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.h3. 1648us : irq_exit <-asm_do_IRQ
    <...>-1252 0d.h3. 1648us : sub_preempt_count <-irq_exit
    <...>-1252 0d..4. 1648us : __do_softirq <-irq_exit
    <...>-1252 0d..4. 1648us : __local_bh_disable <-__do_softirq
    <...>-1252 0d.s5. 1648us : asm_do_IRQ <-__irq_svc
    <...>-1252 0d.s5. 1648us : irq_enter <-asm_do_IRQ
    <...>-1252 0d.s5. 1648us : rcu_irq_enter <-irq_enter
    <...>-1252 0d.s5. 1648us+: idle_cpu <-irq_enter
    <...>-1252 0d.s5. 1678us : add_preempt_count <-irq_enter
    <...>-1252 0d.H5. 1678us : irq_to_desc <-asm_do_IRQ
    <...>-1252 0d.H5. 1678us : handle_level_irq <-asm_do_IRQ
    <...>-1252 0d.H5. 1678us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.H6. 1678us : omap_mask_irq <-handle_level_irq
    <...>-1252 0d.H6. 1678us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.H6. 1678us : omap_mask_ack_irq <-handle_level_irq
    <...>-1252 0d.H6. 1678us : omap_mask_irq <-omap_mask_ack_irq
    <...>-1252 0d.H6. 1678us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.H6. 1678us : omap_ack_irq <-omap_mask_ack_irq
    <...>-1252 0d.H6. 1678us+: intc_bank_write_reg <-omap_ack_irq
    <...>-1252 0d.H6. 1709us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.H5. 1709us : handle_IRQ_event <-handle_level_irq
    <...>-1252 0d.H5. 1709us : omap2_gp_timer_interrupt <-handle_IRQ_event
    <...>-1252 0d.H5. 1709us : omap_dm_timer_write_status <-omap2_gp_timer_interrupt
    <...>-1252 0d.H5. 1709us : omap_dm_timer_write_reg <-omap_dm_timer_write_status
    <...>-1252 0d.H5. 1709us : hrtimer_interrupt <-omap2_gp_timer_interrupt
    <...>-1252 0d.H5. 1709us : ktime_get <-hrtimer_interrupt
    <...>-1252 0d.H5. 1709us : omap34xx_32k_read <-ktime_get
    <...>-1252 0d.H5. 1709us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.H5. 1709us+: ktime_add_ns <-ktime_get
    <...>-1252 0d.H5. 1740us : add_preempt_count <-hrtimer_interrupt
    <...>-1252 0d.H6. 1740us : __run_hrtimer <-hrtimer_interrupt
    <...>-1252 0d.H6. 1740us : __remove_hrtimer <-__run_hrtimer
    <...>-1252 0d.H6. 1740us : sub_preempt_count <-__run_hrtimer
    <...>-1252 0d.H5. 1740us : hrtimer_wakeup <-__run_hrtimer
    <...>-1252 0d.H5. 1740us : wake_up_process <-hrtimer_wakeup
    <...>-1252 0d.H5. 1740us : try_to_wake_up <-wake_up_process
    <...>-1252 0d.H5. 1740us : add_preempt_count <-try_to_wake_up
    <...>-1252 0d.H6. 1740us : task_rq_lock <-try_to_wake_up
    <...>-1252 0d.H6. 1740us+: add_preempt_count <-task_rq_lock
    <...>-1252 0d.H7. 1770us : omap34xx_32k_read <-sched_clock
    <...>-1252 0d.H7. 1770us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.H7. 1770us : activate_task <-try_to_wake_up
    <...>-1252 0d.H7. 1770us : enqueue_task <-activate_task
    <...>-1252 0d.H7. 1770us : enqueue_task_fair <-enqueue_task
    <...>-1252 0d.H7. 1770us : enqueue_entity <-enqueue_task_fair
    <...>-1252 0d.H7. 1770us : update_curr <-enqueue_entity
    <...>-1252 0d.H7. 1770us : update_min_vruntime <-update_curr
    <...>-1252 0d.H7. 1770us : place_entity <-enqueue_entity
    <...>-1252 0d.H7. 1770us+: check_spread <-enqueue_entity
    <...>-1252 0d.H7. 1801us : __enqueue_entity <-enqueue_entity
    <...>-1252 0d.H7. 1801us : check_preempt_wakeup <-try_to_wake_up
    <...>-1252 0d.H7. 1801us : sub_preempt_count <-try_to_wake_up
    <...>-1252 0d.H6. 1801us : sub_preempt_count <-try_to_wake_up
    <...>-1252 0d.H5. 1801us : add_preempt_count <-__run_hrtimer
    <...>-1252 0d.H6. 1801us : sub_preempt_count <-hrtimer_interrupt
    <...>-1252 0d.H5. 1801us+: tick_program_event <-hrtimer_interrupt
    <...>-1252 0d.H5. 1831us : tick_dev_program_event <-tick_program_event
    <...>-1252 0d.H5. 1831us : ktime_get <-tick_dev_program_event
    <...>-1252 0d.H5. 1831us : omap34xx_32k_read <-ktime_get
    <...>-1252 0d.H5. 1831us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.H5. 1831us : ktime_add_ns <-ktime_get
    <...>-1252 0d.H5. 1831us : clockevents_program_event <-tick_dev_program_event
    <...>-1252 0d.H5. 1831us : omap2_gp_timer_set_next_event <-clockevents_program_event
    <...>-1252 0d.H5. 1831us : omap_dm_timer_set_load_start <-omap2_gp_timer_set_next_event
    <...>-1252 0d.H5. 1831us : omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    <...>-1252 0d.H5. 1831us+: omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    <...>-1252 0d.H5. 1862us : note_interrupt <-handle_level_irq
    <...>-1252 0d.H5. 1862us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.H6. 1862us : omap_unmask_irq <-handle_level_irq
    <...>-1252 0d.H6. 1862us : intc_bank_write_reg <-omap_unmask_irq
    <...>-1252 0d.H6. 1862us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.H5. 1862us : irq_exit <-asm_do_IRQ
    <...>-1252 0d.H5. 1862us : sub_preempt_count <-irq_exit
    <...>-1252 0d.s6. 1862us : rcu_irq_exit <-irq_exit
    <...>-1252 0d.s6. 1862us : idle_cpu <-irq_exit
    <...>-1252 0d.s6. 1862us+: sub_preempt_count <-irq_exit
    <...>-1252 0d.s5. 1892us : asm_do_IRQ <-__irq_svc
    <...>-1252 0d.s5. 1892us : irq_enter <-asm_do_IRQ
    <...>-1252 0d.s5. 1892us : rcu_irq_enter <-irq_enter
    <...>-1252 0d.s5. 1892us : idle_cpu <-irq_enter
    <...>-1252 0d.s5. 1892us : add_preempt_count <-irq_enter
    <...>-1252 0d.H5. 1892us : irq_to_desc <-asm_do_IRQ
    <...>-1252 0d.H5. 1892us : handle_level_irq <-asm_do_IRQ
    <...>-1252 0d.H5. 1892us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.H6. 1892us : omap_mask_irq <-handle_level_irq
    <...>-1252 0d.H6. 1892us+: intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.H6. 1923us : omap_mask_ack_irq <-handle_level_irq
    <...>-1252 0d.H6. 1923us : omap_mask_irq <-omap_mask_ack_irq
    <...>-1252 0d.H6. 1923us : intc_bank_write_reg <-omap_mask_irq
    <...>-1252 0d.H6. 1923us : omap_ack_irq <-omap_mask_ack_irq
    <...>-1252 0d.H6. 1923us : intc_bank_write_reg <-omap_ack_irq
    <...>-1252 0d.H6. 1923us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.H5. 1923us : handle_IRQ_event <-handle_level_irq
    <...>-1252 0d.H5. 1923us : add_preempt_count <-lock_timer_base
    <...>-1252 0d.H6. 1923us+: internal_add_timer <-mod_timer
    <...>-1252 0d.H6. 1953us : add_preempt_count <-serial8250_handle_port
    <...>-1252 0d.H7. 1953us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1953us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1953us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1953us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1953us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1953us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1953us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1953us+: mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1984us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1984us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1984us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1984us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1984us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1984us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1984us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1984us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1984us : mem_serial_in <-serial8250_handle_port
    <...>-1252 0d.H7. 1984us+: sub_preempt_count <-serial8250_handle_port
    <...>-1252 0d.H6. 2014us : tty_flip_buffer_push <-serial8250_handle_port
    <...>-1252 0d.H6. 2014us : add_preempt_count <-tty_flip_buffer_push
    <...>-1252 0d.H7. 2014us : sub_preempt_count <-tty_flip_buffer_push
    <...>-1252 0d.H6. 2014us : schedule_delayed_work <-tty_flip_buffer_push
    <...>-1252 0d.H6. 2014us : queue_delayed_work <-schedule_delayed_work
    <...>-1252 0d.H6. 2014us : queue_delayed_work_on <-queue_delayed_work
    <...>-1252 0d.H6. 2014us : add_preempt_count <-serial8250_handle_port
    <...>-1252 0d.H7. 2014us : check_modem_status <-serial8250_handle_port
    <...>-1252 0d.H7. 2014us : mem_serial_in <-check_modem_status
    <...>-1252 0d.H7. 2014us+: transmit_chars <-serial8250_handle_port
    <...>-1252 0d.H5. 2045us : note_interrupt <-handle_level_irq
    <...>-1252 0d.H5. 2045us : add_preempt_count <-handle_level_irq
    <...>-1252 0d.H6. 2045us : omap_unmask_irq <-handle_level_irq
    <...>-1252 0d.H6. 2045us : intc_bank_write_reg <-omap_unmask_irq
    <...>-1252 0d.H6. 2045us : sub_preempt_count <-handle_level_irq
    <...>-1252 0d.H5. 2045us : irq_exit <-asm_do_IRQ
    <...>-1252 0d.H5. 2045us : sub_preempt_count <-irq_exit
    <...>-1252 0d.s6. 2045us : rcu_irq_exit <-irq_exit
    <...>-1252 0d.s6. 2045us : idle_cpu <-irq_exit
    <...>-1252 0d.s6. 2045us+: sub_preempt_count <-irq_exit
    <...>-1252 0d.s4. 2075us : add_preempt_count <-run_timer_softirq
    <...>-1252 0d.s4. 2075us : add_preempt_count <-__queue_work
    <...>-1252 0d.s5. 2075us : insert_work <-__queue_work
    <...>-1252 0d.s6. 2075us : add_preempt_count <-probe_workqueue_insertion
    <...>-1252 0d.s7. 2075us : sub_preempt_count <-probe_workqueue_insertion
    <...>-1252 0d.s5. 2075us : __wake_up <-insert_work
    <...>-1252 0d.s5. 2075us+: add_preempt_count <-__wake_up
    <...>-1252 0d.s6. 2106us : __wake_up_common <-__wake_up
    <...>-1252 0d.s6. 2106us : autoremove_wake_function <-__wake_up_common
    <...>-1252 0d.s6. 2106us : default_wake_function <-autoremove_wake_function
    <...>-1252 0d.s6. 2106us : try_to_wake_up <-default_wake_function
    <...>-1252 0d.s6. 2106us : add_preempt_count <-try_to_wake_up
    <...>-1252 0d.s7. 2106us : task_rq_lock <-try_to_wake_up
    <...>-1252 0d.s7. 2106us : add_preempt_count <-task_rq_lock
    <...>-1252 0d.s8. 2106us : omap34xx_32k_read <-sched_clock
    <...>-1252 0d.s8. 2106us : omap_readl <-omap34xx_32k_read
    <...>-1252 0d.s8. 2106us+: activate_task <-try_to_wake_up
    <...>-1252 0d.s8. 2136us : enqueue_task <-activate_task
    <...>-1252 0d.s8. 2136us : enqueue_task_fair <-enqueue_task
    <...>-1252 0d.s8. 2136us : enqueue_entity <-enqueue_task_fair
    <...>-1252 0d.s8. 2136us : update_curr <-enqueue_entity
    <...>-1252 0d.s8. 2136us : update_min_vruntime <-update_curr
    <...>-1252 0d.s8. 2136us : place_entity <-enqueue_entity
    <...>-1252 0d.s8. 2136us : check_spread <-enqueue_entity
    <...>-1252 0d.s8. 2136us : __enqueue_entity <-enqueue_entity
    <...>-1252 0d.s8. 2136us : check_preempt_wakeup <-try_to_wake_up
    <...>-1252 0d.s8. 2136us+: sub_preempt_count <-try_to_wake_up
    <...>-1252 0d.s7. 2167us : sub_preempt_count <-try_to_wake_up
    <...>-1252 0d.s6. 2167us : sub_preempt_count <-__wake_up
    <...>-1252 0d.s4. 2167us : add_preempt_count <-run_timer_softirq
    <...>-1252 0d.s4. 2167us : _local_bh_enable <-__do_softirq
    <...>-1252 0d.s4. 2167us : sub_preempt_count <-_local_bh_enable
    <...>-1252 0d..4. 2167us : rcu_irq_exit <-irq_exit
    <...>-1252 0d..4. 2167us : idle_cpu <-irq_exit
    <...>-1252 0d..4. 2167us+: sub_preempt_count <-irq_exit
    llrpserv-1248 0dN.1. 2197us : add_preempt_count <-schedule
    llrpserv-1248 0dN.2. 2197us : omap34xx_32k_read <-sched_clock
    llrpserv-1248 0dN.2. 2197us : omap_readl <-omap34xx_32k_read
    llrpserv-1248 0d..2. 2197us : update_avg <-schedule
    llrpserv-1248 0d..2. 2197us : put_prev_task_fair <-schedule
    llrpserv-1248 0d..2. 2197us : update_curr <-put_prev_task_fair
    llrpserv-1248 0d..2. 2197us : update_min_vruntime <-update_curr
    llrpserv-1248 0d..2. 2197us+: check_spread <-put_prev_task_fair
    llrpserv-1248 0d..2. 2228us : __enqueue_entity <-put_prev_task_fair
    llrpserv-1248 0d..2. 2228us : update_curr <-put_prev_task_fair
    llrpserv-1248 0d..2. 2228us : calc_delta_mine <-update_curr
    llrpserv-1248 0d..2. 2228us : update_min_vruntime <-update_curr
    llrpserv-1248 0d..2. 2228us : check_spread <-put_prev_task_fair
    llrpserv-1248 0d..2. 2228us : __enqueue_entity <-put_prev_task_fair
    llrpserv-1248 0d..2. 2228us : pick_next_task_rt <-schedule
    llrpserv-1248 0d..2. 2228us : pick_next_task_fair <-schedule
    llrpserv-1248 0d..2. 2228us : __pick_next_entity <-pick_next_task_fair
    llrpserv-1248 0d..2. 2228us+: clear_buddies <-pick_next_task_fair
    llrpserv-1248 0d..2. 2258us : set_next_entity <-pick_next_task_fair
    #err64k
    #noroom
    #buf_overrun



    # preemptoff latency trace v1.1.5 on 2.6.32.8
    # --------------------------------------------------------------------
    # latency: 3021 us, #966/966, CPU#0 | (Mreempt VP:0, KP:0, SP:0 HP:0)
    # -----------------
    # | task: -5 (uid:0 nice:0 policy:0 rt_prio:0)
    # -----------------
    # => started at: flush_to_ldisc
    # => ended at: flush_to_ldisc
    #
    #
    # _------=> CPU#
    # / _-----=> irqs-off
    # | / _----=> need-resched
    # || / _---=> hardirq/softirq
    # ||| / _--=> preempt-depth
    # |||| /_--=> lock-depth
    # |||||/ delay
    # cmd pid |||||| time | caller
    # \ / |||||| \ | /
    events/0-5 0...1. 0us : trace_preempt_on <-worker_thread
    events/0-5 0d..1. 0us : tty_ldisc_try
    events/0-5 0...1. 0us : tty_ldisc_try
    events/0-5 0...1. 0us : trace_preempt_on <-tty_ldisc_try
    events/0-5 0d..1. 0us : flush_to_ldisc
    events/0-5 0d..1. 0us+: schedule_delayed_work <-flush_to_ldisc
    events/0-5 0d..1. 31us : queue_delayed_work <-schedule_delayed_work
    events/0-5 0d..1. 31us : queue_delayed_work_on <-queue_delayed_work
    events/0-5 0d..1. 31us : add_timer <-queue_delayed_work_on
    events/0-5 0d..1. 31us : mod_timer <-add_timer
    events/0-5 0d..1. 31us : lock_timer_base <-mod_timer
    events/0-5 0d..1. 31us : add_preempt_count <-lock_timer_base
    events/0-5 0d..2. 31us : internal_add_timer <-mod_timer
    events/0-5 0d..2. 31us+: sub_preempt_count <-mod_timer
    events/0-5 0d..2. 61us : asm_do_IRQ <-__irq_svc
    events/0-5 0d..2. 61us : irq_enter <-asm_do_IRQ
    events/0-5 0d..2. 61us : rcu_irq_enter <-irq_enter
    events/0-5 0d..2. 61us : idle_cpu <-irq_enter
    events/0-5 0d..2. 61us : add_preempt_count <-irq_enter
    events/0-5 0d.h2. 61us : irq_to_desc <-asm_do_IRQ
    events/0-5 0d.h2. 61us : handle_level_irq <-asm_do_IRQ
    events/0-5 0d.h2. 61us : add_preempt_count <-handle_level_irq
    events/0-5 0d.h3. 61us : omap_mask_irq <-handle_level_irq
    events/0-5 0d.h3. 61us+: intc_bank_write_reg <-omap_mask_irq
    events/0-5 0d.h3. 92us : omap_mask_ack_irq <-handle_level_irq
    events/0-5 0d.h3. 92us : omap_mask_irq <-omap_mask_ack_irq
    events/0-5 0d.h3. 92us : intc_bank_write_reg <-omap_mask_irq
    events/0-5 0d.h3. 92us : omap_ack_irq <-omap_mask_ack_irq
    events/0-5 0d.h3. 92us : intc_bank_write_reg <-omap_ack_irq
    events/0-5 0d.h3. 92us : sub_preempt_count <-handle_level_irq
    events/0-5 0d.h2. 92us : handle_IRQ_event <-handle_level_irq
    events/0-5 0d.h3. 92us : add_preempt_count <-serial8250_handle_port
    events/0-5 0d.h4. 92us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 122us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 122us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 122us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 122us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 122us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 122us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 122us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 122us+: tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 153us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 153us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 153us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 153us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 153us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 153us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 153us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 153us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 153us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 153us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 183us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 183us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 183us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 183us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 183us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 183us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 183us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 183us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 183us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 183us+: add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 214us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 214us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 214us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 214us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 214us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 214us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 214us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 214us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 214us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 214us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 214us+: tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 244us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 244us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 244us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 244us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 244us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 244us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 244us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 244us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 244us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 244us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 275us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 275us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 275us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 275us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 275us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 275us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 275us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 275us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 275us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 275us+: sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 305us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 305us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 305us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 305us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 305us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 305us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 305us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 305us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 305us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 305us+: tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 336us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 336us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 336us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 336us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 336us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 336us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 336us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 336us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 336us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 336us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 366us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 366us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 366us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 366us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 366us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 366us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 366us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 366us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 366us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 366us+: sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 397us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 397us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 397us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 397us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 397us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 397us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 397us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 397us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 397us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 397us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 397us+: add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 427us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 427us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 427us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 427us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 427us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 427us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 427us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 427us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 427us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 427us+: tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 458us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 458us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 458us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 458us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 458us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 458us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 458us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 458us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 458us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 458us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 488us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 488us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 488us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 488us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 488us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 488us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 488us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 488us+: tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 519us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 519us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 519us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 519us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 519us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 519us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 519us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 519us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 519us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 519us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 549us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 549us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 549us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 549us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 549us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 549us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 549us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 549us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 549us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 549us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 549us+: sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 580us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 580us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 580us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 580us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 580us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 580us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 580us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 580us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 580us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 580us+: tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 610us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 610us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 610us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 610us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 610us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 610us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 610us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 610us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 610us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 610us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 641us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 641us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 641us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 641us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 641us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 641us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 641us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 641us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 641us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 641us+: sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 671us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 671us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 671us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 671us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 671us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 671us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 671us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 671us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 671us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 671us+: tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 702us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 702us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 702us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 702us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 702us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 702us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 702us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 702us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 702us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 702us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 732us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 732us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 732us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 732us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 732us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 732us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 732us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 732us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 732us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 732us+: sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 763us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 763us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 763us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 763us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 763us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 763us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 763us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 763us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 763us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 763us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 763us+: add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 793us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 793us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 793us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 793us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 793us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 793us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 793us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 793us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 793us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 793us+: tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 824us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 824us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 824us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 824us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 824us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 824us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 824us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 824us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 824us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 824us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 854us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 854us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 854us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 854us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 854us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 854us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 854us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 854us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 854us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 854us+: add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 885us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 885us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 885us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 885us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 885us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 885us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 885us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 885us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 885us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 885us+: tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 916us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 916us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 916us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 916us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 916us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 916us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 916us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 916us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 916us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 916us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 946us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 946us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 946us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 946us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 946us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 946us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 946us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 946us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 946us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 946us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 946us+: sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 977us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 977us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 977us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 977us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 977us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 977us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 977us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 977us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 977us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 977us+: tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1007us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1007us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1007us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1007us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1007us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1007us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1007us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1007us+: sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1038us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1038us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1038us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1038us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1038us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1038us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1038us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1038us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1038us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1038us+: tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1068us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1068us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1068us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1068us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1068us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1068us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1068us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1068us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1068us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1068us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1068us+: tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1099us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1099us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1099us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1099us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1099us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1099us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1099us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1099us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1099us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1099us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1129us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1129us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1129us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1129us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1129us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1129us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1129us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1129us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1129us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1129us+: add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1160us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1160us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1160us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1160us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1160us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1160us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1160us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1160us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1160us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1160us+: tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1190us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1190us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1190us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1190us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1190us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1190us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1190us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1190us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1190us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1190us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1221us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1221us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0d.h4. 1221us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0d.h4. 1221us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h5. 1221us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0d.h4. 1221us : mem_serial_in <-serial8250_handle_port
    events/0-5 0d.h4. 1221us : sub_preempt_count <-serial8250_handle_port
    events/0-5 0d.h3. 1221us : tty_flip_buffer_push <-serial8250_handle_port
    events/0-5 0d.h3. 1221us : add_preempt_count <-tty_flip_buffer_push
    events/0-5 0d.h4. 1221us+: sub_preempt_count <-tty_flip_buffer_push
    events/0-5 0d.h3. 1251us : schedule_delayed_work <-tty_flip_buffer_push
    events/0-5 0d.h3. 1251us : queue_delayed_work <-schedule_delayed_work
    events/0-5 0d.h3. 1251us : queue_delayed_work_on <-queue_delayed_work
    events/0-5 0d.h3. 1251us : add_preempt_count <-serial8250_handle_port
    events/0-5 0d.h4. 1251us : check_modem_status <-serial8250_handle_port
    events/0-5 0d.h4. 1251us : mem_serial_in <-check_modem_status
    events/0-5 0d.h4. 1251us : transmit_chars <-serial8250_handle_port
    events/0-5 0d.h5. 1251us : asm_do_IRQ <-__irq_svc
    events/0-5 0d.h5. 1251us : irq_enter <-asm_do_IRQ
    events/0-5 0d.h5. 1251us+: rcu_irq_enter <-irq_enter
    events/0-5 0d.h5. 1282us : idle_cpu <-irq_enter
    events/0-5 0d.h5. 1282us : add_preempt_count <-irq_enter
    events/0-5 0d.h5. 1282us : irq_to_desc <-asm_do_IRQ
    events/0-5 0d.h5. 1282us : handle_level_irq <-asm_do_IRQ
    events/0-5 0d.h5. 1282us : add_preempt_count <-handle_level_irq
    events/0-5 0d.h6. 1282us : omap_mask_irq <-handle_level_irq
    events/0-5 0d.h6. 1282us : intc_bank_write_reg <-omap_mask_irq
    events/0-5 0d.h6. 1282us : omap_mask_ack_irq <-handle_level_irq
    events/0-5 0d.h6. 1282us : omap_mask_irq <-omap_mask_ack_irq
    events/0-5 0d.h6. 1282us : intc_bank_write_reg <-omap_mask_irq
    events/0-5 0d.h6. 1282us+: omap_ack_irq <-omap_mask_ack_irq
    events/0-5 0d.h6. 1312us : intc_bank_write_reg <-omap_ack_irq
    events/0-5 0d.h6. 1312us : sub_preempt_count <-handle_level_irq
    events/0-5 0d.h5. 1312us : handle_IRQ_event <-handle_level_irq
    events/0-5 0d.h6. 1312us : asm_do_IRQ <-__irq_svc
    events/0-5 0d.h6. 1312us : irq_enter <-asm_do_IRQ
    events/0-5 0d.h6. 1312us : rcu_irq_enter <-irq_enter
    events/0-5 0d.h6. 1312us : idle_cpu <-irq_enter
    events/0-5 0d.h6. 1312us : add_preempt_count <-irq_enter
    events/0-5 0d.h6. 1312us : irq_to_desc <-asm_do_IRQ
    events/0-5 0d.h6. 1312us+: handle_level_irq <-asm_do_IRQ
    events/0-5 0d.h6. 1343us : add_preempt_count <-handle_level_irq
    events/0-5 0d.h7. 1343us : omap_mask_irq <-handle_level_irq
    events/0-5 0d.h7. 1343us : intc_bank_write_reg <-omap_mask_irq
    events/0-5 0d.h7. 1343us : omap_mask_ack_irq <-handle_level_irq
    events/0-5 0d.h7. 1343us : omap_mask_irq <-omap_mask_ack_irq
    events/0-5 0d.h7. 1343us : intc_bank_write_reg <-omap_mask_irq
    events/0-5 0d.h7. 1343us : omap_ack_irq <-omap_mask_ack_irq
    events/0-5 0d.h7. 1343us : intc_bank_write_reg <-omap_ack_irq
    events/0-5 0d.h7. 1343us : sub_preempt_count <-handle_level_irq
    events/0-5 0d.h6. 1343us+: handle_IRQ_event <-handle_level_irq
    events/0-5 0d.h6. 1373us : omap2_gp_timer_interrupt <-handle_IRQ_event
    events/0-5 0d.h6. 1373us : omap_dm_timer_write_status <-omap2_gp_timer_interrupt
    events/0-5 0d.h6. 1373us : omap_dm_timer_write_reg <-omap_dm_timer_write_status
    events/0-5 0d.h6. 1373us : hrtimer_interrupt <-omap2_gp_timer_interrupt
    events/0-5 0d.h6. 1373us : ktime_get <-hrtimer_interrupt
    events/0-5 0d.h6. 1373us : omap34xx_32k_read <-ktime_get
    events/0-5 0d.h6. 1373us : omap_readl <-omap34xx_32k_read
    events/0-5 0d.h6. 1373us : ktime_add_ns <-ktime_get
    events/0-5 0d.h6. 1373us+: add_preempt_count <-hrtimer_interrupt
    events/0-5 0d.h7. 1404us : __run_hrtimer <-hrtimer_interrupt
    events/0-5 0d.h7. 1404us : __remove_hrtimer <-__run_hrtimer
    events/0-5 0d.h7. 1404us : sub_preempt_count <-__run_hrtimer
    events/0-5 0d.h6. 1404us : hrtimer_wakeup <-__run_hrtimer
    events/0-5 0d.h6. 1404us : wake_up_process <-hrtimer_wakeup
    events/0-5 0d.h6. 1404us : try_to_wake_up <-wake_up_process
    events/0-5 0d.h6. 1404us : add_preempt_count <-try_to_wake_up
    events/0-5 0d.h7. 1404us : task_rq_lock <-try_to_wake_up
    events/0-5 0d.h7. 1404us+: add_preempt_count <-task_rq_lock
    events/0-5 0d.h8. 1434us : omap34xx_32k_read <-sched_clock
    events/0-5 0d.h8. 1434us : omap_readl <-omap34xx_32k_read
    events/0-5 0d.h8. 1434us : activate_task <-try_to_wake_up
    events/0-5 0d.h8. 1434us : enqueue_task <-activate_task
    events/0-5 0d.h8. 1434us : enqueue_task_fair <-enqueue_task
    events/0-5 0d.h8. 1434us : enqueue_entity <-enqueue_task_fair
    events/0-5 0d.h8. 1434us : update_curr <-enqueue_entity
    events/0-5 0d.h8. 1434us : update_min_vruntime <-update_curr
    events/0-5 0d.h8. 1434us+: place_entity <-enqueue_entity
    events/0-5 0d.h8. 1465us : check_spread <-enqueue_entity
    events/0-5 0d.h8. 1465us : __enqueue_entity <-enqueue_entity
    events/0-5 0d.h8. 1465us : check_preempt_wakeup <-try_to_wake_up
    events/0-5 0d.h8. 1465us : update_curr <-check_preempt_wakeup
    events/0-5 0d.h8. 1465us : wakeup_preempt_entity <-check_preempt_wakeup
    events/0-5 0d.h8. 1465us : resched_task <-check_preempt_wakeup
    events/0-5 0dNh8. 1465us : sub_preempt_count <-try_to_wake_up
    events/0-5 0dNh7. 1465us+: preempt_schedule <-try_to_wake_up
    events/0-5 0dNh7. 1495us : sub_preempt_count <-try_to_wake_up
    events/0-5 0dNh6. 1495us : preempt_schedule <-try_to_wake_up
    events/0-5 0dNh6. 1495us : add_preempt_count <-__run_hrtimer
    events/0-5 0dNh7. 1495us : __run_hrtimer <-hrtimer_interrupt
    events/0-5 0dNh7. 1495us : __remove_hrtimer <-__run_hrtimer
    events/0-5 0dNh7. 1495us : sub_preempt_count <-__run_hrtimer
    events/0-5 0dNh6. 1495us : preempt_schedule <-__run_hrtimer
    events/0-5 0dNh6. 1495us : tick_sched_timer <-__run_hrtimer
    events/0-5 0dNh6. 1495us : ktime_get <-tick_sched_timer
    events/0-5 0dNh6. 1495us+: omap34xx_32k_read <-ktime_get
    events/0-5 0dNh6. 1526us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh6. 1526us : ktime_add_ns <-ktime_get
    events/0-5 0dNh6. 1526us : tick_do_update_jiffies64 <-tick_sched_timer
    events/0-5 0dNh6. 1526us : add_preempt_count <-tick_do_update_jiffies64
    events/0-5 0dNh7. 1526us : do_timer <-tick_do_update_jiffies64
    events/0-5 0dNh7. 1526us : update_wall_time <-do_timer
    events/0-5 0dNh7. 1526us : omap34xx_32k_read <-update_wall_time
    events/0-5 0dNh7. 1526us+: omap_readl <-omap34xx_32k_read
    events/0-5 0dNh7. 1556us : calc_global_load <-do_timer
    events/0-5 0dNh7. 1556us : sub_preempt_count <-tick_do_update_jiffies64
    events/0-5 0dNh6. 1556us : preempt_schedule <-tick_do_update_jiffies64
    events/0-5 0dNh6. 1556us : update_process_times <-tick_sched_timer
    events/0-5 0dNh6. 1556us : account_process_tick <-update_process_times
    events/0-5 0dNh6. 1556us : account_system_time <-account_process_tick
    events/0-5 0dNh6. 1556us+: run_local_timers <-update_process_times
    events/0-5 0dNh6. 1587us : hrtimer_run_queues <-run_local_timers
    events/0-5 0dNh6. 1587us : raise_softirq <-run_local_timers
    events/0-5 0dNh6. 1587us : softlockup_tick <-run_local_timers
    events/0-5 0dNh6. 1587us : get_timestamp <-softlockup_tick
    events/0-5 0dNh6. 1587us : omap34xx_32k_read <-sched_clock
    events/0-5 0dNh6. 1587us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh6. 1587us : rcu_check_callbacks <-update_process_times
    events/0-5 0dNh6. 1587us : __rcu_pending <-rcu_check_callbacks
    events/0-5 0dNh6. 1587us+: cpu_has_callbacks_ready_to_invoke <-__rcu_pending
    events/0-5 0dNh6. 1617us : cpu_needs_another_gp <-__rcu_pending
    events/0-5 0dNh6. 1617us : rcu_gp_in_progress <-__rcu_pending
    events/0-5 0dNh6. 1617us : __rcu_pending <-rcu_check_callbacks
    events/0-5 0dNh6. 1617us : cpu_has_callbacks_ready_to_invoke <-__rcu_pending
    events/0-5 0dNh6. 1617us : cpu_needs_another_gp <-__rcu_pending
    events/0-5 0dNh6. 1617us : rcu_gp_in_progress <-__rcu_pending
    events/0-5 0dNh6. 1617us : printk_tick <-update_process_times
    events/0-5 0dNh6. 1617us : scheduler_tick <-update_process_times
    events/0-5 0dNh6. 1617us+: add_preempt_count <-scheduler_tick
    events/0-5 0dNh7. 1648us : omap34xx_32k_read <-sched_clock
    events/0-5 0dNh7. 1648us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh7. 1648us : task_tick_fair <-scheduler_tick
    events/0-5 0dNh7. 1648us : update_curr <-task_tick_fair
    events/0-5 0dNh7. 1648us : update_min_vruntime <-update_curr
    events/0-5 0dNh7. 1648us : sched_slice <-task_tick_fair
    events/0-5 0dNh7. 1648us : calc_delta_mine <-sched_slice
    events/0-5 0dNh7. 1648us : calc_delta_mine <-sched_slice
    events/0-5 0dNh7. 1648us : resched_task <-task_tick_fair
    events/0-5 0dNh7. 1648us+: clear_buddies <-task_tick_fair
    events/0-5 0dNh7. 1678us : update_curr <-task_tick_fair
    events/0-5 0dNh7. 1678us : calc_delta_mine <-update_curr
    events/0-5 0dNh7. 1678us : update_min_vruntime <-update_curr
    events/0-5 0dNh7. 1678us : sub_preempt_count <-scheduler_tick
    events/0-5 0dNh6. 1678us : preempt_schedule <-scheduler_tick
    events/0-5 0dNh6. 1678us : run_posix_cpu_timers <-update_process_times
    events/0-5 0dNh6. 1678us : profile_tick <-tick_sched_timer
    events/0-5 0dNh6. 1678us+: hrtimer_forward <-tick_sched_timer
    events/0-5 0dNh6. 1709us : ktime_add_safe <-hrtimer_forward
    events/0-5 0dNh6. 1709us : ktime_add_safe <-hrtimer_forward
    events/0-5 0dNh6. 1709us : add_preempt_count <-__run_hrtimer
    events/0-5 0dNh7. 1709us : enqueue_hrtimer <-__run_hrtimer
    events/0-5 0dNh7. 1709us : sub_preempt_count <-hrtimer_interrupt
    events/0-5 0dNh6. 1709us : preempt_schedule <-hrtimer_interrupt
    events/0-5 0dNh6. 1709us : tick_program_event <-hrtimer_interrupt
    events/0-5 0dNh6. 1709us : tick_dev_program_event <-tick_program_event
    events/0-5 0dNh6. 1709us : ktime_get <-tick_dev_program_event
    events/0-5 0dNh6. 1709us+: omap34xx_32k_read <-ktime_get
    events/0-5 0dNh6. 1740us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh6. 1740us : ktime_add_ns <-ktime_get
    events/0-5 0dNh6. 1740us : clockevents_program_event <-tick_dev_program_event
    events/0-5 0dNh6. 1740us : ktime_get <-hrtimer_interrupt
    events/0-5 0dNh6. 1740us : omap34xx_32k_read <-ktime_get
    events/0-5 0dNh6. 1740us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh6. 1740us : ktime_add_ns <-ktime_get
    events/0-5 0dNh6. 1740us : add_preempt_count <-hrtimer_interrupt
    events/0-5 0dNh7. 1740us+: __run_hrtimer <-hrtimer_interrupt
    events/0-5 0dNh7. 1770us : __remove_hrtimer <-__run_hrtimer
    events/0-5 0dNh7. 1770us : sub_preempt_count <-__run_hrtimer
    events/0-5 0dNh6. 1770us : preempt_schedule <-__run_hrtimer
    events/0-5 0dNh6. 1770us : hrtimer_wakeup <-__run_hrtimer
    events/0-5 0dNh6. 1770us : wake_up_process <-hrtimer_wakeup
    events/0-5 0dNh6. 1770us : try_to_wake_up <-wake_up_process
    events/0-5 0dNh6. 1770us : add_preempt_count <-try_to_wake_up
    events/0-5 0dNh7. 1770us : task_rq_lock <-try_to_wake_up
    events/0-5 0dNh7. 1770us : add_preempt_count <-task_rq_lock
    events/0-5 0dNh8. 1770us : omap34xx_32k_read <-sched_clock
    events/0-5 0dNh8. 1770us+: omap_readl <-omap34xx_32k_read
    events/0-5 0dNh8. 1801us : activate_task <-try_to_wake_up
    events/0-5 0dNh8. 1801us : enqueue_task <-activate_task
    events/0-5 0dNh8. 1801us : enqueue_task_fair <-enqueue_task
    events/0-5 0dNh8. 1801us : enqueue_entity <-enqueue_task_fair
    events/0-5 0dNh8. 1801us : update_curr <-enqueue_entity
    events/0-5 0dNh8. 1801us : update_min_vruntime <-update_curr
    events/0-5 0dNh8. 1801us : place_entity <-enqueue_entity
    events/0-5 0dNh8. 1801us : check_spread <-enqueue_entity
    events/0-5 0dNh8. 1801us+: __enqueue_entity <-enqueue_entity
    events/0-5 0dNh8. 1831us : check_preempt_wakeup <-try_to_wake_up
    events/0-5 0dNh8. 1831us : sub_preempt_count <-try_to_wake_up
    events/0-5 0dNh7. 1831us : preempt_schedule <-try_to_wake_up
    events/0-5 0dNh7. 1831us : sub_preempt_count <-try_to_wake_up
    events/0-5 0dNh6. 1831us : preempt_schedule <-try_to_wake_up
    events/0-5 0dNh6. 1831us : add_preempt_count <-__run_hrtimer
    events/0-5 0dNh7. 1831us : sub_preempt_count <-hrtimer_interrupt
    events/0-5 0dNh6. 1831us : preempt_schedule <-hrtimer_interrupt
    events/0-5 0dNh6. 1831us : tick_program_event <-hrtimer_interrupt
    events/0-5 0dNh6. 1831us : tick_dev_program_event <-tick_program_event
    events/0-5 0dNh6. 1831us+: ktime_get <-tick_dev_program_event
    events/0-5 0dNh6. 1862us : omap34xx_32k_read <-ktime_get
    events/0-5 0dNh6. 1862us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh6. 1862us : ktime_add_ns <-ktime_get
    events/0-5 0dNh6. 1862us : clockevents_program_event <-tick_dev_program_event
    events/0-5 0dNh6. 1862us : ktime_get <-hrtimer_interrupt
    events/0-5 0dNh6. 1862us : omap34xx_32k_read <-ktime_get
    events/0-5 0dNh6. 1862us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh6. 1862us : ktime_add_ns <-ktime_get
    events/0-5 0dNh6. 1862us : add_preempt_count <-hrtimer_interrupt
    events/0-5 0dNh7. 1862us+: __run_hrtimer <-hrtimer_interrupt
    events/0-5 0dNh7. 1892us : __remove_hrtimer <-__run_hrtimer
    events/0-5 0dNh7. 1892us : sub_preempt_count <-__run_hrtimer
    events/0-5 0dNh6. 1892us : preempt_schedule <-__run_hrtimer
    events/0-5 0dNh6. 1892us : hrtimer_wakeup <-__run_hrtimer
    events/0-5 0dNh6. 1892us : wake_up_process <-hrtimer_wakeup
    events/0-5 0dNh6. 1892us : try_to_wake_up <-wake_up_process
    events/0-5 0dNh6. 1892us : add_preempt_count <-try_to_wake_up
    events/0-5 0dNh7. 1892us : task_rq_lock <-try_to_wake_up
    events/0-5 0dNh7. 1892us : add_preempt_count <-task_rq_lock
    events/0-5 0dNh8. 1892us : omap34xx_32k_read <-sched_clock
    events/0-5 0dNh8. 1892us+: omap_readl <-omap34xx_32k_read
    events/0-5 0dNh8. 1923us : activate_task <-try_to_wake_up
    events/0-5 0dNh8. 1923us : enqueue_task <-activate_task
    events/0-5 0dNh8. 1923us : enqueue_task_fair <-enqueue_task
    events/0-5 0dNh8. 1923us : enqueue_entity <-enqueue_task_fair
    events/0-5 0dNh8. 1923us : update_curr <-enqueue_entity
    events/0-5 0dNh8. 1923us : update_min_vruntime <-update_curr
    events/0-5 0dNh8. 1923us : place_entity <-enqueue_entity
    events/0-5 0dNh8. 1923us : check_spread <-enqueue_entity
    events/0-5 0dNh8. 1923us+: __enqueue_entity <-enqueue_entity
    events/0-5 0dNh8. 1953us : check_preempt_wakeup <-try_to_wake_up
    events/0-5 0dNh8. 1953us : sub_preempt_count <-try_to_wake_up
    events/0-5 0dNh7. 1953us : preempt_schedule <-try_to_wake_up
    events/0-5 0dNh7. 1953us : sub_preempt_count <-try_to_wake_up
    events/0-5 0dNh6. 1953us : preempt_schedule <-try_to_wake_up
    events/0-5 0dNh6. 1953us : add_preempt_count <-__run_hrtimer
    events/0-5 0dNh7. 1953us : sub_preempt_count <-hrtimer_interrupt
    events/0-5 0dNh6. 1953us : preempt_schedule <-hrtimer_interrupt
    events/0-5 0dNh6. 1953us : tick_program_event <-hrtimer_interrupt
    events/0-5 0dNh6. 1953us : tick_dev_program_event <-tick_program_event
    events/0-5 0dNh6. 1953us+: ktime_get <-tick_dev_program_event
    events/0-5 0dNh6. 1984us : omap34xx_32k_read <-ktime_get
    events/0-5 0dNh6. 1984us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh6. 1984us : ktime_add_ns <-ktime_get
    events/0-5 0dNh6. 1984us : clockevents_program_event <-tick_dev_program_event
    events/0-5 0dNh6. 1984us : omap2_gp_timer_set_next_event <-clockevents_program_event
    events/0-5 0dNh6. 1984us : omap_dm_timer_set_load_start <-omap2_gp_timer_set_next_event
    events/0-5 0dNh6. 1984us : omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    events/0-5 0dNh6. 1984us+: omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    events/0-5 0dNh6. 2014us : note_interrupt <-handle_level_irq
    events/0-5 0dNh6. 2014us : add_preempt_count <-handle_level_irq
    events/0-5 0dNh7. 2014us : omap_unmask_irq <-handle_level_irq
    events/0-5 0dNh7. 2014us : intc_bank_write_reg <-omap_unmask_irq
    events/0-5 0dNh7. 2014us : sub_preempt_count <-handle_level_irq
    events/0-5 0dNh6. 2014us : preempt_schedule <-handle_level_irq
    events/0-5 0dNh6. 2014us : irq_exit <-asm_do_IRQ
    events/0-5 0dNh6. 2014us : sub_preempt_count <-irq_exit
    events/0-5 0dNh7. 2014us : rcu_irq_exit <-irq_exit
    events/0-5 0dNh7. 2014us : idle_cpu <-irq_exit
    events/0-5 0dNh7. 2014us+: sub_preempt_count <-irq_exit
    events/0-5 0dNh5. 2045us : add_preempt_count <-lock_timer_base
    events/0-5 0dNh6. 2045us : internal_add_timer <-mod_timer
    events/0-5 0dNh6. 2045us : add_preempt_count <-serial8250_handle_port
    events/0-5 0dNh7. 2045us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh7. 2045us : check_modem_status <-serial8250_handle_port
    events/0-5 0dNh7. 2045us : mem_serial_in <-check_modem_status
    events/0-5 0dNh7. 2045us+: transmit_chars <-serial8250_handle_port
    events/0-5 0dNh7. 2075us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2075us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2075us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2075us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2075us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2075us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2075us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2075us : mem_serial_out <-transmit_chars
    events/0-5 0dNh5. 2075us : note_interrupt <-handle_level_irq
    events/0-5 0dNh5. 2075us+: add_preempt_count <-handle_level_irq
    events/0-5 0dNh6. 2106us : omap_unmask_irq <-handle_level_irq
    events/0-5 0dNh6. 2106us : intc_bank_write_reg <-omap_unmask_irq
    events/0-5 0dNh6. 2106us : sub_preempt_count <-handle_level_irq
    events/0-5 0dNh5. 2106us : preempt_schedule <-handle_level_irq
    events/0-5 0dNh5. 2106us : irq_exit <-asm_do_IRQ
    events/0-5 0dNh5. 2106us : sub_preempt_count <-irq_exit
    events/0-5 0dNh6. 2106us : rcu_irq_exit <-irq_exit
    events/0-5 0dNh6. 2106us : idle_cpu <-irq_exit
    events/0-5 0dNh6. 2106us+: sub_preempt_count <-irq_exit
    events/0-5 0dNh3. 2136us : add_preempt_count <-serial8250_handle_port
    events/0-5 0dNh4. 2136us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2136us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2136us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2136us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2136us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2136us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2136us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2136us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2167us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2167us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2167us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2167us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2167us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2167us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2167us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2167us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2167us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2167us+: tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2197us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2197us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2197us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2197us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2197us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2197us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2197us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2197us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2197us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2197us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2197us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2228us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2228us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2228us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2228us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2228us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2228us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2228us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2228us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2228us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2228us+: tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2258us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2258us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2258us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2258us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2258us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2258us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2258us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2258us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2258us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2258us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2258us+: mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2289us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2289us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2289us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2289us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2289us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2289us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2289us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2289us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2289us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2289us+: tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2319us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2319us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2319us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2319us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2319us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2319us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2319us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2319us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2319us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2319us+: preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2350us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2350us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2350us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2350us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2350us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2350us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2350us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2350us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2350us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2350us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2350us+: tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2380us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2380us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2380us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2380us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2380us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2380us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2380us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2380us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2380us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2380us+: preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2411us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2411us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2411us : tty_insert_flip_string_flags <-serial8250_handle_port
    events/0-5 0dNh4. 2411us : tty_buffer_request_room <-tty_insert_flip_string_flags
    events/0-5 0dNh4. 2411us : add_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh5. 2411us : sub_preempt_count <-tty_buffer_request_room
    events/0-5 0dNh4. 2411us : preempt_schedule <-tty_buffer_request_room
    events/0-5 0dNh4. 2411us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh4. 2411us : sub_preempt_count <-serial8250_handle_port
    events/0-5 0dNh3. 2411us : preempt_schedule <-serial8250_handle_port
    events/0-5 0dNh3. 2411us+: tty_flip_buffer_push <-serial8250_handle_port
    events/0-5 0dNh3. 2441us : add_preempt_count <-tty_flip_buffer_push
    events/0-5 0dNh4. 2441us : sub_preempt_count <-tty_flip_buffer_push
    events/0-5 0dNh3. 2441us : preempt_schedule <-tty_flip_buffer_push
    events/0-5 0dNh3. 2441us : schedule_delayed_work <-tty_flip_buffer_push
    events/0-5 0dNh3. 2441us : queue_delayed_work <-schedule_delayed_work
    events/0-5 0dNh3. 2441us : queue_delayed_work_on <-queue_delayed_work
    events/0-5 0dNh3. 2441us : add_preempt_count <-serial8250_handle_port
    events/0-5 0dNh4. 2441us : check_modem_status <-serial8250_handle_port
    events/0-5 0dNh4. 2441us : mem_serial_in <-check_modem_status
    events/0-5 0dNh4. 2441us+: transmit_chars <-serial8250_handle_port
    events/0-5 0dNh5. 2472us : asm_do_IRQ <-__irq_svc
    events/0-5 0dNh5. 2472us : irq_enter <-asm_do_IRQ
    events/0-5 0dNh5. 2472us : rcu_irq_enter <-irq_enter
    events/0-5 0dNh5. 2472us : idle_cpu <-irq_enter
    events/0-5 0dNh5. 2472us : add_preempt_count <-irq_enter
    events/0-5 0dNh5. 2472us : irq_to_desc <-asm_do_IRQ
    events/0-5 0dNh5. 2472us : handle_level_irq <-asm_do_IRQ
    events/0-5 0dNh5. 2472us : add_preempt_count <-handle_level_irq
    events/0-5 0dNh6. 2472us : omap_mask_irq <-handle_level_irq
    events/0-5 0dNh6. 2472us : intc_bank_write_reg <-omap_mask_irq
    events/0-5 0dNh6. 2472us+: omap_mask_ack_irq <-handle_level_irq
    events/0-5 0dNh6. 2502us : omap_mask_irq <-omap_mask_ack_irq
    events/0-5 0dNh6. 2502us : intc_bank_write_reg <-omap_mask_irq
    events/0-5 0dNh6. 2502us : omap_ack_irq <-omap_mask_ack_irq
    events/0-5 0dNh6. 2502us : intc_bank_write_reg <-omap_ack_irq
    events/0-5 0dNh6. 2502us : sub_preempt_count <-handle_level_irq
    events/0-5 0dNh5. 2502us : preempt_schedule <-handle_level_irq
    events/0-5 0dNh5. 2502us : handle_IRQ_event <-handle_level_irq
    events/0-5 0dNh5. 2502us : omap2_gp_timer_interrupt <-handle_IRQ_event
    events/0-5 0dNh5. 2502us : omap_dm_timer_write_status <-omap2_gp_timer_interrupt
    events/0-5 0dNh5. 2502us : omap_dm_timer_write_reg <-omap_dm_timer_write_status
    events/0-5 0dNh5. 2502us+: hrtimer_interrupt <-omap2_gp_timer_interrupt
    events/0-5 0dNh5. 2533us : ktime_get <-hrtimer_interrupt
    events/0-5 0dNh5. 2533us : omap34xx_32k_read <-ktime_get
    events/0-5 0dNh5. 2533us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh5. 2533us : ktime_add_ns <-ktime_get
    events/0-5 0dNh5. 2533us : add_preempt_count <-hrtimer_interrupt
    events/0-5 0dNh6. 2533us : __run_hrtimer <-hrtimer_interrupt
    events/0-5 0dNh6. 2533us : __remove_hrtimer <-__run_hrtimer
    events/0-5 0dNh6. 2533us : sub_preempt_count <-__run_hrtimer
    events/0-5 0dNh5. 2533us : preempt_schedule <-__run_hrtimer
    events/0-5 0dNh5. 2533us+: hrtimer_wakeup <-__run_hrtimer
    events/0-5 0dNh5. 2563us : wake_up_process <-hrtimer_wakeup
    events/0-5 0dNh5. 2563us : try_to_wake_up <-wake_up_process
    events/0-5 0dNh5. 2563us : add_preempt_count <-try_to_wake_up
    events/0-5 0dNh6. 2563us : task_rq_lock <-try_to_wake_up
    events/0-5 0dNh6. 2563us : add_preempt_count <-task_rq_lock
    events/0-5 0dNh7. 2563us : omap34xx_32k_read <-sched_clock
    events/0-5 0dNh7. 2563us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh7. 2563us : activate_task <-try_to_wake_up
    events/0-5 0dNh7. 2563us : enqueue_task <-activate_task
    events/0-5 0dNh7. 2563us+: enqueue_task_fair <-enqueue_task
    events/0-5 0dNh7. 2594us : enqueue_entity <-enqueue_task_fair
    events/0-5 0dNh7. 2594us : update_curr <-enqueue_entity
    events/0-5 0dNh7. 2594us : update_min_vruntime <-update_curr
    events/0-5 0dNh7. 2594us : place_entity <-enqueue_entity
    events/0-5 0dNh7. 2594us : check_spread <-enqueue_entity
    events/0-5 0dNh7. 2594us : __enqueue_entity <-enqueue_entity
    events/0-5 0dNh7. 2594us : check_preempt_wakeup <-try_to_wake_up
    events/0-5 0dNh7. 2594us+: sub_preempt_count <-try_to_wake_up
    events/0-5 0dNh6. 2625us : preempt_schedule <-try_to_wake_up
    events/0-5 0dNh6. 2625us : sub_preempt_count <-try_to_wake_up
    events/0-5 0dNh5. 2625us : preempt_schedule <-try_to_wake_up
    events/0-5 0dNh5. 2625us : add_preempt_count <-__run_hrtimer
    events/0-5 0dNh6. 2625us : __run_hrtimer <-hrtimer_interrupt
    events/0-5 0dNh6. 2625us : __remove_hrtimer <-__run_hrtimer
    events/0-5 0dNh6. 2625us : sub_preempt_count <-__run_hrtimer
    events/0-5 0dNh5. 2625us : preempt_schedule <-__run_hrtimer
    events/0-5 0dNh5. 2625us : hrtimer_wakeup <-__run_hrtimer
    events/0-5 0dNh5. 2625us+: wake_up_process <-hrtimer_wakeup
    events/0-5 0dNh5. 2655us : try_to_wake_up <-wake_up_process
    events/0-5 0dNh5. 2655us : add_preempt_count <-try_to_wake_up
    events/0-5 0dNh6. 2655us : task_rq_lock <-try_to_wake_up
    events/0-5 0dNh6. 2655us : add_preempt_count <-task_rq_lock
    events/0-5 0dNh7. 2655us : omap34xx_32k_read <-sched_clock
    events/0-5 0dNh7. 2655us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh7. 2655us : activate_task <-try_to_wake_up
    events/0-5 0dNh7. 2655us : enqueue_task <-activate_task
    events/0-5 0dNh7. 2655us : enqueue_task_fair <-enqueue_task
    events/0-5 0dNh7. 2655us+: enqueue_entity <-enqueue_task_fair
    events/0-5 0dNh7. 2686us : update_curr <-enqueue_entity
    events/0-5 0dNh7. 2686us : update_min_vruntime <-update_curr
    events/0-5 0dNh7. 2686us : place_entity <-enqueue_entity
    events/0-5 0dNh7. 2686us : check_spread <-enqueue_entity
    events/0-5 0dNh7. 2686us : __enqueue_entity <-enqueue_entity
    events/0-5 0dNh7. 2686us : check_preempt_wakeup <-try_to_wake_up
    events/0-5 0dNh7. 2686us : sub_preempt_count <-try_to_wake_up
    events/0-5 0dNh6. 2686us : preempt_schedule <-try_to_wake_up
    events/0-5 0dNh6. 2686us : sub_preempt_count <-try_to_wake_up
    events/0-5 0dNh5. 2686us+: preempt_schedule <-try_to_wake_up
    events/0-5 0dNh5. 2716us : add_preempt_count <-__run_hrtimer
    events/0-5 0dNh6. 2716us : sub_preempt_count <-hrtimer_interrupt
    events/0-5 0dNh5. 2716us : preempt_schedule <-hrtimer_interrupt
    events/0-5 0dNh5. 2716us : tick_program_event <-hrtimer_interrupt
    events/0-5 0dNh5. 2716us : tick_dev_program_event <-tick_program_event
    events/0-5 0dNh5. 2716us : ktime_get <-tick_dev_program_event
    events/0-5 0dNh5. 2716us : omap34xx_32k_read <-ktime_get
    events/0-5 0dNh5. 2716us : omap_readl <-omap34xx_32k_read
    events/0-5 0dNh5. 2716us : ktime_add_ns <-ktime_get
    events/0-5 0dNh5. 2716us : clockevents_program_event <-tick_dev_program_event
    events/0-5 0dNh5. 2716us+: omap2_gp_timer_set_next_event <-clockevents_program_event
    events/0-5 0dNh5. 2747us : omap_dm_timer_set_load_start <-omap2_gp_timer_set_next_event
    events/0-5 0dNh5. 2747us : omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    events/0-5 0dNh5. 2747us : omap_dm_timer_write_reg <-omap_dm_timer_set_load_start
    events/0-5 0dNh5. 2747us : note_interrupt <-handle_level_irq
    events/0-5 0dNh5. 2747us : add_preempt_count <-handle_level_irq
    events/0-5 0dNh6. 2747us : omap_unmask_irq <-handle_level_irq
    events/0-5 0dNh6. 2747us : intc_bank_write_reg <-omap_unmask_irq
    events/0-5 0dNh6. 2747us : sub_preempt_count <-handle_level_irq
    events/0-5 0dNh5. 2747us+: preempt_schedule <-handle_level_irq
    events/0-5 0dNh5. 2777us : irq_exit <-asm_do_IRQ
    events/0-5 0dNh5. 2777us : sub_preempt_count <-irq_exit
    events/0-5 0dNh6. 2777us : rcu_irq_exit <-irq_exit
    events/0-5 0dNh6. 2777us : idle_cpu <-irq_exit
    events/0-5 0dNh6. 2777us : sub_preempt_count <-irq_exit
    events/0-5 0dNh5. 2777us : asm_do_IRQ <-__irq_svc
    events/0-5 0dNh5. 2777us : irq_enter <-asm_do_IRQ
    events/0-5 0dNh5. 2777us : rcu_irq_enter <-irq_enter
    events/0-5 0dNh5. 2777us : idle_cpu <-irq_enter
    events/0-5 0dNh5. 2777us : add_preempt_count <-irq_enter
    events/0-5 0dNh5. 2777us+: irq_to_desc <-asm_do_IRQ
    events/0-5 0dNh5. 2808us : handle_level_irq <-asm_do_IRQ
    events/0-5 0dNh5. 2808us : add_preempt_count <-handle_level_irq
    events/0-5 0dNh6. 2808us : omap_mask_irq <-handle_level_irq
    events/0-5 0dNh6. 2808us : intc_bank_write_reg <-omap_mask_irq
    events/0-5 0dNh6. 2808us : omap_mask_ack_irq <-handle_level_irq
    events/0-5 0dNh6. 2808us : omap_mask_irq <-omap_mask_ack_irq
    events/0-5 0dNh6. 2808us : intc_bank_write_reg <-omap_mask_irq
    events/0-5 0dNh6. 2808us : omap_ack_irq <-omap_mask_ack_irq
    events/0-5 0dNh6. 2808us : intc_bank_write_reg <-omap_ack_irq
    events/0-5 0dNh6. 2808us : sub_preempt_count <-handle_level_irq
    events/0-5 0dNh5. 2808us+: preempt_schedule <-handle_level_irq
    events/0-5 0dNh5. 2838us : handle_IRQ_event <-handle_level_irq
    events/0-5 0dNh6. 2838us : add_preempt_count <-serial8250_handle_port
    events/0-5 0dNh7. 2838us : mem_serial_in <-serial8250_handle_port
    events/0-5 0dNh7. 2838us : check_modem_status <-serial8250_handle_port
    events/0-5 0dNh7. 2838us : mem_serial_in <-check_modem_status
    events/0-5 0dNh7. 2838us : transmit_chars <-serial8250_handle_port
    events/0-5 0dNh7. 2838us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2838us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2838us+: mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2869us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2869us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2869us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2869us : mem_serial_out <-transmit_chars
    events/0-5 0dNh7. 2869us : mem_serial_out <-transmit_chars
    events/0-5 0dNh5. 2869us : note_interrupt <-handle_level_irq
    events/0-5 0dNh5. 2869us : add_preempt_count <-handle_level_irq
    events/0-5 0dNh6. 2869us : omap_unmask_irq <-handle_level_irq
    events/0-5 0dNh6. 2869us : intc_bank_write_reg <-omap_unmask_irq
    events/0-5 0dNh6. 2869us+: sub_preempt_count <-handle_level_irq
    events/0-5 0dNh5. 2899us : preempt_schedule <-handle_level_irq
    events/0-5 0dNh5. 2899us : irq_exit <-asm_do_IRQ
    events/0-5 0dNh5. 2899us : sub_preempt_count <-irq_exit
    events/0-5 0dNh6. 2899us : rcu_irq_exit <-irq_exit
    events/0-5 0dNh6. 2899us : idle_cpu <-irq_exit
    events/0-5 0dNh6. 2899us : sub_preempt_count <-irq_exit
    events/0-5 0dNh2. 2899us : note_interrupt <-handle_level_irq
    events/0-5 0dNh2. 2899us : add_preempt_count <-handle_level_irq
    events/0-5 0dNh3. 2899us : omap_unmask_irq <-handle_level_irq
    events/0-5 0dNh3. 2899us+: intc_bank_write_reg <-omap_unmask_irq
    events/0-5 0dNh3. 2930us : sub_preempt_count <-handle_level_irq
    events/0-5 0dNh2. 2930us : preempt_schedule <-handle_level_irq
    events/0-5 0dNh2. 2930us : irq_exit <-asm_do_IRQ
    events/0-5 0dNh2. 2930us : sub_preempt_count <-irq_exit
    events/0-5 0dN.3. 2930us : __do_softirq <-irq_exit
    events/0-5 0dN.3. 2930us : __local_bh_disable <-__do_softirq
    events/0-5 0dNs3. 2930us+: add_preempt_count <-run_timer_softirq
    events/0-5 0dNs3. 2960us : add_preempt_count <-__queue_work
    events/0-5 0dNs4. 2960us : insert_work <-__queue_work
    events/0-5 0dNs5. 2960us : add_preempt_count <-probe_workqueue_insertion
    events/0-5 0dNs6. 2960us : sub_preempt_count <-probe_workqueue_insertion
    events/0-5 0dNs5. 2960us : preempt_schedule <-probe_workqueue_insertion
    events/0-5 0dNs4. 2960us : preempt_schedule <-insert_work
    events/0-5 0dNs4. 2960us : __wake_up <-insert_work
    events/0-5 0dNs4. 2960us : add_preempt_count <-__wake_up
    events/0-5 0dNs5. 2960us+: __wake_up_common <-__wake_up
    events/0-5 0dNs5. 2991us : sub_preempt_count <-__wake_up
    events/0-5 0dNs4. 2991us : preempt_schedule <-__wake_up
    events/0-5 0dNs3. 2991us : add_preempt_count <-run_timer_softirq
    events/0-5 0dNs3. 2991us : _local_bh_enable <-__do_softirq
    events/0-5 0dNs3. 2991us : sub_preempt_count <-_local_bh_enable
    events/0-5 0dN.3. 2991us : rcu_irq_exit <-irq_exit
    events/0-5 0dN.3. 2991us : idle_cpu <-irq_exit
    events/0-5 0dN.3. 2991us : sub_preempt_count <-irq_exit
    events/0-5 0.N.1. 2991us+: flush_to_ldisc
    events/0-5 0.N.1. 3021us : trace_preempt_on <-flush_to_ldisc

  2. #2
    Linux Guru Rubberman's Avatar
    Join Date
    Apr 2009
    Location
    I can be found either 40 miles west of Chicago, in Chicago, or in a galaxy far, far away.
    Posts
    11,556
    What are you using for flow control? Hardware (CTS/RTS, DTR/DSR), or software (XON/XOFF), or none? If hardware, then are you sure the signals are being asserted properly, and recognized by the other end? What about cables? What is the length of your cables? Are you using twisted-pair? If software, then at your data rates that could indeed be a problem.
    Sometimes, real fast is almost as good as real time.
    Just remember, Semper Gumbi - always be flexible!

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •