···25252626- A CPU looping with bottom halves disabled.27272828-- For !CONFIG_PREEMPTION kernels, a CPU looping anywhere in the kernel2929- without invoking schedule(). If the looping in the kernel is3030- really expected and desirable behavior, you might need to add3131- some calls to cond_resched().2828+- For !CONFIG_PREEMPTION kernels, a CPU looping anywhere in the2929+ kernel without potentially invoking schedule(). If the looping3030+ in the kernel is really expected and desirable behavior, you3131+ might need to add some calls to cond_resched().32323333- Booting Linux using a console connection that is too slow to3434 keep up with the boot-time console-message rate. For example,···108108109109- A bug in the RCU implementation.110110111111-- A hardware failure. This is quite unlikely, but has occurred112112- at least once in real life. A CPU failed in a running system,113113- becoming unresponsive, but not causing an immediate crash.114114- This resulted in a series of RCU CPU stall warnings, eventually115115- leading the realization that the CPU had failed.111111+- A hardware failure. This is quite unlikely, but is not at all112112+ uncommon in large datacenter. In one memorable case some decades113113+ back, a CPU failed in a running system, becoming unresponsive,114114+ but not causing an immediate crash. This resulted in a series115115+ of RCU CPU stall warnings, eventually leading the realization116116+ that the CPU had failed.116117117117-The RCU, RCU-sched, and RCU-tasks implementations have CPU stall warning.118118-Note that SRCU does *not* have CPU stall warnings. Please note that119119-RCU only detects CPU stalls when there is a grace period in progress.120120-No grace period, no CPU stall warnings.118118+The RCU, RCU-sched, RCU-tasks, and RCU-tasks-trace implementations have119119+CPU stall warning. Note that SRCU does *not* have CPU stall warnings.120120+Please note that RCU only detects CPU stalls when there is a grace period121121+in progress. No grace period, no CPU stall warnings.121122122123To diagnose the cause of the stall, inspect the stack traces.123124The offending function will usually be near the top of the stack.···206205rcupdate.rcu_task_stall_timeout207206-------------------------------208207209209- This boot/sysfs parameter controls the RCU-tasks stall warning210210- interval. A value of zero or less suppresses RCU-tasks stall211211- warnings. A positive value sets the stall-warning interval212212- in seconds. An RCU-tasks stall warning starts with the line:208208+ This boot/sysfs parameter controls the RCU-tasks and209209+ RCU-tasks-trace stall warning intervals. A value of zero or less210210+ suppresses RCU-tasks stall warnings. A positive value sets the211211+ stall-warning interval in seconds. An RCU-tasks stall warning212212+ starts with the line:213213214214 INFO: rcu_tasks detected stalls on tasks:215215216216 And continues with the output of sched_show_task() for each217217 task stalling the current RCU-tasks grace period.218218+219219+ An RCU-tasks-trace stall warning starts (and continues) similarly:220220+221221+ INFO: rcu_tasks_trace detected stalls on tasks218222219223220224Interpreting RCU's CPU Stall-Detector "Splats"···254248is in dyntick-idle mode and an odd-numbered value otherwise. The hex255249number between the two "/"s is the value of the nesting, which will be256250a small non-negative number if in the idle loop (as shown above) and a257257-very large positive number otherwise.251251+very large positive number otherwise. The number following the final252252+"/" is the NMI nesting, which will be a small non-negative number.258253259254The "softirq=" portion of the message tracks the number of RCU softirq260255handlers that the stalled CPU has executed. The number before the "/"