UbiquitousOS
/
OpenCloudOS-Kernel
mirror of https://gitee.com/OpenCloudOS/OpenCloudOS-Kernel.git
11
0
Fork 0
Code Issues Projects Releases Wiki Activity

powerpc/rtas: use device model APIs and serialization during LPM 

The LPAR migration implementation and userspace-initiated cpu hotplug
can interleave their executions like so:

1. Set cpu 7 offline via sysfs.

2. Begin a partition migration, whose implementation requires the OS
   to ensure all present cpus are online; cpu 7 is onlined:

     rtas_ibm_suspend_me -> rtas_online_cpus_mask -> cpu_up

   This sets cpu 7 online in all respects except for the cpu's
   corresponding struct device; dev->offline remains true.

3. Set cpu 7 online via sysfs. _cpu_up() determines that cpu 7 is
   already online and returns success. The driver core (device_online)
   sets dev->offline = false.

4. The migration completes and restores cpu 7 to offline state:

     rtas_ibm_suspend_me -> rtas_offline_cpus_mask -> cpu_down

This leaves cpu7 in a state where the driver core considers the cpu
device online, but in all other respects it is offline and
unused. Attempts to online the cpu via sysfs appear to succeed but the
driver core actually does not pass the request to the lower-level
cpuhp support code. This makes the cpu unusable until the cpu device
is manually set offline and then online again via sysfs.

Instead of directly calling cpu_up/cpu_down, the migration code should
use the higher-level device core APIs to maintain consistent state and
serialize operations.

Fixes: 120496ac2d ("powerpc: Bring all threads online prior to migration/hibernation")
Signed-off-by: Nathan Lynch <nathanl@linux.ibm.com>
Reviewed-by: Gautham R. Shenoy <ego@linux.vnet.ibm.com>
Signed-off-by: Michael Ellerman <mpe@ellerman.id.au>
Link: https://lore.kernel.org/r/20190802192926.19277-2-nathanl@linux.ibm.com
This commit is contained in:
Nathan Lynch 2019-08-02 14:29:24 -05:00 committed by Michael Ellerman
parent 415480dce2
commit a6717c01dd
1 changed files with 8 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
arch/powerpc/kernel/rtas.c
View File

@ -871,15 +871,17 @@ static int rtas_cpu_state_change_mask(enum rtas_cpu_state state,
return 0; return 0;
for_each_cpu(cpu, cpus) { for_each_cpu(cpu, cpus) {
struct device *dev = get_cpu_device(cpu);
switch (state) { switch (state) {
case DOWN: case DOWN:
cpuret = cpu_down(cpu); cpuret = device_offline(dev);
break; break;
case UP: case UP:
cpuret = cpu_up(cpu); cpuret = device_online(dev);
break; break;
} }
if (cpuret) { if (cpuret < 0) {
pr_debug("%s: cpu_%s for cpu#%d returned %d.\n", pr_debug("%s: cpu_%s for cpu#%d returned %d.\n",
__func__, __func__,
((state == UP) ? "up" : "down"), ((state == UP) ? "up" : "down"),
@ -966,6 +968,8 @@ int rtas_ibm_suspend_me(u64 handle)
data.token = rtas_token("ibm,suspend-me"); data.token = rtas_token("ibm,suspend-me");
data.complete = &done; data.complete = &done;
lock_device_hotplug();
/* All present CPUs must be online */ /* All present CPUs must be online */
cpumask_andnot(offline_mask, cpu_present_mask, cpu_online_mask); cpumask_andnot(offline_mask, cpu_present_mask, cpu_online_mask);
cpuret = rtas_online_cpus_mask(offline_mask); cpuret = rtas_online_cpus_mask(offline_mask);
@ -1004,6 +1008,7 @@ out_hotplug_enable:
__func__); __func__);
out: out:
unlock_device_hotplug();
free_cpumask_var(offline_mask); free_cpumask_var(offline_mask);
return atomic_read(&data.error); return atomic_read(&data.error);
} }