Andy Lutomirski a7fcf28d43 x86/asm/entry: Replace this_cpu_sp0() with current_top_of_stack() and fix it on x86_32 ... I broke 32-bit kernels. The implementation of sp0 was correct as far as I can tell, but sp0 was much weirder on x86_32 than I realized. It has the following issues: - Init's sp0 is inconsistent with everything else's: non-init tasks are offset by 8 bytes. (I have no idea why, and the comment is unhelpful.) - vm86 does crazy things to sp0. Fix it up by replacing this_cpu_sp0() with current_top_of_stack() and using a new percpu variable to track the top of the stack on x86_32. Signed-off-by: Andy Lutomirski <luto@amacapital.net> Cc: Borislav Petkov <bp@alien8.de> Cc: Denys Vlasenko <dvlasenk@redhat.com> Cc: H. Peter Anvin <hpa@zytor.com> Cc: Linus Torvalds <torvalds@linux-foundation.org> Cc: Oleg Nesterov <oleg@redhat.com> Cc: Thomas Gleixner <tglx@linutronix.de> Fixes: 75182b1632 ("x86/asm/entry: Switch all C consumers of kernel_stack to this_cpu_sp0()") Link: http://lkml.kernel.org/r/d09dbe270883433776e0cbee3c7079433349e96d.1425692936.git.luto@amacapital.net Signed-off-by: Ingo Molnar <mingo@kernel.org>		2015-03-07 09:34:03 +01:00
..
acpi	Merge branches 'core-urgent-for-linus' and 'irq-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2015-02-21 10:36:06 -08:00
apic	Revert "x86/apic: Only disable CPU x2apic mode when necessary"	2015-02-13 10:26:18 -08:00
cpu	x86/asm/entry: Replace this_cpu_sp0() with current_top_of_stack() and fix it on x86_32	2015-03-07 09:34:03 +01:00
kprobes	Merge branch 'perf-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2015-03-01 11:56:13 -08:00
.gitignore	…
Makefile	Linux 4.0-rc2	2015-03-04 06:35:43 +01:00
alternative.c	x86/alternatives: Use optimized NOPs for padding	2015-02-23 13:44:12 +01:00
amd_gart_64.c	…
amd_nb.c	…
apb_timer.c	x86/platform: Remove unused function from apb_timer.c	2014-12-23 10:43:35 +01:00
aperture_64.c	…
apm_32.c	…
asm-offsets.c	…
asm-offsets_32.c	x86/asm: Guard against building the 32/64-bit versions of the asm-offsets*.c file directly	2014-12-11 11:43:56 +01:00
asm-offsets_64.c	x86/asm/entry/64/compat: Change the 32-bit sysenter code to use sp0	2015-03-06 08:32:58 +01:00
audit_64.c	x86: hook up execveat system call	2014-12-13 12:42:51 -08:00
bootflag.c	…
check.c	…
cpuid.c	…
crash.c	x86, irq: Move IOAPIC related declarations from hw_irq.h into io_apic.h	2014-12-16 14:08:17 +01:00
crash_dump_32.c	…
crash_dump_64.c	…
devicetree.c	…
doublefault.c	…
dumpstack.c	x86_64: add KASan support	2015-02-13 21:21:41 -08:00
dumpstack_32.c	…
dumpstack_64.c	…
e820.c	x86, e820: Clean up sanitize_e820_map() users	2015-01-23 16:14:27 +01:00
early-quirks.c	…
early_printk.c	Specify PCI based UART for earlyprintk	2015-02-02 10:11:27 -08:00
entry_32.S	x86/asm: Introduce push/pop macros which generate CFI_REL_OFFSET and CFI_RESTORE	2015-03-04 22:50:49 +01:00
entry_64.S	x86/asm/entry: Rename 'INIT_TSS_IST' to 'CPU_TSS_IST'	2015-03-06 08:32:58 +01:00
espfix_64.c	…
ftrace.c	module: remove mod arg from module_free, rename module_memfree().	2015-01-20 11:38:33 +10:30
head.c	…
head32.c	x86: Store a per-cpu shadow copy of CR4	2015-02-04 12:10:42 +01:00
head64.c	Merge branch 'perf-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2015-02-16 14:58:12 -08:00
head_32.S	x86/asm/boot: Use already defined KEEP_SEGMENTS macro in head_{32,64}.S	2015-02-19 10:05:04 +01:00
head_64.S	Linux 4.0-rc2	2015-03-04 06:35:43 +01:00
hpet.c	kernel.h: remove ancient __FUNCTION__ hack	2015-02-12 18:54:13 -08:00
hw_breakpoint.c	…
i386_ksyms_32.c	…
i387.c	Merge branch 'perf-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2015-02-16 14:58:12 -08:00
i8237.c	…
i8253.c	…
i8259.c	…
io_delay.c	…
ioport.c	x86/asm/entry: Rename 'init_tss' to 'cpu_tss'	2015-03-06 08:32:58 +01:00
iosf_mbi.c	…
irq.c	x86/irq: Check for valid irq descriptor in check_irq_vectors_for_cpu_disable()	2015-02-18 15:01:42 +01:00
irq_32.c	x86: Clean up current_stack_pointer	2015-01-02 10:22:46 -08:00
irq_64.c	…
irq_work.c	…
irqinit.c	x86, irq: Move local APIC related code from io_apic.c into vector.c	2014-12-16 14:08:16 +01:00
jump_label.c	…
kdebugfs.c	…
kexec-bzimage64.c	…
kgdb.c	…
ksysfs.c	…
kvm.c	x86/spinlocks/paravirt: Fix memory corruption on unlock	2015-02-18 14:53:49 +01:00
kvmclock.c	…
ldt.c	…
livepatch.c	livepatch: kernel: add support for live patching	2014-12-22 15:40:49 +01:00
machine_kexec_32.c	x86, irq: Move IOAPIC related declarations from hw_irq.h into io_apic.h	2014-12-16 14:08:17 +01:00
machine_kexec_64.c	x86, irq: Move IOAPIC related declarations from hw_irq.h into io_apic.h	2014-12-16 14:08:17 +01:00
mcount_64.S	…
mmconf-fam10h_64.c	…
module.c	Merge branch 'x86-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2015-02-21 10:41:29 -08:00
mpparse.c	…
msr.c	…
nmi.c	…
nmi_selftest.c	…
paravirt-spinlocks.c	…
paravirt.c	…
paravirt_patch_32.c	…
paravirt_patch_64.c	…
pci-calgary_64.c	…
pci-dma.c	…
pci-iommu_table.c	…
pci-nommu.c	…
pci-swiotlb.c	…
pcspeaker.c	…
perf_regs.c	perf/x86_64: Improve user regs sampling	2015-01-09 11:12:29 +01:00
pmc_atom.c	x86: pmc_atom: Expose contents of PSS	2015-01-20 12:50:14 +01:00
probe_roms.c	…
process.c	x86/asm/entry: Remove INIT_TSS and fold the definitions into 'cpu_tss'	2015-03-06 08:32:58 +01:00
process_32.c	x86/asm/entry: Replace this_cpu_sp0() with current_top_of_stack() and fix it on x86_32	2015-03-07 09:34:03 +01:00
process_64.c	x86/asm/entry: Delay loading sp0 slightly on task switch	2015-03-07 09:34:03 +01:00
ptrace.c	x86/ptrace: Remove checks for TIF_IA32 when changing CS and SS	2015-02-25 08:27:49 +01:00
pvclock.c	…
quirks.c	…
reboot.c	x86, irq: Move IOAPIC related declarations from hw_irq.h into io_apic.h	2014-12-16 14:08:17 +01:00
reboot_fixups_32.c	…
relocate_kernel_32.S	…
relocate_kernel_64.S	…
resource.c	…
rtc.c	kernel.h: remove ancient __FUNCTION__ hack	2015-02-12 18:54:13 -08:00
setup.c	Merge branch 'x86-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2015-02-21 10:41:29 -08:00
setup_percpu.c	…
signal.c	all arches, signal: move restart_block to struct task_struct	2015-02-12 18:54:12 -08:00
smp.c	…
smpboot.c	x86/asm/entry: Replace this_cpu_sp0() with current_top_of_stack() and fix it on x86_32	2015-03-07 09:34:03 +01:00
stacktrace.c	…
step.c	…
sys_x86_64.c	…
syscall_32.c	x86/compat: Merge native and compat 32-bit syscall tables	2015-03-04 06:16:21 +01:00
syscall_64.c	…
sysfb.c	…
sysfb_efi.c	…
sysfb_simplefb.c	…
tboot.c	…
tce_64.c	…
test_nx.c	…
test_rodata.c	…
time.c	…
tls.c	x86, tls: Interpret an all-zero struct user_desc as "no segment"	2015-01-22 21:45:07 +01:00
tls.h	…
topology.c	…
trace_clock.c	…
tracepoint.c	…
traps.c	x86/asm/entry: Replace this_cpu_sp0() with current_top_of_stack() and fix it on x86_32	2015-03-07 09:34:03 +01:00
tsc.c	x86/tsc: Change Fast TSC calibration failed from error to info	2015-01-23 10:53:52 +01:00
tsc_msr.c	…
tsc_sync.c	…
uprobes.c	uprobes/x86: Fix 2-byte opcode table	2015-02-18 20:55:53 +01:00
verify_cpu.S	…
vm86_32.c	x86/asm/entry: Rename 'init_tss' to 'cpu_tss'	2015-03-06 08:32:58 +01:00
vmlinux.lds.S	…
vsmp_64.c	…
vsyscall_64.c	…
vsyscall_emu_64.S	…
vsyscall_gtod.c	…
vsyscall_trace.h	…
x86_init.c	…
x8664_ksyms_64.c	x86_64: kasan: add interceptors for memset/memmove/memcpy functions	2015-02-13 21:21:41 -08:00
xsave.c	x86: Clean up cr4 manipulation	2015-02-04 12:10:41 +01:00