michaelh/zephyr
1
0
Fork 0
Code Releases Activity
zephyr/arch/arm64/include/kernel_arch_func.h

77 lines
1.8 KiB
C
Raw Normal View History

arch: arm64: Introduce ARM64 (AArch64) architecture Introduce the basic ARM64 architecture support. A new CONFIG_ARM64 symbol is introduced for the new architecture and new cmake / Kconfig files are added to switch between ARM and ARM64. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2019-11-10 16:17:19 +00:00
/*
* Copyright (c) 2019 Carlo Caione <ccaione@baylibre.com<
*
* SPDX-License-Identifier: Apache-2.0
*/
/**
* @file
* @brief Private kernel definitions (ARM64)
*
* This file contains private kernel function definitions and various
* other definitions for the ARM Cortex-A processor architecture family.
*
* This file is also included by assembly language files which must #define
* _ASMLANGUAGE before including this header file. Note that kernel
* assembly source files obtains structure offset values via "absolute symbols"
* in the offsets.o module.
*/
arm/arm64: Fix misc and trivials for ARM/ARM64 split Fix the header guards, comments, github labeler, CODEOWNERS and MAINTAINERS files. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2021-03-26 15:22:59 +01:00
#ifndef ZEPHYR_ARCH_ARM64_INCLUDE_KERNEL_ARCH_FUNC_H_
#define ZEPHYR_ARCH_ARM64_INCLUDE_KERNEL_ARCH_FUNC_H_
arch: arm64: Introduce ARM64 (AArch64) architecture Introduce the basic ARM64 architecture support. A new CONFIG_ARM64 symbol is introduced for the new architecture and new cmake / Kconfig files are added to switch between ARM and ARM64. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2019-11-10 16:17:19 +00:00
#include <kernel_arch_data.h>
init: support per-core init hook Allow SoC to implement their custom per-core initialization function by selecting `CONFIG_SOC_PER_CORE_INIT_HOOK` and implement `soc_per_core_init_hook()`. Signed-off-by: Maxim Adelman <imax@meta.com> Signed-off-by: Yong Cong Sin <ycsin@meta.com> Signed-off-by: Yong Cong Sin <yongcong.sin@gmail.com>
2024-10-30 22:19:51 +08:00
#include <zephyr/platform/hooks.h>
arch: arm64: Introduce ARM64 (AArch64) architecture Introduce the basic ARM64 architecture support. A new CONFIG_ARM64 symbol is introduced for the new architecture and new cmake / Kconfig files are added to switch between ARM and ARM64. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2019-11-10 16:17:19 +00:00
#ifdef __cplusplus
extern "C" {
#endif
#ifndef _ASMLANGUAGE
arch: arm64: init xen in arch_kernel_init() Call xen_enlighten_init() from arch_kernel_init() instead of using SYS_INIT. Signed-off-by: Anas Nashif <anas.nashif@intel.com>
2024-07-08 17:17:09 -04:00
extern void xen_enlighten_init(void);
arch: arm64: Introduce ARM64 (AArch64) architecture Introduce the basic ARM64 architecture support. A new CONFIG_ARM64 symbol is introduced for the new architecture and new cmake / Kconfig files are added to switch between ARM and ARM64. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2019-11-10 16:17:19 +00:00
static ALWAYS_INLINE void arch_kernel_init(void)
{
arch: arm64: init xen in arch_kernel_init() Call xen_enlighten_init() from arch_kernel_init() instead of using SYS_INIT. Signed-off-by: Anas Nashif <anas.nashif@intel.com>
2024-07-08 17:17:09 -04:00
#ifdef CONFIG_XEN
xen_enlighten_init();
#endif
init: support per-core init hook Allow SoC to implement their custom per-core initialization function by selecting `CONFIG_SOC_PER_CORE_INIT_HOOK` and implement `soc_per_core_init_hook()`. Signed-off-by: Maxim Adelman <imax@meta.com> Signed-off-by: Yong Cong Sin <ycsin@meta.com> Signed-off-by: Yong Cong Sin <yongcong.sin@gmail.com>
2024-10-30 22:19:51 +08:00
#ifdef CONFIG_SOC_PER_CORE_INIT_HOOK
soc_per_core_init_hook();
#endif /* CONFIG_SOC_PER_CORE_INIT_HOOK */
arch: arm64: Introduce ARM64 (AArch64) architecture Introduce the basic ARM64 architecture support. A new CONFIG_ARM64 symbol is introduced for the new architecture and new cmake / Kconfig files are added to switch between ARM and ARM64. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2019-11-10 16:17:19 +00:00
}
arch: arm64: Use _arch_switch() API Switch to the _arch_switch() API that is required for an SMP-aware scheduler instead of using the old arch_swap mechanism. SMP is not supported yet but this is a necessary step in that direction. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2020-08-04 12:52:16 +02:00
static inline void arch_switch(void *switch_to, void **switched_from)
arch: arm64: Introduce ARM64 (AArch64) architecture Introduce the basic ARM64 architecture support. A new CONFIG_ARM64 symbol is introduced for the new architecture and new cmake / Kconfig files are added to switch between ARM and ARM64. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2019-11-10 16:17:19 +00:00
{
arm64: improved arch_switch() implementation Make it optimal without the need for an SVC/exception roundtrip on every context switch. Performance numbers from tests/benchmarks/sched: Before: unpend 85 ready 58 switch 258 pend 231 tot 632 (avg 699) After: unpend 85 ready 59 switch 115 pend 138 tot 397 (avg 478) Signed-off-by: Nicolas Pitre <npitre@baylibre.com>
2022-03-14 12:51:40 -05:00
extern void z_arm64_context_switch(struct k_thread *new,
struct k_thread *old);
struct k_thread *new = switch_to;
struct k_thread *old = CONTAINER_OF(switched_from, struct k_thread,
switch_handle);
arch: arm64: Use _arch_switch() API Switch to the _arch_switch() API that is required for an SMP-aware scheduler instead of using the old arch_swap mechanism. SMP is not supported yet but this is a necessary step in that direction. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2020-08-04 12:52:16 +02:00
arm64: improved arch_switch() implementation Make it optimal without the need for an SVC/exception roundtrip on every context switch. Performance numbers from tests/benchmarks/sched: Before: unpend 85 ready 58 switch 258 pend 231 tot 632 (avg 699) After: unpend 85 ready 59 switch 115 pend 138 tot 397 (avg 478) Signed-off-by: Nicolas Pitre <npitre@baylibre.com>
2022-03-14 12:51:40 -05:00
z_arm64_context_switch(new, old);
arch: arm64: Introduce ARM64 (AArch64) architecture Introduce the basic ARM64 architecture support. A new CONFIG_ARM64 symbol is introduced for the new architecture and new cmake / Kconfig files are added to switch between ARM and ARM64. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2019-11-10 16:17:19 +00:00
}
arch: define `struct arch_esf` and deprecate `z_arch_esf_t` Make `struct arch_esf` compulsory for all architectures by declaring it in the `arch_interface.h` header. After this commit, the named struct `z_arch_esf_t` is only used internally to generate offsets, and is slated to be removed from the `arch_interface.h` header in the future. Signed-off-by: Yong Cong Sin <ycsin@meta.com>
2024-06-01 00:07:14 +08:00
extern void z_arm64_fatal_error(unsigned int reason, struct arch_esf *esf);
arch/arm64: Implement ASID support in ARM64 MMU Improves context-switch performance. TLB invalidation and the nG bit are used conservatively. This could be improved in future work. Tested with tests/benchmarks/sched_userspace: BEFORE: ``` Swapping 2 threads: 161562583 cyc & 1000000 rounds -> 1615 ns per ctx Swapping 8 threads: 161569289 cyc & 1000000 rounds -> 1615 ns per ctx Swapping 16 threads: 161649163 cyc & 1000000 rounds -> 1616 ns per ctx Swapping 32 threads: 163487880 cyc & 1000000 rounds -> 1634 ns per ctx ``` AFTER: ``` Swapping 2 threads: 18129207 cyc & 1000000 rounds -> 181 ns per ctx Swapping 8 threads: 49702891 cyc & 1000000 rounds -> 497 ns per ctx Swapping 16 threads: 55898650 cyc & 1000000 rounds -> 558 ns per ctx Swapping 32 threads: 58059704 cyc & 1000000 rounds -> 580 ns per ctx ``` Signed-off-by: Henri Xavier <datacomos@huawei.com>
2022-12-12 16:33:31 +01:00
extern void z_arm64_set_ttbr0(uint64_t ttbr0);
arm64: Create common mmu and mpu interfaces Include the new introduced include/arch/arm64/mm.h instead of the arm_mmu.h or arm_mpu.h. Unify function names z_arm64_thread_pt_init/z_arm64_swap_ptables with z_arm64_thread_mem_domains_init/z_arm64_swap_mem_domains for mmu and mpu, because: 1. mmu and mpu have almost the same logic. 2. mpu doesn't have ptables. 3. using the function names help reducing "#if define" macros. Similarly, change z_arm64_ptable_ipi to z_arm64_domain_sync_ipi And fix a log bug in arm_mmu.c. Signed-off-by: Jaxson Han <jaxson.han@arm.com>
2021-07-20 10:14:17 +08:00
extern void z_arm64_mem_cfg_ipi(void);
arch: arm64: Introduce ARM64 (AArch64) architecture Introduce the basic ARM64 architecture support. A new CONFIG_ARM64 symbol is introduced for the new architecture and new cmake / Kconfig files are added to switch between ARM and ARM64. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2019-11-10 16:17:19 +00:00
arm64: FPU context switching support This adds FPU sharing support with a lazy context switching algorithm. Every thread is allowed to use FPU/SIMD registers. In fact, the compiler may insert FPU reg accesses in anycontext to optimize even non-FP code unless the -mgeneral-regs-only compiler flag is used, but Zephyr currently doesn't support such a build. It is therefore possible to do FP access in IRS as well with this patch although IRQs are then disabled to prevent nested IRQs in such cases. Because the thread object grows in size, some tests have to be adjusted. Signed-off-by: Nicolas Pitre <npitre@baylibre.com>
2021-04-07 23:31:44 -04:00
#ifdef CONFIG_FPU_SHARING
arch: smp: make flush_fpu_ipi a common, optional interfaces The interface to flush fpu is not unique to one architecture, make it a generic, optional interface that can be implemented (and overriden) by a platform. Signed-off-by: Anas Nashif <anas.nashif@intel.com>
2023-12-13 16:04:15 -05:00
void arch_flush_local_fpu(void);
void arch_flush_fpu_ipi(unsigned int cpu);
arm64: FPU context switching support This adds FPU sharing support with a lazy context switching algorithm. Every thread is allowed to use FPU/SIMD registers. In fact, the compiler may insert FPU reg accesses in anycontext to optimize even non-FP code unless the -mgeneral-regs-only compiler flag is used, but Zephyr currently doesn't support such a build. It is therefore possible to do FP access in IRS as well with this patch although IRQs are then disabled to prevent nested IRQs in such cases. Because the thread object grows in size, some tests have to be adjusted. Signed-off-by: Nicolas Pitre <npitre@baylibre.com>
2021-04-07 23:31:44 -04:00
#endif
arch: arm64: Add safe exception stack init function Add safe exception stack init function which does several things: 1) setting current cpu safe exception stack pointer to its corresponding stack top. 2) init sp_el0 with the above safe exception stack. That makes sure the sp_el0 points to per-cpu safe_stack in the kernel space. 3) init the current_stack_limit and corrupted_sp with 0 Signed-off-by: Jaxson Han <jaxson.han@arm.com>
2022-11-01 16:03:42 +08:00
#ifdef CONFIG_ARM64_SAFE_EXCEPTION_STACK
void z_arm64_safe_exception_stack_init(void);
#endif
arch: arm64: Introduce ARM64 (AArch64) architecture Introduce the basic ARM64 architecture support. A new CONFIG_ARM64 symbol is introduced for the new architecture and new cmake / Kconfig files are added to switch between ARM and ARM64. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2019-11-10 16:17:19 +00:00
#endif /* _ASMLANGUAGE */
#ifdef __cplusplus
}
#endif
arm/arm64: Fix misc and trivials for ARM/ARM64 split Fix the header guards, comments, github labeler, CODEOWNERS and MAINTAINERS files. Signed-off-by: Carlo Caione <ccaione@baylibre.com>
2021-03-26 15:22:59 +01:00
#endif /* ZEPHYR_ARCH_ARM64_INCLUDE_KERNEL_ARCH_FUNC_H_ */
Copy permalink