Ard Biesheuvel 65d1e3c415 crypto: aesni - release FPU during skcipher walk API calls ... Taking ownership of the FPU in kernel mode disables preemption, and this may result in excessive scheduling blackouts if the size of the data being processed on the FPU is unbounded. Given that taking and releasing the FPU is cheap these days on x86, we can limit the impact of this issue easily for skcipher implementations, by moving the FPU begin/end calls inside the skcipher walk processing loop. Considering that skcipher walks operate on at most one page at a time, doing so fully mitigates this issue. This also permits the skcipher walk logic to use non-atomic kmalloc() calls etc so we can change the 'atomic' bool argument in the calls to skcipher_walk_virt() to false as well. Signed-off-by: Ard Biesheuvel <ardb@kernel.org> Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>		2021-01-22 14:58:04 +11:00
..
.gitignore	.gitignore: add SPDX License Identifier	2020-03-25 11:50:48 +01:00
Makefile	crypto: x86 - remove glue helper module	2021-01-14 17:10:29 +11:00
aegis128-aesni-asm.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
aegis128-aesni-glue.c	crypto: remove CRYPTO_TFM_RES_BAD_KEY_LEN	2020-01-09 11:30:53 +08:00
aes_ctrby8_avx-x86_64.S	crypto: x86 - Remove include/asm/inst.h	2020-07-16 21:49:07 +10:00
aesni-intel_asm.S	crypto: x86/aes-ni-xts - rewrite and drop indirections via glue helper	2021-01-08 15:39:47 +11:00
aesni-intel_avx-x86_64.S	crypto: aesni - Use TEST %reg,%reg instead of CMP $0,%reg	2020-12-04 18:13:15 +11:00
aesni-intel_glue.c	crypto: aesni - release FPU during skcipher walk API calls	2021-01-22 14:58:04 +11:00
blake2s-core.S	x86: remove always-defined CONFIG_AS_SSSE3	2020-04-09 00:01:59 +09:00
blake2s-glue.c	crypto: blake2s - share the "shash" API boilerplate code	2021-01-03 08:41:38 +11:00
blowfish-x86_64-asm_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
blowfish_glue.c	crypto: x86/blowfish - drop CTR mode implementation	2021-01-14 17:10:29 +11:00
camellia-aesni-avx-asm_64.S	crypto: x86/camellia - drop CTR mode implementation	2021-01-14 17:10:28 +11:00
camellia-aesni-avx2-asm_64.S	crypto: x86/camellia - drop CTR mode implementation	2021-01-14 17:10:28 +11:00
camellia-x86_64-asm_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
camellia.h	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
camellia_aesni_avx2_glue.c	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
camellia_aesni_avx_glue.c	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
camellia_glue.c	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
cast5-avx-x86_64-asm_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
cast5_avx_glue.c	crypto: x86/cast5 - drop dependency on glue helper	2021-01-14 17:10:29 +11:00
cast6-avx-x86_64-asm_64.S	crypto: x86/cast6 - drop CTR mode implementation	2021-01-14 17:10:28 +11:00
cast6_avx_glue.c	crypto: x86/cast6 - drop dependency on glue helper	2021-01-14 17:10:29 +11:00
chacha-avx2-x86_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
chacha-avx512vl-x86_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
chacha-ssse3-x86_64.S	crypto: x86/chacha-sse3 - use unaligned loads for state array	2020-07-16 21:49:04 +10:00
chacha_glue.c	crypto: algapi - Remove skbuff.h inclusion	2020-08-20 14:04:28 +10:00
crc32-pclmul_asm.S	crypto: x86 - Remove include/asm/inst.h	2020-07-16 21:49:07 +10:00
crc32-pclmul_glue.c	crypto: Convert to new CPU match macros	2020-03-24 21:36:06 +01:00
crc32c-intel_glue.c	crypto: x86/crc32c-intel - Use CRC32 mnemonic	2020-08-21 14:45:28 +10:00
crc32c-pcl-intel-asm_64.S	crypto: x86/crc32c - fix building with clang ias	2020-07-23 17:34:16 +10:00
crct10dif-pcl-asm_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
crct10dif-pclmul_glue.c	crypto: Convert to new CPU match macros	2020-03-24 21:36:06 +01:00
curve25519-x86_64.c	crypto: curve25519-x86_64 - Use XORL r32,32	2020-09-11 14:39:13 +10:00
des3_ede-asm_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
des3_ede_glue.c	crypto: x86/des - drop CTR mode implementation	2021-01-14 17:10:28 +11:00
ecb_cbc_helpers.h	crypto: x86 - add some helper macros for ECB and CBC modes	2021-01-14 17:10:29 +11:00
ghash-clmulni-intel_asm.S	crypto: x86 - Remove include/asm/inst.h	2020-07-16 21:49:07 +10:00
ghash-clmulni-intel_glue.c	crypto: Convert to new CPU match macros	2020-03-24 21:36:06 +01:00
glue_helper-asm-avx.S	crypto: x86/glue-helper - drop CTR helper routines	2021-01-14 17:10:28 +11:00
glue_helper-asm-avx2.S	crypto: x86/glue-helper - drop CTR helper routines	2021-01-14 17:10:28 +11:00
nh-avx2-x86_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
nh-sse2-x86_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
nhpoly1305-avx2-glue.c	crypto: algapi - Remove skbuff.h inclusion	2020-08-20 14:04:28 +10:00
nhpoly1305-sse2-glue.c	crypto: algapi - Remove skbuff.h inclusion	2020-08-20 14:04:28 +10:00
poly1305-x86_64-cryptogams.pl	crypto: x86/poly1305 - Use TEST %reg,%reg instead of CMP $0,%reg	2020-12-04 18:13:16 +11:00
poly1305_glue.c	Merge branch 'linus' of git://git.kernel.org/pub/scm/linux/kernel/git/herbert/crypto-2.6	2020-12-14 12:18:19 -08:00
serpent-avx-x86_64-asm_64.S	crypto: x86/serpent - drop CTR mode implementation	2021-01-14 17:10:28 +11:00
serpent-avx.h	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
serpent-avx2-asm_64.S	crypto: x86/serpent - drop CTR mode implementation	2021-01-14 17:10:28 +11:00
serpent-sse2-i586-asm_32.S	x86/asm/32: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 12:03:43 +02:00
serpent-sse2-x86_64-asm_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
serpent-sse2.h	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
serpent_avx2_glue.c	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
serpent_avx_glue.c	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
serpent_sse2_glue.c	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
sha1_avx2_x86_64_asm.S	crypto: x86/sha - Eliminate casts on asm implementations	2020-01-22 16:21:08 +08:00
sha1_ni_asm.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
sha1_ssse3_asm.S	x86: remove always-defined CONFIG_AS_AVX	2020-04-09 00:01:59 +09:00
sha1_ssse3_glue.c	crypto: sha - split sha.h into sha1.h and sha2.h	2020-11-20 14:45:33 +11:00
sha256-avx-asm.S	x86: remove always-defined CONFIG_AS_AVX	2020-04-09 00:01:59 +09:00
sha256-avx2-asm.S	x86: update AS_* macros to binutils >=2.23, supporting ADX and AVX2	2020-04-09 00:12:48 +09:00
sha256-ssse3-asm.S	crypto: x86/sha - Eliminate casts on asm implementations	2020-01-22 16:21:08 +08:00
sha256_ni_asm.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
sha256_ssse3_glue.c	crypto: sha - split sha.h into sha1.h and sha2.h	2020-11-20 14:45:33 +11:00
sha512-avx-asm.S	crypto: x86/sha512 - Use TEST %reg,%reg instead of CMP $0,%reg	2020-12-04 18:13:15 +11:00
sha512-avx2-asm.S	x86: update AS_* macros to binutils >=2.23, supporting ADX and AVX2	2020-04-09 00:12:48 +09:00
sha512-ssse3-asm.S	crypto: x86/sha512 - Use TEST %reg,%reg instead of CMP $0,%reg	2020-12-04 18:13:15 +11:00
sha512_ssse3_glue.c	crypto: sha - split sha.h into sha1.h and sha2.h	2020-11-20 14:45:33 +11:00
twofish-avx-x86_64-asm_64.S	crypto: x86/twofish - drop CTR mode implementation	2021-01-14 17:10:28 +11:00
twofish-i586-asm_32.S	x86/asm/32: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 12:03:43 +02:00
twofish-x86_64-asm_64-3way.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
twofish-x86_64-asm_64.S	x86/asm: Change all ENTRY+ENDPROC to SYM_FUNC_*	2019-10-18 11:58:33 +02:00
twofish.h	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
twofish_avx_glue.c	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00
twofish_glue.c	…
twofish_glue_3way.c	crypto: x86 - use local headers for x86 specific shared declarations	2021-01-14 17:10:30 +11:00