Eric Dumazet c335ad738f af_packet: do not call packet_read_pending() from tpacket_destruct_skb() ... [ Upstream commit 581073f626e387d3e7eed55c48c8495584ead7ba ] trafgen performance considerably sank on hosts with many cores after the blamed commit. packet_read_pending() is very expensive, and calling it in af_packet fast path defeats Daniel intent in commit b013840810 ("packet: use percpu mmap tx frame pending refcount") tpacket_destruct_skb() makes room for one packet, we can immediately wakeup a producer, no need to completely drain the tx ring. Fixes: 89ed5b5190 ("af_packet: Block execution of tasks waiting for transmit to complete in AF_PACKET") Signed-off-by: Eric Dumazet <edumazet@google.com> Cc: Neil Horman <nhorman@tuxdriver.com> Cc: Daniel Borkmann <daniel@iogearbox.net> Reviewed-by: Willem de Bruijn <willemb@google.com> Link: https://lore.kernel.org/r/20240515163358.4105915-1-edumazet@google.com Signed-off-by: Jakub Kicinski <kuba@kernel.org> Signed-off-by: Sasha Levin <sashal@kernel.org>		2024-06-16 13:39:33 +02:00
..
6lowpan	6lowpan: iphc: Fix an off-by-one check of array index	2021-07-22 16:19:03 +02:00
9p	net: 9p: avoid freeing uninit memory in p9pdu_vreadf	2024-01-05 15:13:34 +01:00
802	mrp: introduce active flags to prevent UAF when applicant uninit	2022-12-31 13:14:42 +01:00
8021q	vlan: skip nested type that is not IFLA_VLAN_QOS_MAPPING	2024-02-23 08:54:27 +01:00
appletalk	appletalk: Fix Use-After-Free in atalk_ioctl	2023-12-20 15:17:37 +01:00
atm	atm: Fix Use-After-Free in do_vcc_ioctl	2023-12-20 15:17:35 +01:00
ax25	net: ax25: Fix deadlock caused by skb_recv_datagram in ax25_recvmsg	2022-06-22 14:22:01 +02:00
batman-adv	batman-adv: Avoid infinite loop trying to resize local TT	2024-04-17 11:15:13 +02:00
bluetooth	Bluetooth: l2cap: fix null-ptr-deref in l2cap_chan_timeout	2024-05-17 11:50:57 +02:00
bpf	bpf: Move skb->len == 0 checks into __bpf_redirect	2022-12-31 13:14:11 +01:00
bpfilter	bpfilter: Specify the log level for the kmsg message	2021-06-25 13:13:50 +02:00
bridge	net: bridge: fix corrupted ethernet header on multicast-to-unicast	2024-05-17 11:50:58 +02:00
caif	net: caif: Fix use-after-free in cfusbl_device_notify()	2023-03-17 08:48:54 +01:00
can	can: j1939: Fix UAF in j1939_sk_match_filter during setsockopt(SO_J1939_FILTER)	2024-02-23 08:55:10 +01:00
ceph	libceph: use kernel_connect()	2023-10-19 23:05:36 +02:00
core	net: give more chances to rcu in netdev_wait_allrefs_any()	2024-06-16 13:39:23 +02:00
dcb	net: dcb: choose correct policy to parse DCB_ATTR_BCN	2023-08-11 15:13:53 +02:00
dccp	net: inet: Retire port only listening_hash	2023-11-28 16:56:22 +00:00
dns_resolver	keys, dns: Fix size check of V1 server-list header	2024-01-25 14:52:46 -08:00
dsa	net: dsa: introduce preferred_default_local_cpu_port and use on MT7530	2024-04-27 17:05:29 +02:00
ethernet	ethernet: Add helper for assigning packet type when dest address does not match device address	2024-05-02 16:24:49 +02:00
ethtool	ethtool: netlink: Add missing ethnl_ops_begin/complete	2024-01-25 14:52:54 -08:00
hsr	hsr: Handle failures in module init	2024-03-26 18:21:36 -04:00
ieee802154	net: ieee802154: fix error return code in dgram_bind()	2022-11-03 23:59:14 +09:00
ife	net: sched: ife: fix potential use-after-free	2024-01-05 15:13:29 +01:00
ipv4	tcp: avoid premature drops in tcp_add_backlog()	2024-06-16 13:39:22 +02:00
ipv6	ipv6: sr: fix invalid unregister error path	2024-06-16 13:39:26 +02:00
iucv	net/iucv: fix the allocation size of iucv_path_table array	2024-03-26 18:21:13 -04:00
kcm	net: kcm: fix incorrect parameter validation in the kcm_getsockopt) function	2024-03-26 18:21:23 -04:00
key	net: af_key: fix sadb_x_filter validation	2023-08-26 14:23:32 +02:00
l2tp	net l2tp: drop flow hash on forward	2024-05-17 11:50:48 +02:00
l3mdev	l3mdev: l3mdev_master_upper_ifindex_by_index_rcu should be using netdev_master_upper_dev_get_rcu	2022-04-27 14:38:53 +02:00
lapb	net: lapb: Use list_for_each_entry() to simplify code in lapb_iface.c	2021-06-08 16:31:25 -07:00
llc	llc: call sock_orphan() at release time	2024-02-23 08:54:54 +01:00
mac80211	wifi: mac80211: fix ieee80211_bss_*_flags kernel-doc	2024-05-17 11:50:52 +02:00
mac802154	mac802154: fix llsec key resources release in mac802154_llsec_key_del	2024-04-10 16:18:39 +02:00
mctp	mctp: perform route lookups under a RCU read-side lock	2023-10-25 11:58:59 +02:00
mpls	net: mpls: fix stale pointer if allocation fails during device rename	2023-02-22 12:57:09 +01:00
mptcp	mptcp: SO_KEEPALIVE: fix getsockopt support	2024-06-16 13:39:26 +02:00
ncsi	net/ncsi: Fix netlink major/minor version numbers	2024-01-25 14:52:36 -08:00
netfilter	netfilter: nf_tables: honor table dormant flag from netdev release event path	2024-05-02 16:24:46 +02:00
netlabel	calipso: fix memory leak in netlbl_calipso_add_pass()	2024-01-25 14:52:33 -08:00
netlink	netlink: annotate data-races around sk->sk_err	2024-05-25 16:20:17 +02:00
netrom	netrom: fix possible dead-lock in nr_rt_ioctl()	2024-06-16 13:39:33 +02:00
nfc	nfc: nci: Fix uninit-value in nci_dev_up and nci_ntf_packet	2024-04-10 16:19:35 +02:00
nsh	nsh: Restore skb->{protocol,data,mac_header} for outer header in nsh_gso_segment().	2024-05-17 11:50:48 +02:00
openvswitch	net: openvswitch: fix overwriting ct original tuple for ICMPv6	2024-06-16 13:39:26 +02:00
packet	af_packet: do not call packet_read_pending() from tpacket_destruct_skb()	2024-06-16 13:39:33 +02:00
phonet	phonet: fix rtm_phonet_notify() skb allocation	2024-05-17 11:50:58 +02:00
psample	psample: Require 'CAP_NET_ADMIN' when joining "packets" group	2023-12-13 18:36:37 +01:00
qrtr	net: qrtr: ns: Fix module refcnt	2024-06-16 13:39:33 +02:00
rds	net/rds: fix possible cp null dereference	2024-04-10 16:19:37 +02:00
rfkill	net: rfkill: gpio: set GPIO direction	2024-01-05 15:13:34 +01:00
rose	net/rose: fix races in rose_kill_by_device()	2024-01-05 15:13:29 +01:00
rxrpc	rxrpc: Fix response to PING RESPONSE ACKs to a dead call	2024-02-23 08:54:58 +01:00
sched	net/sched: act_skbmod: prevent kernel-infoleak	2024-04-10 16:19:38 +02:00
sctp	sctp: update hb timer immediately after users change hb_interval	2023-10-10 21:59:08 +02:00
smc	net/smc: reduce rtnl pressure in smc_pnet_create_pnetids_list()	2024-04-13 13:01:44 +02:00
strparser	bpf: sockmap, strparser, and tls are reusing qdisc_skb_cb and colliding	2021-11-18 19:17:11 +01:00
sunrpc	SUNRPC: Fix gss_free_in_token_pages()	2024-06-16 13:39:33 +02:00
switchdev	net: make switchdev_bridge_port_{,unoffload} loosely coupled with the bridge	2021-08-04 12:35:07 +01:00
tipc	tipc: fix UAF in error path	2024-05-17 11:51:04 +02:00
tls	net: tls: handle backlogging of crypto requests	2024-05-25 16:20:17 +02:00
unix	af_unix: Fix data races in unix_release_sock/unix_stream_sendmsg	2024-06-16 13:39:25 +02:00
vmw_vsock	virtio/vsock: fix logic which reduces credit update messages	2024-01-25 14:52:38 -08:00
wireless	wifi: cfg80211: fix the order of arguments for trace events of the tx_rx_evt class	2024-06-16 13:39:13 +02:00
x25	net/x25: fix incorrect parameter validation in the x25_getsockopt() function	2024-03-26 18:21:23 -04:00
xdp	xsk: validate user input for XDP_{UMEM|COMPLETION}_FILL_RING	2024-04-17 11:15:14 +02:00
xfrm	xfrm: Preserve vlan tags for transport mode software GRO	2024-05-17 11:50:57 +02:00
Kconfig	Remove DECnet support from kernel	2023-06-21 15:59:15 +02:00
Makefile	Remove DECnet support from kernel	2023-06-21 15:59:15 +02:00
compat.c	net: Return the correct errno code	2021-06-03 15:13:56 -07:00
devres.c	net: devres: Correct a grammatical error	2021-06-11 12:55:28 -07:00
socket.c	net: Save and restore msg_namelen in sock_sendmsg	2024-01-15 18:51:16 +01:00
sysctl_net.c	…