2019-05-27 14:55:01 +08:00
|
|
|
// SPDX-License-Identifier: GPL-2.0-or-later
|
2005-04-17 06:20:36 +08:00
|
|
|
/*
|
|
|
|
* IPv6 input
|
2007-02-09 22:24:49 +08:00
|
|
|
* Linux INET6 implementation
|
2005-04-17 06:20:36 +08:00
|
|
|
*
|
|
|
|
* Authors:
|
|
|
|
* Pedro Roque <roque@di.fc.ul.pt>
|
|
|
|
* Ian P. Morris <I.P.Morris@soton.ac.uk>
|
|
|
|
*
|
|
|
|
* Based in linux/net/ipv4/ip_input.c
|
|
|
|
*/
|
|
|
|
/* Changes
|
|
|
|
*
|
2014-08-25 04:53:10 +08:00
|
|
|
* Mitsuru KANDA @USAGI and
|
|
|
|
* YOSHIFUJI Hideaki @USAGI: Remove ipv6_parse_exthdrs().
|
2005-04-17 06:20:36 +08:00
|
|
|
*/
|
|
|
|
|
|
|
|
#include <linux/errno.h>
|
|
|
|
#include <linux/types.h>
|
|
|
|
#include <linux/socket.h>
|
|
|
|
#include <linux/sockios.h>
|
|
|
|
#include <linux/net.h>
|
|
|
|
#include <linux/netdevice.h>
|
|
|
|
#include <linux/in6.h>
|
|
|
|
#include <linux/icmpv6.h>
|
2008-04-03 08:22:53 +08:00
|
|
|
#include <linux/mroute6.h>
|
include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h
percpu.h is included by sched.h and module.h and thus ends up being
included when building most .c files. percpu.h includes slab.h which
in turn includes gfp.h making everything defined by the two files
universally available and complicating inclusion dependencies.
percpu.h -> slab.h dependency is about to be removed. Prepare for
this change by updating users of gfp and slab facilities include those
headers directly instead of assuming availability. As this conversion
needs to touch large number of source files, the following script is
used as the basis of conversion.
http://userweb.kernel.org/~tj/misc/slabh-sweep.py
The script does the followings.
* Scan files for gfp and slab usages and update includes such that
only the necessary includes are there. ie. if only gfp is used,
gfp.h, if slab is used, slab.h.
* When the script inserts a new include, it looks at the include
blocks and try to put the new include such that its order conforms
to its surrounding. It's put in the include block which contains
core kernel includes, in the same order that the rest are ordered -
alphabetical, Christmas tree, rev-Xmas-tree or at the end if there
doesn't seem to be any matching order.
* If the script can't find a place to put a new include (mostly
because the file doesn't have fitting include block), it prints out
an error message indicating which .h file needs to be added to the
file.
The conversion was done in the following steps.
1. The initial automatic conversion of all .c files updated slightly
over 4000 files, deleting around 700 includes and adding ~480 gfp.h
and ~3000 slab.h inclusions. The script emitted errors for ~400
files.
2. Each error was manually checked. Some didn't need the inclusion,
some needed manual addition while adding it to implementation .h or
embedding .c file was more appropriate for others. This step added
inclusions to around 150 files.
3. The script was run again and the output was compared to the edits
from #2 to make sure no file was left behind.
4. Several build tests were done and a couple of problems were fixed.
e.g. lib/decompress_*.c used malloc/free() wrappers around slab
APIs requiring slab.h to be added manually.
5. The script was run on all .h files but without automatically
editing them as sprinkling gfp.h and slab.h inclusions around .h
files could easily lead to inclusion dependency hell. Most gfp.h
inclusion directives were ignored as stuff from gfp.h was usually
wildly available and often used in preprocessor macros. Each
slab.h inclusion directive was examined and added manually as
necessary.
6. percpu.h was updated not to include slab.h.
7. Build test were done on the following configurations and failures
were fixed. CONFIG_GCOV_KERNEL was turned off for all tests (as my
distributed build env didn't work with gcov compiles) and a few
more options had to be turned off depending on archs to make things
build (like ipr on powerpc/64 which failed due to missing writeq).
* x86 and x86_64 UP and SMP allmodconfig and a custom test config.
* powerpc and powerpc64 SMP allmodconfig
* sparc and sparc64 SMP allmodconfig
* ia64 SMP allmodconfig
* s390 SMP allmodconfig
* alpha SMP allmodconfig
* um on x86_64 SMP allmodconfig
8. percpu.h modifications were reverted so that it could be applied as
a separate patch and serve as bisection point.
Given the fact that I had only a couple of failures from tests on step
6, I'm fairly confident about the coverage of this conversion patch.
If there is a breakage, it's likely to be something in one of the arch
headers which should be easily discoverable easily on most builds of
the specific arch.
Signed-off-by: Tejun Heo <tj@kernel.org>
Guess-its-ok-by: Christoph Lameter <cl@linux-foundation.org>
Cc: Ingo Molnar <mingo@redhat.com>
Cc: Lee Schermerhorn <Lee.Schermerhorn@hp.com>
2010-03-24 16:04:11 +08:00
|
|
|
#include <linux/slab.h>
|
2019-05-03 23:01:37 +08:00
|
|
|
#include <linux/indirect_call_wrapper.h>
|
2005-04-17 06:20:36 +08:00
|
|
|
|
|
|
|
#include <linux/netfilter.h>
|
|
|
|
#include <linux/netfilter_ipv6.h>
|
|
|
|
|
|
|
|
#include <net/sock.h>
|
|
|
|
#include <net/snmp.h>
|
2021-02-03 21:51:10 +08:00
|
|
|
#include <net/udp.h>
|
2005-04-17 06:20:36 +08:00
|
|
|
|
|
|
|
#include <net/ipv6.h>
|
|
|
|
#include <net/protocol.h>
|
|
|
|
#include <net/transp_v6.h>
|
|
|
|
#include <net/rawv6.h>
|
|
|
|
#include <net/ndisc.h>
|
|
|
|
#include <net/ip6_route.h>
|
|
|
|
#include <net/addrconf.h>
|
|
|
|
#include <net/xfrm.h>
|
2013-08-06 18:32:11 +08:00
|
|
|
#include <net/inet_ecn.h>
|
2015-07-23 09:13:12 +08:00
|
|
|
#include <net/dst_metadata.h>
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2019-05-03 23:01:38 +08:00
|
|
|
INDIRECT_CALLABLE_DECLARE(void tcp_v6_early_demux(struct sk_buff *));
|
2018-07-05 22:49:42 +08:00
|
|
|
static void ip6_rcv_finish_core(struct net *net, struct sock *sk,
|
|
|
|
struct sk_buff *skb)
|
2005-04-17 06:20:36 +08:00
|
|
|
{
|
2017-03-24 03:34:16 +08:00
|
|
|
void (*edemux)(struct sk_buff *skb);
|
|
|
|
|
2016-02-15 18:11:30 +08:00
|
|
|
if (net->ipv4.sysctl_ip_early_demux && !skb_dst(skb) && skb->sk == NULL) {
|
2012-07-26 20:18:11 +08:00
|
|
|
const struct inet6_protocol *ipprot;
|
|
|
|
|
|
|
|
ipprot = rcu_dereference(inet6_protos[ipv6_hdr(skb)->nexthdr]);
|
2017-03-24 03:34:16 +08:00
|
|
|
if (ipprot && (edemux = READ_ONCE(ipprot->early_demux)))
|
2019-05-03 23:01:38 +08:00
|
|
|
INDIRECT_CALL_2(edemux, tcp_v6_early_demux,
|
|
|
|
udp_v6_early_demux, skb);
|
2012-07-26 20:18:11 +08:00
|
|
|
}
|
2015-07-23 09:13:12 +08:00
|
|
|
if (!skb_valid_dst(skb))
|
2005-04-17 06:20:36 +08:00
|
|
|
ip6_route_input(skb);
|
2018-07-05 22:49:42 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
int ip6_rcv_finish(struct net *net, struct sock *sk, struct sk_buff *skb)
|
|
|
|
{
|
|
|
|
/* if ingress device is enslaved to an L3 master device pass the
|
|
|
|
* skb to its handler for processing
|
|
|
|
*/
|
|
|
|
skb = l3mdev_ip6_rcv(skb);
|
|
|
|
if (!skb)
|
|
|
|
return NET_RX_SUCCESS;
|
|
|
|
ip6_rcv_finish_core(net, sk, skb);
|
2005-04-17 06:20:36 +08:00
|
|
|
|
|
|
|
return dst_input(skb);
|
|
|
|
}
|
|
|
|
|
2018-07-05 22:49:42 +08:00
|
|
|
static void ip6_sublist_rcv_finish(struct list_head *head)
|
|
|
|
{
|
|
|
|
struct sk_buff *skb, *next;
|
|
|
|
|
2019-08-23 19:33:03 +08:00
|
|
|
list_for_each_entry_safe(skb, next, head, list) {
|
|
|
|
skb_list_del_init(skb);
|
2018-07-05 22:49:42 +08:00
|
|
|
dst_input(skb);
|
2019-08-23 19:33:03 +08:00
|
|
|
}
|
2018-07-05 22:49:42 +08:00
|
|
|
}
|
|
|
|
|
2019-11-20 20:47:35 +08:00
|
|
|
static bool ip6_can_use_hint(const struct sk_buff *skb,
|
|
|
|
const struct sk_buff *hint)
|
|
|
|
{
|
|
|
|
return hint && !skb_dst(skb) &&
|
|
|
|
ipv6_addr_equal(&ipv6_hdr(hint)->daddr, &ipv6_hdr(skb)->daddr);
|
|
|
|
}
|
|
|
|
|
|
|
|
static struct sk_buff *ip6_extract_route_hint(const struct net *net,
|
|
|
|
struct sk_buff *skb)
|
|
|
|
{
|
|
|
|
if (fib6_routes_require_src(net) || fib6_has_custom_rules(net))
|
|
|
|
return NULL;
|
|
|
|
|
|
|
|
return skb;
|
|
|
|
}
|
|
|
|
|
2018-07-05 22:49:42 +08:00
|
|
|
static void ip6_list_rcv_finish(struct net *net, struct sock *sk,
|
|
|
|
struct list_head *head)
|
|
|
|
{
|
2019-11-20 20:47:35 +08:00
|
|
|
struct sk_buff *skb, *next, *hint = NULL;
|
2018-07-05 22:49:42 +08:00
|
|
|
struct dst_entry *curr_dst = NULL;
|
|
|
|
struct list_head sublist;
|
|
|
|
|
|
|
|
INIT_LIST_HEAD(&sublist);
|
|
|
|
list_for_each_entry_safe(skb, next, head, list) {
|
|
|
|
struct dst_entry *dst;
|
|
|
|
|
2018-12-05 01:37:57 +08:00
|
|
|
skb_list_del_init(skb);
|
2018-07-05 22:49:42 +08:00
|
|
|
/* if ingress device is enslaved to an L3 master device pass the
|
|
|
|
* skb to its handler for processing
|
|
|
|
*/
|
|
|
|
skb = l3mdev_ip6_rcv(skb);
|
|
|
|
if (!skb)
|
|
|
|
continue;
|
2019-11-20 20:47:35 +08:00
|
|
|
|
|
|
|
if (ip6_can_use_hint(skb, hint))
|
|
|
|
skb_dst_copy(skb, hint);
|
|
|
|
else
|
|
|
|
ip6_rcv_finish_core(net, sk, skb);
|
2018-07-05 22:49:42 +08:00
|
|
|
dst = skb_dst(skb);
|
|
|
|
if (curr_dst != dst) {
|
2019-11-20 20:47:35 +08:00
|
|
|
hint = ip6_extract_route_hint(net, skb);
|
|
|
|
|
2018-07-05 22:49:42 +08:00
|
|
|
/* dispatch old sublist */
|
|
|
|
if (!list_empty(&sublist))
|
|
|
|
ip6_sublist_rcv_finish(&sublist);
|
|
|
|
/* start new sublist */
|
|
|
|
INIT_LIST_HEAD(&sublist);
|
|
|
|
curr_dst = dst;
|
|
|
|
}
|
|
|
|
list_add_tail(&skb->list, &sublist);
|
|
|
|
}
|
|
|
|
/* dispatch final sublist */
|
|
|
|
ip6_sublist_rcv_finish(&sublist);
|
|
|
|
}
|
|
|
|
|
|
|
|
static struct sk_buff *ip6_rcv_core(struct sk_buff *skb, struct net_device *dev,
|
|
|
|
struct net *net)
|
2005-04-17 06:20:36 +08:00
|
|
|
{
|
2011-04-22 12:53:02 +08:00
|
|
|
const struct ipv6hdr *hdr;
|
2014-08-25 04:53:10 +08:00
|
|
|
u32 pkt_len;
|
2006-11-04 19:11:37 +08:00
|
|
|
struct inet6_dev *idev;
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2006-11-04 19:11:37 +08:00
|
|
|
if (skb->pkt_type == PACKET_OTHERHOST) {
|
|
|
|
kfree_skb(skb);
|
2018-07-05 22:49:42 +08:00
|
|
|
return NULL;
|
2006-11-04 19:11:37 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
rcu_read_lock();
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2006-11-04 19:11:37 +08:00
|
|
|
idev = __in6_dev_get(skb->dev);
|
|
|
|
|
2016-04-28 07:44:41 +08:00
|
|
|
__IP6_UPD_PO_STATS(net, idev, IPSTATS_MIB_IN, skb->len);
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2008-06-28 13:17:11 +08:00
|
|
|
if ((skb = skb_share_check(skb, GFP_ATOMIC)) == NULL ||
|
|
|
|
!idev || unlikely(idev->cnf.disable_ipv6)) {
|
2016-04-28 07:44:40 +08:00
|
|
|
__IP6_INC_STATS(net, idev, IPSTATS_MIB_INDISCARDS);
|
2009-03-27 15:17:45 +08:00
|
|
|
goto drop;
|
2005-04-17 06:20:36 +08:00
|
|
|
}
|
|
|
|
|
2006-07-25 14:44:44 +08:00
|
|
|
memset(IP6CB(skb), 0, sizeof(struct inet6_skb_parm));
|
|
|
|
|
2005-04-17 06:20:36 +08:00
|
|
|
/*
|
|
|
|
* Store incoming device index. When the packet will
|
|
|
|
* be queued, we cannot refer to skb->dev anymore.
|
|
|
|
*
|
|
|
|
* BTW, when we send a packet for our own local address on a
|
|
|
|
* non-loopback interface (e.g. ethX), it is being delivered
|
2007-09-26 10:16:28 +08:00
|
|
|
* via the loopback interface (lo) here; skb->dev = loopback_dev.
|
2005-04-17 06:20:36 +08:00
|
|
|
* It, however, should be considered as if it is being
|
|
|
|
* arrived via the sending interface (ethX), because of the
|
|
|
|
* nature of scoping architecture. --yoshfuji
|
|
|
|
*/
|
2015-07-23 09:13:12 +08:00
|
|
|
IP6CB(skb)->iif = skb_valid_dst(skb) ? ip6_dst_idev(skb_dst(skb))->dev->ifindex : dev->ifindex;
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2006-07-01 04:35:46 +08:00
|
|
|
if (unlikely(!pskb_may_pull(skb, sizeof(*hdr))))
|
2005-04-17 06:20:36 +08:00
|
|
|
goto err;
|
|
|
|
|
2007-04-26 08:54:47 +08:00
|
|
|
hdr = ipv6_hdr(skb);
|
2005-04-17 06:20:36 +08:00
|
|
|
|
|
|
|
if (hdr->version != 6)
|
|
|
|
goto err;
|
|
|
|
|
2016-04-28 07:44:40 +08:00
|
|
|
__IP6_ADD_STATS(net, idev,
|
|
|
|
IPSTATS_MIB_NOECTPKTS +
|
2013-08-06 18:32:11 +08:00
|
|
|
(ipv6_get_dsfield(hdr) & INET_ECN_MASK),
|
2016-04-28 07:44:40 +08:00
|
|
|
max_t(unsigned short, 1, skb_shinfo(skb)->gso_segs));
|
2008-06-20 07:33:57 +08:00
|
|
|
/*
|
|
|
|
* RFC4291 2.5.3
|
2017-04-15 02:22:43 +08:00
|
|
|
* The loopback address must not be used as the source address in IPv6
|
|
|
|
* packets that are sent outside of a single node. [..]
|
2008-06-20 07:33:57 +08:00
|
|
|
* A packet received on an interface with a destination address
|
|
|
|
* of loopback must be dropped.
|
|
|
|
*/
|
2017-04-15 02:22:43 +08:00
|
|
|
if ((ipv6_addr_loopback(&hdr->saddr) ||
|
|
|
|
ipv6_addr_loopback(&hdr->daddr)) &&
|
2018-09-19 20:56:53 +08:00
|
|
|
!(dev->flags & IFF_LOOPBACK) &&
|
|
|
|
!netif_is_l3_master(dev))
|
2008-06-20 07:33:57 +08:00
|
|
|
goto err;
|
|
|
|
|
2013-03-26 16:13:34 +08:00
|
|
|
/* RFC4291 Errata ID: 3480
|
|
|
|
* Interface-Local scope spans only a single interface on a
|
|
|
|
* node and is useful only for loopback transmission of
|
|
|
|
* multicast. Packets with interface-local scope received
|
|
|
|
* from another node must be discarded.
|
|
|
|
*/
|
|
|
|
if (!(skb->pkt_type == PACKET_LOOPBACK ||
|
|
|
|
dev->flags & IFF_LOOPBACK) &&
|
|
|
|
ipv6_addr_is_multicast(&hdr->daddr) &&
|
|
|
|
IPV6_ADDR_MC_SCOPE(&hdr->daddr) == 1)
|
|
|
|
goto err;
|
|
|
|
|
2016-02-04 20:31:19 +08:00
|
|
|
/* If enabled, drop unicast packets that were encapsulated in link-layer
|
|
|
|
* multicast or broadcast to protected against the so-called "hole-196"
|
|
|
|
* attack in 802.11 wireless.
|
|
|
|
*/
|
|
|
|
if (!ipv6_addr_is_multicast(&hdr->daddr) &&
|
|
|
|
(skb->pkt_type == PACKET_BROADCAST ||
|
|
|
|
skb->pkt_type == PACKET_MULTICAST) &&
|
|
|
|
idev->cnf.drop_unicast_in_l2_multicast)
|
|
|
|
goto err;
|
|
|
|
|
2013-02-10 13:35:22 +08:00
|
|
|
/* RFC4291 2.7
|
|
|
|
* Nodes must not originate a packet to a multicast address whose scope
|
|
|
|
* field contains the reserved value 0; if such a packet is received, it
|
|
|
|
* must be silently dropped.
|
|
|
|
*/
|
|
|
|
if (ipv6_addr_is_multicast(&hdr->daddr) &&
|
|
|
|
IPV6_ADDR_MC_SCOPE(&hdr->daddr) == 0)
|
|
|
|
goto err;
|
|
|
|
|
2011-11-08 12:41:42 +08:00
|
|
|
/*
|
|
|
|
* RFC4291 2.7
|
|
|
|
* Multicast addresses must not be used as source addresses in IPv6
|
|
|
|
* packets or appear in any Routing header.
|
|
|
|
*/
|
|
|
|
if (ipv6_addr_is_multicast(&hdr->saddr))
|
|
|
|
goto err;
|
|
|
|
|
2007-04-11 12:21:55 +08:00
|
|
|
skb->transport_header = skb->network_header + sizeof(*hdr);
|
2006-01-07 15:02:34 +08:00
|
|
|
IP6CB(skb)->nhoff = offsetof(struct ipv6hdr, nexthdr);
|
|
|
|
|
2005-04-17 06:20:36 +08:00
|
|
|
pkt_len = ntohs(hdr->payload_len);
|
|
|
|
|
|
|
|
/* pkt_len may be zero if Jumbo payload option is present */
|
|
|
|
if (pkt_len || hdr->nexthdr != NEXTHDR_HOP) {
|
2007-04-05 14:54:59 +08:00
|
|
|
if (pkt_len + sizeof(struct ipv6hdr) > skb->len) {
|
2016-04-28 07:44:40 +08:00
|
|
|
__IP6_INC_STATS(net,
|
|
|
|
idev, IPSTATS_MIB_INTRUNCATEDPKTS);
|
2007-04-05 14:54:59 +08:00
|
|
|
goto drop;
|
|
|
|
}
|
2005-04-17 06:20:36 +08:00
|
|
|
if (pskb_trim_rcsum(skb, pkt_len + sizeof(struct ipv6hdr))) {
|
2016-04-28 07:44:40 +08:00
|
|
|
__IP6_INC_STATS(net, idev, IPSTATS_MIB_INHDRERRORS);
|
2005-04-17 06:20:36 +08:00
|
|
|
goto drop;
|
|
|
|
}
|
2007-04-26 08:54:47 +08:00
|
|
|
hdr = ipv6_hdr(skb);
|
2005-04-17 06:20:36 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
if (hdr->nexthdr == NEXTHDR_HOP) {
|
2007-10-16 03:50:28 +08:00
|
|
|
if (ipv6_parse_hopopts(skb) < 0) {
|
2016-04-28 07:44:40 +08:00
|
|
|
__IP6_INC_STATS(net, idev, IPSTATS_MIB_INHDRERRORS);
|
2006-11-04 19:11:37 +08:00
|
|
|
rcu_read_unlock();
|
2018-07-05 22:49:42 +08:00
|
|
|
return NULL;
|
2005-04-17 06:20:36 +08:00
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2006-11-04 19:11:37 +08:00
|
|
|
rcu_read_unlock();
|
|
|
|
|
2009-06-27 10:22:37 +08:00
|
|
|
/* Must drop socket now because of tproxy. */
|
2020-03-30 06:53:38 +08:00
|
|
|
if (!skb_sk_is_prefetched(skb))
|
|
|
|
skb_orphan(skb);
|
2009-06-27 10:22:37 +08:00
|
|
|
|
2018-07-05 22:49:42 +08:00
|
|
|
return skb;
|
2005-04-17 06:20:36 +08:00
|
|
|
err:
|
2016-04-28 07:44:40 +08:00
|
|
|
__IP6_INC_STATS(net, idev, IPSTATS_MIB_INHDRERRORS);
|
2005-04-17 06:20:36 +08:00
|
|
|
drop:
|
2006-11-04 19:11:37 +08:00
|
|
|
rcu_read_unlock();
|
2005-04-17 06:20:36 +08:00
|
|
|
kfree_skb(skb);
|
2018-07-05 22:49:42 +08:00
|
|
|
return NULL;
|
|
|
|
}
|
|
|
|
|
|
|
|
int ipv6_rcv(struct sk_buff *skb, struct net_device *dev, struct packet_type *pt, struct net_device *orig_dev)
|
|
|
|
{
|
|
|
|
struct net *net = dev_net(skb->dev);
|
|
|
|
|
|
|
|
skb = ip6_rcv_core(skb, dev, net);
|
|
|
|
if (skb == NULL)
|
|
|
|
return NET_RX_DROP;
|
|
|
|
return NF_HOOK(NFPROTO_IPV6, NF_INET_PRE_ROUTING,
|
|
|
|
net, NULL, skb, dev, NULL,
|
|
|
|
ip6_rcv_finish);
|
|
|
|
}
|
|
|
|
|
|
|
|
static void ip6_sublist_rcv(struct list_head *head, struct net_device *dev,
|
|
|
|
struct net *net)
|
|
|
|
{
|
|
|
|
NF_HOOK_LIST(NFPROTO_IPV6, NF_INET_PRE_ROUTING, net, NULL,
|
|
|
|
head, dev, NULL, ip6_rcv_finish);
|
|
|
|
ip6_list_rcv_finish(net, NULL, head);
|
|
|
|
}
|
|
|
|
|
|
|
|
/* Receive a list of IPv6 packets */
|
|
|
|
void ipv6_list_rcv(struct list_head *head, struct packet_type *pt,
|
|
|
|
struct net_device *orig_dev)
|
|
|
|
{
|
|
|
|
struct net_device *curr_dev = NULL;
|
|
|
|
struct net *curr_net = NULL;
|
|
|
|
struct sk_buff *skb, *next;
|
|
|
|
struct list_head sublist;
|
|
|
|
|
|
|
|
INIT_LIST_HEAD(&sublist);
|
|
|
|
list_for_each_entry_safe(skb, next, head, list) {
|
|
|
|
struct net_device *dev = skb->dev;
|
|
|
|
struct net *net = dev_net(dev);
|
|
|
|
|
2018-12-05 01:37:57 +08:00
|
|
|
skb_list_del_init(skb);
|
2018-07-05 22:49:42 +08:00
|
|
|
skb = ip6_rcv_core(skb, dev, net);
|
|
|
|
if (skb == NULL)
|
|
|
|
continue;
|
|
|
|
|
|
|
|
if (curr_dev != dev || curr_net != net) {
|
|
|
|
/* dispatch old sublist */
|
|
|
|
if (!list_empty(&sublist))
|
|
|
|
ip6_sublist_rcv(&sublist, curr_dev, curr_net);
|
|
|
|
/* start new sublist */
|
|
|
|
INIT_LIST_HEAD(&sublist);
|
|
|
|
curr_dev = dev;
|
|
|
|
curr_net = net;
|
|
|
|
}
|
|
|
|
list_add_tail(&skb->list, &sublist);
|
|
|
|
}
|
|
|
|
/* dispatch final sublist */
|
inet: do not call sublist_rcv on empty list
syzbot triggered struct net NULL deref in NF_HOOK_LIST:
RIP: 0010:NF_HOOK_LIST include/linux/netfilter.h:331 [inline]
RIP: 0010:ip6_sublist_rcv+0x5c9/0x930 net/ipv6/ip6_input.c:292
ipv6_list_rcv+0x373/0x4b0 net/ipv6/ip6_input.c:328
__netif_receive_skb_list_ptype net/core/dev.c:5274 [inline]
Reason:
void ipv6_list_rcv(struct list_head *head, struct packet_type *pt,
struct net_device *orig_dev)
[..]
list_for_each_entry_safe(skb, next, head, list) {
/* iterates list */
skb = ip6_rcv_core(skb, dev, net);
/* ip6_rcv_core drops skb -> NULL is returned */
if (skb == NULL)
continue;
[..]
}
/* sublist is empty -> curr_net is NULL */
ip6_sublist_rcv(&sublist, curr_dev, curr_net);
Before the recent change NF_HOOK_LIST did a list iteration before
struct net deref, i.e. it was a no-op in the empty list case.
List iteration now happens after *net deref, causing crash.
Follow the same pattern as the ip(v6)_list_rcv loop and add a list_empty
test for the final sublist dispatch too.
Cc: Edward Cree <ecree@solarflare.com>
Reported-by: syzbot+c54f457cad330e57e967@syzkaller.appspotmail.com
Fixes: ca58fbe06c54 ("netfilter: add and use nf_hook_slow_list()")
Signed-off-by: Florian Westphal <fw@strlen.de>
Tested-by: Leon Romanovsky <leonro@mellanox.com>
Tested-by: Nikolay Aleksandrov <nikolay@cumulusnetworks.com>
Signed-off-by: David S. Miller <davem@davemloft.net>
2019-10-29 08:44:04 +08:00
|
|
|
if (!list_empty(&sublist))
|
|
|
|
ip6_sublist_rcv(&sublist, curr_dev, curr_net);
|
2005-04-17 06:20:36 +08:00
|
|
|
}
|
|
|
|
|
2019-05-03 23:01:37 +08:00
|
|
|
INDIRECT_CALLABLE_DECLARE(int tcp_v6_rcv(struct sk_buff *));
|
|
|
|
|
2005-04-17 06:20:36 +08:00
|
|
|
/*
|
|
|
|
* Deliver the packet to the host
|
|
|
|
*/
|
2018-11-07 19:38:32 +08:00
|
|
|
void ip6_protocol_deliver_rcu(struct net *net, struct sk_buff *skb, int nexthdr,
|
|
|
|
bool have_final)
|
2005-04-17 06:20:36 +08:00
|
|
|
{
|
2009-09-14 20:22:28 +08:00
|
|
|
const struct inet6_protocol *ipprot;
|
2012-06-20 09:56:21 +08:00
|
|
|
struct inet6_dev *idev;
|
2005-04-17 06:20:36 +08:00
|
|
|
unsigned int nhoff;
|
2012-05-19 02:57:34 +08:00
|
|
|
bool raw;
|
2005-04-17 06:20:36 +08:00
|
|
|
|
|
|
|
/*
|
|
|
|
* Parse extension headers
|
|
|
|
*/
|
|
|
|
|
2015-06-11 06:29:31 +08:00
|
|
|
resubmit:
|
2009-06-02 13:19:30 +08:00
|
|
|
idev = ip6_dst_idev(skb_dst(skb));
|
2006-01-07 15:02:34 +08:00
|
|
|
nhoff = IP6CB(skb)->nhoff;
|
2018-11-07 19:38:32 +08:00
|
|
|
if (!have_final) {
|
|
|
|
if (!pskb_pull(skb, skb_transport_offset(skb)))
|
|
|
|
goto discard;
|
|
|
|
nexthdr = skb_network_header(skb)[nhoff];
|
|
|
|
}
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2016-05-19 00:06:11 +08:00
|
|
|
resubmit_final:
|
2007-11-20 14:35:57 +08:00
|
|
|
raw = raw6_local_deliver(skb, nexthdr);
|
2014-11-24 05:28:43 +08:00
|
|
|
ipprot = rcu_dereference(inet6_protos[nexthdr]);
|
2015-03-29 21:00:05 +08:00
|
|
|
if (ipprot) {
|
2005-04-17 06:20:36 +08:00
|
|
|
int ret;
|
2007-02-09 22:24:49 +08:00
|
|
|
|
2016-05-19 00:06:12 +08:00
|
|
|
if (have_final) {
|
|
|
|
if (!(ipprot->flags & INET6_PROTO_FINAL)) {
|
|
|
|
/* Once we've seen a final protocol don't
|
|
|
|
* allow encapsulation on any non-final
|
|
|
|
* ones. This allows foo in UDP encapsulation
|
|
|
|
* to work.
|
|
|
|
*/
|
|
|
|
goto discard;
|
|
|
|
}
|
|
|
|
} else if (ipprot->flags & INET6_PROTO_FINAL) {
|
2011-04-22 12:53:02 +08:00
|
|
|
const struct ipv6hdr *hdr;
|
2018-11-07 23:36:09 +08:00
|
|
|
int sdif = inet6_sdif(skb);
|
|
|
|
struct net_device *dev;
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2016-05-19 00:06:12 +08:00
|
|
|
/* Only do this once for first final protocol */
|
|
|
|
have_final = true;
|
|
|
|
|
[NETFILTER]: Add nf_conntrack subsystem.
The existing connection tracking subsystem in netfilter can only
handle ipv4. There were basically two choices present to add
connection tracking support for ipv6. We could either duplicate all
of the ipv4 connection tracking code into an ipv6 counterpart, or (the
choice taken by these patches) we could design a generic layer that
could handle both ipv4 and ipv6 and thus requiring only one sub-protocol
(TCP, UDP, etc.) connection tracking helper module to be written.
In fact nf_conntrack is capable of working with any layer 3
protocol.
The existing ipv4 specific conntrack code could also not deal
with the pecularities of doing connection tracking on ipv6,
which is also cured here. For example, these issues include:
1) ICMPv6 handling, which is used for neighbour discovery in
ipv6 thus some messages such as these should not participate
in connection tracking since effectively they are like ARP
messages
2) fragmentation must be handled differently in ipv6, because
the simplistic "defrag, connection track and NAT, refrag"
(which the existing ipv4 connection tracking does) approach simply
isn't feasible in ipv6
3) ipv6 extension header parsing must occur at the correct spots
before and after connection tracking decisions, and there were
no provisions for this in the existing connection tracking
design
4) ipv6 has no need for stateful NAT
The ipv4 specific conntrack layer is kept around, until all of
the ipv4 specific conntrack helpers are ported over to nf_conntrack
and it is feature complete. Once that occurs, the old conntrack
stuff will get placed into the feature-removal-schedule and we will
fully kill it off 6 months later.
Signed-off-by: Yasuyuki Kozakai <yasuyuki.kozakai@toshiba.co.jp>
Signed-off-by: Harald Welte <laforge@netfilter.org>
Signed-off-by: Arnaldo Carvalho de Melo <acme@mandriva.com>
2005-11-10 08:38:16 +08:00
|
|
|
/* Free reference early: we don't need it any more,
|
|
|
|
and it may hold ip_conntrack module loaded
|
|
|
|
indefinitely. */
|
2019-09-30 02:54:03 +08:00
|
|
|
nf_reset_ct(skb);
|
[NETFILTER]: Add nf_conntrack subsystem.
The existing connection tracking subsystem in netfilter can only
handle ipv4. There were basically two choices present to add
connection tracking support for ipv6. We could either duplicate all
of the ipv4 connection tracking code into an ipv6 counterpart, or (the
choice taken by these patches) we could design a generic layer that
could handle both ipv4 and ipv6 and thus requiring only one sub-protocol
(TCP, UDP, etc.) connection tracking helper module to be written.
In fact nf_conntrack is capable of working with any layer 3
protocol.
The existing ipv4 specific conntrack code could also not deal
with the pecularities of doing connection tracking on ipv6,
which is also cured here. For example, these issues include:
1) ICMPv6 handling, which is used for neighbour discovery in
ipv6 thus some messages such as these should not participate
in connection tracking since effectively they are like ARP
messages
2) fragmentation must be handled differently in ipv6, because
the simplistic "defrag, connection track and NAT, refrag"
(which the existing ipv4 connection tracking does) approach simply
isn't feasible in ipv6
3) ipv6 extension header parsing must occur at the correct spots
before and after connection tracking decisions, and there were
no provisions for this in the existing connection tracking
design
4) ipv6 has no need for stateful NAT
The ipv4 specific conntrack layer is kept around, until all of
the ipv4 specific conntrack helpers are ported over to nf_conntrack
and it is feature complete. Once that occurs, the old conntrack
stuff will get placed into the feature-removal-schedule and we will
fully kill it off 6 months later.
Signed-off-by: Yasuyuki Kozakai <yasuyuki.kozakai@toshiba.co.jp>
Signed-off-by: Harald Welte <laforge@netfilter.org>
Signed-off-by: Arnaldo Carvalho de Melo <acme@mandriva.com>
2005-11-10 08:38:16 +08:00
|
|
|
|
2007-04-11 11:50:43 +08:00
|
|
|
skb_postpull_rcsum(skb, skb_network_header(skb),
|
2007-03-17 04:26:39 +08:00
|
|
|
skb_network_header_len(skb));
|
2007-04-26 08:54:47 +08:00
|
|
|
hdr = ipv6_hdr(skb);
|
2018-11-07 23:36:09 +08:00
|
|
|
|
|
|
|
/* skb->dev passed may be master dev for vrfs. */
|
|
|
|
if (sdif) {
|
|
|
|
dev = dev_get_by_index_rcu(net, sdif);
|
|
|
|
if (!dev)
|
|
|
|
goto discard;
|
|
|
|
} else {
|
|
|
|
dev = skb->dev;
|
|
|
|
}
|
|
|
|
|
2005-04-17 06:20:36 +08:00
|
|
|
if (ipv6_addr_is_multicast(&hdr->daddr) &&
|
2018-11-07 23:36:09 +08:00
|
|
|
!ipv6_chk_mcast_addr(dev, &hdr->daddr,
|
|
|
|
&hdr->saddr) &&
|
2013-01-13 13:02:18 +08:00
|
|
|
!ipv6_is_mld(skb, nexthdr, skb_network_header_len(skb)))
|
2005-04-17 06:20:36 +08:00
|
|
|
goto discard;
|
|
|
|
}
|
|
|
|
if (!(ipprot->flags & INET6_PROTO_NOPOLICY) &&
|
2007-02-09 22:24:49 +08:00
|
|
|
!xfrm6_policy_check(NULL, XFRM_POLICY_IN, skb))
|
2005-04-17 06:20:36 +08:00
|
|
|
goto discard;
|
2007-02-09 22:24:49 +08:00
|
|
|
|
2019-05-03 23:01:37 +08:00
|
|
|
ret = INDIRECT_CALL_2(ipprot->handler, tcp_v6_rcv, udpv6_rcv,
|
|
|
|
skb);
|
2016-05-19 00:06:11 +08:00
|
|
|
if (ret > 0) {
|
|
|
|
if (ipprot->flags & INET6_PROTO_FINAL) {
|
|
|
|
/* Not an extension header, most likely UDP
|
|
|
|
* encapsulation. Use return value as nexthdr
|
|
|
|
* protocol not nhoff (which presumably is
|
|
|
|
* not set by handler).
|
|
|
|
*/
|
|
|
|
nexthdr = ret;
|
|
|
|
goto resubmit_final;
|
|
|
|
} else {
|
|
|
|
goto resubmit;
|
|
|
|
}
|
|
|
|
} else if (ret == 0) {
|
2016-04-28 07:44:40 +08:00
|
|
|
__IP6_INC_STATS(net, idev, IPSTATS_MIB_INDELIVERS);
|
2016-05-19 00:06:11 +08:00
|
|
|
}
|
2005-04-17 06:20:36 +08:00
|
|
|
} else {
|
2007-11-20 14:35:57 +08:00
|
|
|
if (!raw) {
|
2005-04-17 06:20:36 +08:00
|
|
|
if (xfrm6_policy_check(NULL, XFRM_POLICY_IN, skb)) {
|
2016-04-28 07:44:40 +08:00
|
|
|
__IP6_INC_STATS(net, idev,
|
|
|
|
IPSTATS_MIB_INUNKNOWNPROTOS);
|
2005-08-17 12:03:41 +08:00
|
|
|
icmpv6_send(skb, ICMPV6_PARAMPROB,
|
2010-02-18 16:25:24 +08:00
|
|
|
ICMPV6_UNK_NEXTHDR, nhoff);
|
2005-04-17 06:20:36 +08:00
|
|
|
}
|
2013-03-01 15:44:08 +08:00
|
|
|
kfree_skb(skb);
|
|
|
|
} else {
|
2016-04-28 07:44:40 +08:00
|
|
|
__IP6_INC_STATS(net, idev, IPSTATS_MIB_INDELIVERS);
|
2013-03-01 15:44:08 +08:00
|
|
|
consume_skb(skb);
|
|
|
|
}
|
2005-04-17 06:20:36 +08:00
|
|
|
}
|
2018-11-07 19:38:32 +08:00
|
|
|
return;
|
2005-04-17 06:20:36 +08:00
|
|
|
|
|
|
|
discard:
|
2016-04-28 07:44:40 +08:00
|
|
|
__IP6_INC_STATS(net, idev, IPSTATS_MIB_INDISCARDS);
|
2005-04-17 06:20:36 +08:00
|
|
|
kfree_skb(skb);
|
2018-11-07 19:38:32 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
static int ip6_input_finish(struct net *net, struct sock *sk, struct sk_buff *skb)
|
|
|
|
{
|
|
|
|
rcu_read_lock();
|
|
|
|
ip6_protocol_deliver_rcu(net, skb, 0, false);
|
|
|
|
rcu_read_unlock();
|
|
|
|
|
2005-04-17 06:20:36 +08:00
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
|
|
int ip6_input(struct sk_buff *skb)
|
|
|
|
{
|
2015-09-16 09:04:16 +08:00
|
|
|
return NF_HOOK(NFPROTO_IPV6, NF_INET_LOCAL_IN,
|
|
|
|
dev_net(skb->dev), NULL, skb, skb->dev, NULL,
|
2007-11-20 10:53:30 +08:00
|
|
|
ip6_input_finish);
|
2005-04-17 06:20:36 +08:00
|
|
|
}
|
2016-06-07 11:50:40 +08:00
|
|
|
EXPORT_SYMBOL_GPL(ip6_input);
|
2005-04-17 06:20:36 +08:00
|
|
|
|
|
|
|
int ip6_mc_input(struct sk_buff *skb)
|
|
|
|
{
|
2018-11-07 23:36:09 +08:00
|
|
|
int sdif = inet6_sdif(skb);
|
2011-04-22 12:53:02 +08:00
|
|
|
const struct ipv6hdr *hdr;
|
2018-11-07 23:36:09 +08:00
|
|
|
struct net_device *dev;
|
2012-05-19 02:57:34 +08:00
|
|
|
bool deliver;
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2016-04-28 07:44:41 +08:00
|
|
|
__IP6_UPD_PO_STATS(dev_net(skb_dst(skb)->dev),
|
2018-04-17 01:42:16 +08:00
|
|
|
__in6_dev_get_safely(skb->dev), IPSTATS_MIB_INMCAST,
|
2009-04-27 17:45:02 +08:00
|
|
|
skb->len);
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2018-11-07 23:36:09 +08:00
|
|
|
/* skb->dev passed may be master dev for vrfs. */
|
|
|
|
if (sdif) {
|
|
|
|
rcu_read_lock();
|
|
|
|
dev = dev_get_by_index_rcu(dev_net(skb->dev), sdif);
|
|
|
|
if (!dev) {
|
|
|
|
rcu_read_unlock();
|
|
|
|
kfree_skb(skb);
|
|
|
|
return -ENODEV;
|
|
|
|
}
|
|
|
|
} else {
|
|
|
|
dev = skb->dev;
|
|
|
|
}
|
|
|
|
|
2007-04-26 08:54:47 +08:00
|
|
|
hdr = ipv6_hdr(skb);
|
2018-11-07 23:36:09 +08:00
|
|
|
deliver = ipv6_chk_mcast_addr(dev, &hdr->daddr, NULL);
|
|
|
|
if (sdif)
|
|
|
|
rcu_read_unlock();
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2008-04-03 08:22:53 +08:00
|
|
|
#ifdef CONFIG_IPV6_MROUTE
|
2005-04-17 06:20:36 +08:00
|
|
|
/*
|
2008-04-03 08:22:53 +08:00
|
|
|
* IPv6 multicast router mode is now supported ;)
|
2005-04-17 06:20:36 +08:00
|
|
|
*/
|
2008-07-20 13:35:03 +08:00
|
|
|
if (dev_net(skb->dev)->ipv6.devconf_all->mc_forwarding &&
|
2013-03-08 10:07:23 +08:00
|
|
|
!(ipv6_addr_type(&hdr->daddr) &
|
|
|
|
(IPV6_ADDR_LOOPBACK|IPV6_ADDR_LINKLOCAL)) &&
|
2008-04-03 08:22:53 +08:00
|
|
|
likely(!(IP6CB(skb)->flags & IP6SKB_FORWARDED))) {
|
|
|
|
/*
|
|
|
|
* Okay, we try to forward - split and duplicate
|
|
|
|
* packets.
|
|
|
|
*/
|
|
|
|
struct sk_buff *skb2;
|
|
|
|
struct inet6_skb_parm *opt = IP6CB(skb);
|
|
|
|
|
|
|
|
/* Check for MLD */
|
2013-01-13 13:02:45 +08:00
|
|
|
if (unlikely(opt->flags & IP6SKB_ROUTERALERT)) {
|
2008-04-03 08:22:53 +08:00
|
|
|
/* Check if this is a mld message */
|
|
|
|
u8 nexthdr = hdr->nexthdr;
|
2011-12-01 09:05:51 +08:00
|
|
|
__be16 frag_off;
|
2008-04-03 08:22:53 +08:00
|
|
|
int offset;
|
|
|
|
|
|
|
|
/* Check if the value of Router Alert
|
|
|
|
* is for MLD (0x0000).
|
|
|
|
*/
|
2013-01-13 13:02:45 +08:00
|
|
|
if (opt->ra == htons(IPV6_OPT_ROUTERALERT_MLD)) {
|
2012-05-19 02:57:34 +08:00
|
|
|
deliver = false;
|
2008-04-10 14:41:26 +08:00
|
|
|
|
2008-04-03 08:22:53 +08:00
|
|
|
if (!ipv6_ext_hdr(nexthdr)) {
|
|
|
|
/* BUG */
|
2008-04-10 14:41:26 +08:00
|
|
|
goto out;
|
2008-04-03 08:22:53 +08:00
|
|
|
}
|
|
|
|
offset = ipv6_skip_exthdr(skb, sizeof(*hdr),
|
2011-12-01 09:05:51 +08:00
|
|
|
&nexthdr, &frag_off);
|
2008-04-03 08:22:53 +08:00
|
|
|
if (offset < 0)
|
2008-04-10 14:41:26 +08:00
|
|
|
goto out;
|
2008-04-03 08:22:53 +08:00
|
|
|
|
2015-07-03 10:40:52 +08:00
|
|
|
if (ipv6_is_mld(skb, nexthdr, offset))
|
|
|
|
deliver = true;
|
2008-04-03 08:22:53 +08:00
|
|
|
|
2015-07-03 10:40:52 +08:00
|
|
|
goto out;
|
2008-04-03 08:22:53 +08:00
|
|
|
}
|
|
|
|
/* unknown RA - process it normally */
|
|
|
|
}
|
2005-04-17 06:20:36 +08:00
|
|
|
|
2008-04-03 08:22:53 +08:00
|
|
|
if (deliver)
|
|
|
|
skb2 = skb_clone(skb, GFP_ATOMIC);
|
|
|
|
else {
|
|
|
|
skb2 = skb;
|
|
|
|
skb = NULL;
|
|
|
|
}
|
2007-02-09 22:24:49 +08:00
|
|
|
|
2008-04-03 08:22:53 +08:00
|
|
|
if (skb2) {
|
|
|
|
ip6_mr_input(skb2);
|
2005-04-17 06:20:36 +08:00
|
|
|
}
|
|
|
|
}
|
2008-04-03 08:22:53 +08:00
|
|
|
out:
|
2008-04-10 14:41:26 +08:00
|
|
|
#endif
|
|
|
|
if (likely(deliver))
|
2005-04-17 06:20:36 +08:00
|
|
|
ip6_input(skb);
|
2008-04-10 14:41:26 +08:00
|
|
|
else {
|
|
|
|
/* discard */
|
|
|
|
kfree_skb(skb);
|
2005-04-17 06:20:36 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
return 0;
|
|
|
|
}
|