[Bug 183851] New: pci(e) ethernet nonworking when without acpi=off when using pcie-switch based eth card

[b***@bugzilla.kernel.org]

https://bugzilla.kernel.org/show_bug.cgi?id=183851

Bug ID: 183851
Summary: pci(e) ethernet nonworking when without acpi=off when
using pcie-switch based eth card
Product: ACPI
Version: 2.5
Kernel Version: opensuse 4.9.0-rc2-1.g436f01e-vanilla
(***@buildhost) (gcc version 6.2.1 20160830
[gcc-6-branch revision 239856] (SUSE Linux) ) #1 SMP
Hardware: x86-64
OS: Linux
Tree: Mainline
Status: NEW
Severity: normal
Priority: P1
Component: Other
Assignee: ***@kernel-bugs.osdl.org
Reporter: ***@opensuse.org
Regression: No

I have two long standing bugs with opensuse at:

<https://bugzilla.opensuse.org/show_bug.cgi?id=1006696>
and the older version of the same (with older bios on the amd mainboard and
older opensuse kernel)
<https://bugzilla.opensuse.org/show_bug.cgi?id=851175>

To make a long story short:

I have multiple ethernet cards (pcie) in pcie slots on an asus amd x64 board
(A88XM-PLUS, latest bios from 2016) and one onboard ethernet chip as well.

Without adding acpi=off as kernel boot parameter (via grub2), the machine can
not work with any of the pcie or onboard realtek based ethernet cards. Watchdog
timeouts and stacktraces appear in the logs, I have it all documented on the
two opensuse bugreports already and have been asked to file it here as well as
its even happening with current vanilla kernel.

This all happens only because I have added two more dual ethernet cards into
additional pcie slots of the boards. Using the motherboard with only the single
onboard ethernet realtek chip works fine with the opensuse kernels, but as this
machine is doing routing and multiple networks it was fitted with multiple
ethernet cards.

When using any of these, as far as I understand pcie-switch based, pcie cards,
the problems started and all I was able to do is, to resort to setting
acpi=off. Only then can I use (ping, traffic, etc.) the various ethernet cards
normally and multiple of them.

Leap 42.1 kernel:
Linux version 4.1.31-30-default (***@buildhost) (gcc version 4.8.5 (SUSE
Linux) ) #1 SMP PREEMPT Wed Aug 24 06:20:09 UTC 2016 (de9ddf8)

Newer vanilla kernel:
Linux version 4.9.0-rc2-1.g436f01e-vanilla (***@buildhost) (gcc version 6.2.1
20160830 [gcc-6-branch revision 239856] (SUSE Linux) ) #1 SMP

------------------


dmesg output when using without acpi=off:


[ 0.000000] Linux version 4.9.0-rc2-1.g436f01e-vanilla (***@buildhost)
(gcc version 6.2.1 20160830 [gcc-6-branch revision 239856] (SUSE Linux) ) #1
SMP PREEMPT Mon Oct 24 14:25:56 UTC 2016 (436f01e)
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-vanilla
root=UUID=80557e25-508f-476e-a3cb-b75da8878d32
resume=/dev/disk/by-id/ata-WDC_WD40EFRX-68WT0N0_WD-WCC4E0287517-part1
splash=silent quiet showopts

[ 0.000000] DMI: System manufacturer System Product Name/A88XM-PLUS, BIOS
2903 03/10/2016

[ 0.249540] smpboot: CPU0: AMD A10-6800K APU with Radeon(tm) HD Graphics
(family: 0x15, model: 0x13, stepping: 0x1)


[ 48.016478] ------------[ cut here ]------------
[ 48.016503] WARNING: CPU: 2 PID: 0 at ../net/sched/sch_generic.c:316
dev_watchdog+0x228/0x230
[ 48.016506] NETDEV WATCHDOG: eth3 (r8169): transmit queue 0 timed out
[ 48.016508] Modules linked in: nf_log_ipv6 ipt_MASQUERADE
nf_nat_masquerade_ipv4 xt_pkttype xt_TCPMSS nf_log_ipv4 nf_log_common xt_LOG
xt_limit iptable_nat nf_nat_ipv4 nf_nat af_packet iscsi_ibft iscsi_boot_sysfs
ip6t_REJECT nf_reject_ipv6 xt_tcpudp nf_conntrack_ipv6 nf_defrag_ipv6
ip6table_raw ipt_REJECT nf_reject_ipv4 iptable_raw xt_CT iptable_filter
ip6table_mangle nf_conntrack_netbios_ns nf_conntrack_broadcast
nf_conntrack_ipv4 nf_defrag_ipv4 ip_tables xt_conntrack nf_conntrack
ip6table_filter ip6_tables x_tables joydev hid_generic snd_hda_codec_realtek
usbhid dm_mod edac_mce_amd edac_core snd_hda_codec_generic snd_hda_codec_hdmi
snd_hda_intel snd_hda_codec snd_hda_core kvm_amd kvm uas usb_storage snd_hwdep
snd_pcm snd_seq snd_seq_device snd_timer sp5100_tco i2c_piix4 k10temp irqbypass
snd tpm_infineon
[ 48.016553] acpi_cpufreq tpm_tis fjes tpm_tis_core ppdev r8169 mii
soundcore shpchp crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel
aesni_intel eeepc_wmi asus_wmi sparse_keymap rfkill wmi parport_pc parport
video button tpm pcspkr aes_x86_64 lrw glue_helper serio_raw ablk_helper cryptd
ohci_pci sr_mod cdrom ehci_pci ohci_hcd ehci_hcd xhci_pci xhci_hcd usbcore
radeon i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm drm sg
[ 48.016591] CPU: 2 PID: 0 Comm: swapper/2 Not tainted
4.9.0-rc2-1.g436f01e-vanilla #1
[ 48.016592] Hardware name: System manufacturer System Product
Name/A88XM-PLUS, BIOS 2903 03/10/2016
[ 48.016595] ffff91beded03db0 ffffffffb73c31a0 ffff91beded03e00
0000000000000000
[ 48.016598] ffff91beded03df0 ffffffffb7083ccb 0000013c00000246
0000000000000000
[ 48.016601] ffff91becb578480 0000000000000002 ffff91becd0fc000
0000000000000001
[ 48.016605] Call Trace:
[ 48.016606] <IRQ>
[ 48.016611] [<ffffffffb73c31a0>] dump_stack+0x63/0x83
[ 48.016614] [<ffffffffb7083ccb>] __warn+0xcb/0xf0
[ 48.016617] [<ffffffffb7083d3f>] warn_slowpath_fmt+0x4f/0x60
[ 48.016620] [<ffffffffb70b73fd>] ? cpu_load_update+0xdd/0x150
[ 48.016623] [<ffffffffb76361d8>] dev_watchdog+0x228/0x230
[ 48.016625] [<ffffffffb7635fb0>] ? qdisc_rcu_free+0x40/0x40
[ 48.016628] [<ffffffffb70f4ba5>] call_timer_fn+0x35/0x150
[ 48.016630] [<ffffffffb7635fb0>] ? qdisc_rcu_free+0x40/0x40
[ 48.016633] [<ffffffffb70f5330>] run_timer_softirq+0x220/0x4b0
[ 48.016635] [<ffffffffb70fd4d1>] ? ktime_get+0x41/0xb0
[ 48.016638] [<ffffffffb705291d>] ? lapic_next_event+0x1d/0x30
[ 48.016641] [<ffffffffb7103d1f>] ? clockevents_program_event+0x7f/0x120
[ 48.016644] [<ffffffffb771b454>] __do_softirq+0x104/0x2c1
[ 48.016646] [<ffffffffb708a086>] irq_exit+0xb6/0xc0
[ 48.016648] [<ffffffffb771b232>] smp_apic_timer_interrupt+0x42/0x50
[ 48.016649] [<ffffffffb771a542>] apic_timer_interrupt+0x82/0x90
[ 48.016650] <EOI>
[ 48.016654] [<ffffffffb75ca502>] ? cpuidle_enter_state+0x122/0x300
[ 48.016657] [<ffffffffb75ca717>] cpuidle_enter+0x17/0x20
[ 48.016659] [<ffffffffb70c7f63>] call_cpuidle+0x23/0x40
[ 48.016661] [<ffffffffb70c81cc>] cpu_startup_entry+0x14c/0x230
[ 48.016664] [<ffffffffb7051469>] start_secondary+0x149/0x170
[ 48.016667] ---[ end trace 1541ed3f835f552d ]---


Some hardware information:

lspci -t
-[0000:00]-+-00.0
+-00.2
+-01.0
+-01.1
+-04.0-[01-05]----00.0-[02-05]--+-01.0-[03]----00.0
| +-02.0-[04]--
| \-03.0-[05]----00.0
+-10.0
+-10.1
+-11.0
+-12.0
+-12.2
+-13.0
+-13.2
+-14.0
+-14.2
+-14.3
+-14.4-[06]--
+-15.0-[07-0b]----00.0-[08-0b]--+-01.0-[09]----00.0
| +-02.0-[0a]--
| \-03.0-[0b]----00.0
+-15.1-[0c]----00.0
+-18.0
+-18.1
+-18.2
+-18.3
+-18.4
\-18.5


lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh)
I/O Memory Management Unit
00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI]
Richland [Radeon HD 8670D]
00:01.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio
Controller
00:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Root Port
00:10.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI
Controller (rev 09)
00:10.1 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI
Controller (rev 09)
00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller
[AHCI mode] (rev 40)
00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI
Controller (rev 11)
00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI
Controller (rev 11)
00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI
Controller (rev 11)
00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI
Controller (rev 11)
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 16)
00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller
(rev 01)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 11)
00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD] FCH PCI Bridge (rev 40)
00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 0)
00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 1)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 5
01:00.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:01.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:02.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:03.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 06)
05:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 06)
07:00.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
08:01.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
08:02.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
08:03.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
09:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 06)
0b:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 06)
0c:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 0c)



dmesg | grep -i rtl
[ 7.022582] r8169 0000:03:00.0 eth0: RTL8168evl/8111evl at
0xffffc90001b34000, 00:13:3b:0e:50:7c, XID 0c900800 IRQ 45
[ 7.023079] r8169 0000:05:00.0 eth1: RTL8168evl/8111evl at
0xffffc90001b36000, 00:13:3b:0e:50:7b, XID 0c900800 IRQ 46
[ 7.023576] r8169 0000:09:00.0 eth2: RTL8168evl/8111evl at
0xffffc90001b38000, 00:13:3b:0e:50:77, XID 0c900800 IRQ 47
[ 7.024050] r8169 0000:0b:00.0 eth3: RTL8168evl/8111evl at
0xffffc90001b3a000, 00:13:3b:0e:50:78, XID 0c900800 IRQ 48
[ 7.033062] r8169 0000:0c:00.0 eth4: RTL8168g/8111g at 0xffffc90001b56000,
d8:50:e6:4c:08:d4, XID 0c000800 IRQ 49



lspci -t -v
-[0000:00]-+-00.0 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Root Complex
+-00.2 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) I/O Memory Management Unit
+-01.0 Advanced Micro Devices, Inc. [AMD/ATI] Richland [Radeon HD
8670D]
+-01.1 Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio
Controller
+-04.0-[01-05]----00.0-[02-05]--+-01.0-[03]----00.0 Realtek
Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet
Controller
| +-02.0-[04]--
| \-03.0-[05]----00.0 Realtek
Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet
Controller
+-10.0 Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
+-10.1 Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
+-11.0 Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI
mode]
+-12.0 Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
+-12.2 Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
+-13.0 Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
+-13.2 Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
+-14.0 Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
+-14.2 Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller
+-14.3 Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
+-14.4-[06]--
+-15.0-[07-0b]----00.0-[08-0b]--+-01.0-[09]----00.0 Realtek
Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet
Controller
| +-02.0-[0a]--
| \-03.0-[0b]----00.0 Realtek
Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet
Controller
+-15.1-[0c]----00.0 Realtek Semiconductor Co., Ltd.
RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
+-18.0 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 0
+-18.1 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 1
+-18.2 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 2
+-18.3 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 3
+-18.4 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 4
\-18.5 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 5




-------------

Additional note: I have these very same pcie dual-port ethernet cards on a
different, older generation amd x64 mainboard as well, and opensuse kernel does
not have any trouble running there, so I dont have to use acpi=off on that
machine. I can add its technical configuration and some messages from that as
well if needed.

[b***@bugzilla.kernel.org]

https://bugzilla.kernel.org/show_bug.cgi?id=183851

abittner <***@opensuse.org> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |***@suse.de

[b***@bugzilla.kernel.org]

https://bugzilla.kernel.org/show_bug.cgi?id=183851

--- Comment #1 from abittner <***@opensuse.org> ---
Maybe I have more hints or an idea, that it is about pcie devices with own pcie
buses via pcie-bridges/pcie-switches coming on their pcbs plugged into a pcie
socket that is directly originating from modern amd apu/cpu instead of pcie bus
that originates from the motherboard chipset itself.
Actually a mix of pcie slots coming from the cpu itself and pcie bus coming
from the chipset (amd hudson d4)

Some block diagram of certain amd chipsets and so on could maybe help or maybe
I am completely wrong.

I have built and reproduced with another spare test device here.

Asus Amd board: F2A85-M PRO
AMD A85X FCH(Hudson D4) chipset
<https://www.asus.com/Motherboards/F2A85M_PRO/specifications/>

latest bios:
Vendor: "American Megatrends Inc."
Version: "6601"
Date: "11/25/2014"

With apu processor:
[ 0.405093] smpboot: CPU0: AMD A10-5700 APU with Radeon(tm) HD Graphics
(fam: 15, model: 10, stepping: 01)


Tested on older OpenSuSE 42.1 leap x64
Linux linux 4.1.34-33-default #1 SMP PREEMPT Thu Oct 20 08:03:29 UTC 2016
(fe18aba) x86_64 x86_64 x86_64 GNU/Linux


Putting in the same pericom pcie switch (or bridge?) based dual ethernet port
pcie network card

lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh)
I/O Memory Management Unit
00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI]
Trinity [Radeon HD 7660D]
00:01.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio
Controller
00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Root Port
00:10.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI
Controller (rev 03)
00:10.1 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI
Controller (rev 03)
00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller
[AHCI mode] (rev 40)
00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI
Controller (rev 11)
00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI
Controller (rev 11)
00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI
Controller (rev 11)
00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI
Controller (rev 11)
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 14)
00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller
(rev 01)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 11)
00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD] FCH PCI Bridge (rev 40)
00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 0)
00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 1)
00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 2)
00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 3)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 5
01:00.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:01.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:02.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:03.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 06)
05:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 06)
08:00.0 USB controller: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host
Controller
09:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 09)
0a:00.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
0b:01.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
0b:02.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
0b:03.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
0c:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 06)
0e:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 06)



lspci -tv
-[0000:00]-+-00.0 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Root Complex
+-00.2 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) I/O Memory Management Unit
+-01.0 Advanced Micro Devices, Inc. [AMD/ATI] Trinity [Radeon HD
7660D]
+-01.1 Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio
Controller
+-02.0-[01-05]----00.0-[02-05]--+-01.0-[03]----00.0 Realtek
Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet
Controller
| +-02.0-[04]--
| \-03.0-[05]----00.0 Realtek
Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet
Controller
+-10.0 Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
+-10.1 Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
+-11.0 Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI
mode]
+-12.0 Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
+-12.2 Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
+-13.0 Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
+-13.2 Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
+-14.0 Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
+-14.2 Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller
+-14.3 Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
+-14.4-[06]--
+-15.0-[07]--
+-15.1-[08]----00.0 ASMedia Technology Inc. ASM1042 SuperSpeed USB
Host Controller
+-15.2-[09]----00.0 Realtek Semiconductor Co., Ltd.
RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
+-15.3-[0a-0e]----00.0-[0b-0e]--+-01.0-[0c]----00.0 Realtek
Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet
Controller
| +-02.0-[0d]--
| \-03.0-[0e]----00.0 Realtek
Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet
Controller
+-18.0 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 0
+-18.1 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 1
+-18.2 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 2
+-18.3 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 3
+-18.4 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 4
\-18.5 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 5




The one dual port ethernet card is attached in an x16 pcie slot, that sits
right next to the cpu socket, and if i understand lspci correctly and identify
those devices and components the one dual ethernet nic is connected to: +-02.0
Which would be: 00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family
15h (Models 10h-1fh) Processor Root Port

The other dual port ethernet card is attached to an x1 pcie slot further away
and apparently attached to: +-15.3-
00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 3)

I am attaching a simple ethernet switch to this second dual ethernet card
sitting in 15.3 and simply seeing an established link (eth4) in kernel
messages. The other three ports (one from this same dual ethernet and both of
the first dual ethernet) are down and unconnected to anything. Then there is an
onboard pcie ethernet port of the mainboard itself that I am mainly using on
the lan and to access ip internet.

Apparently only when I at least connect a simple ethernet switch via rj45 cable
to one of the ports of this e.g. second dual ethernet pcie card (15.3) , and
the link becomming active (nic and switch leds show link established), but not
even binding ip or addresses to it and letting it only stay idle but up, I get
kernel (dmesg) messages of the same kind as above from my original production
affected system:



[ 95.796297] r8169 0000:0e:00.0 eth4: link up
[ 198.044202] ------------[ cut here ]------------
[ 198.044232] WARNING: CPU: 0 PID: 0 at ../net/sched/sch_generic.c:308
dev_watchdog+0x22e/0x240()
[ 198.044235] NETDEV WATCHDOG: eth4 (r8169): transmit queue 0 timed out
[ 198.044237] Modules linked in: fuse bnep bluetooth af_packet iscsi_ibft
iscsi_boot_sysfs joydev hid_generic snd_hda_codec_realtek snd_hda_codec_generic
snd_hda_codec_hdmi dm_mod snd_hda_intel snd_hda_controller snd_hda_codec
snd_hda_core snd_hwdep usbhid snd_pcm_oss snd_pcm snd_seq snd_seq_device
snd_timer snd_mixer_oss snd r8169 mii soundcore i2c_piix4 shpchp k10temp
kvm_amd kvm crct10dif_pclmul eeepc_wmi asus_wmi sparse_keymap rfkill
crc32_pclmul video crc32c_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper
ablk_helper cryptd pcspkr serio_raw 8250_fintek tpm_infineon tpm_tis wmi tpm
acpi_cpufreq button processor ohci_pci ehci_pci ohci_hcd ehci_hcd radeon
xhci_pci xhci_hcd sr_mod cdrom usbcore usb_common i2c_algo_bit drm_kms_helper
ttm drm sg
[ 198.044287] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 4.1.34-33-default #1
[ 198.044289] Hardware name: System manufacturer System Product Name/F2A85-M
PRO, BIOS 6601 11/25/2014
[ 198.044291] 0000000000000286 0000000000000000 ffffffff8165f7d1
00000000000400f6
[ 198.044294] ffff88083ec03de8 ffffffff81aa162c ffffffff81068961
0000000000000000
[ 198.044297] ffff880819dfe000 0000000000000001 ffff880819dfe3e0
0000000000000000
[ 198.044299] Call Trace:
[ 198.044312] [<ffffffff810055cc>] dump_trace+0x8c/0x340
[ 198.044316] [<ffffffff8100597c>] show_stack_log_lvl+0xfc/0x1a0
[ 198.044320] [<ffffffff81006ec1>] show_stack+0x21/0x50
[ 198.044325] [<ffffffff8165f7d1>] dump_stack+0x5d/0x79
[ 198.044330] [<ffffffff81068961>] warn_slowpath_common+0x81/0xb0
[ 198.044334] [<ffffffff810689da>] warn_slowpath_fmt+0x4a/0x50
[ 198.044337] [<ffffffff8158acee>] dev_watchdog+0x22e/0x240
[ 198.044343] [<ffffffff810d16c0>] call_timer_fn+0x30/0x170
[ 198.044347] [<ffffffff810d1b4b>] run_timer_softirq+0x25b/0x310
[ 198.044353] [<ffffffff8106cef1>] __do_softirq+0xf1/0x300
[ 198.044358] [<ffffffff8106d345>] irq_exit+0x95/0xa0
[ 198.044362] [<ffffffff81668c6e>] smp_apic_timer_interrupt+0x3e/0x50
[ 198.044367] [<ffffffff81666ede>] apic_timer_interrupt+0x6e/0x80
[ 198.044373] [<ffffffff81525da8>] cpuidle_enter_state+0xc8/0x260
[ 198.044378] [<ffffffff810aa959>] cpu_idle_loop+0x379/0x410
[ 198.044388] [<ffffffff810aaa49>] cpu_startup_entry+0x59/0x60
[ 198.044393] [<ffffffff81f2a083>] start_kernel+0x4a3/0x4ae
[ 198.044397] [<ffffffff81f296f9>] x86_64_start_kernel+0x149/0x158
[ 198.044401] ---[ end trace 62a15a291aecf7fc ]---
[ 198.054577] r8169 0000:0e:00.0 eth4: link up
[ 264.018923] r8169 0000:0e:00.0 eth4: link up



And it often seems to "reestablish" its link, and the OpenSuSE Network manager
or some popup from the tray area of KDE keeps popping up and telling me eth4
would be up or down or not configured and that kind of stuff.

I dont seem to notice a flickering led on neither the ethernet switch nor on
the nic itself though.

Maybe the software paths in the driver and kernel only become crowded or
struggling with that bug when there is actually software only even slightly
using it e.g. link established and so on.

I can shuffle the pcie dual ethernet cards around abit more and maybe move then
away from the apu/cpu pcie bus all to the chipset pcie bus, and try again?
Anything else needed?

[b***@bugzilla.kernel.org]

https://bugzilla.kernel.org/show_bug.cgi?id=183851

--- Comment #2 from abittner <***@opensuse.org> ---
Removed the one dualport pcie card from the x16 slot but still getting same
watchdog errors:


[ 39.407042] r8169 0000:09:00.0 eth4: link up
[ 106.058374] ------------[ cut here ]------------
[ 106.058384] WARNING: CPU: 3 PID: 2421 at ../net/sched/sch_generic.c:308
dev_watchdog+0x22e/0x240()
[ 106.058387] NETDEV WATCHDOG: eth4 (r8169): transmit queue 0 timed out
[ 106.058388] Modules linked in: bnep bluetooth fuse af_packet iscsi_ibft
iscsi_boot_sysfs joydev hid_generic usbhid snd_hda_codec_realtek
snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_hda_controller
snd_hda_codec snd_hda_core snd_hwdep snd_pcm_oss snd_pcm snd_seq snd_seq_device
snd_timer snd_mixer_oss dm_mod snd eeepc_wmi asus_wmi sparse_keymap rfkill
video r8169 mii soundcore i2c_piix4 k10temp shpchp kvm_amd kvm crct10dif_pclmul
crc32_pclmul crc32c_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper
ablk_helper cryptd pcspkr serio_raw wmi 8250_fintek tpm_infineon tpm_tis tpm
acpi_cpufreq button processor ohci_pci ehci_pci ohci_hcd ehci_hcd sr_mod cdrom
xhci_pci xhci_hcd usbcore usb_common radeon i2c_algo_bit drm_kms_helper ttm drm
sg
[ 106.058430] CPU: 3 PID: 2421 Comm: zypper Not tainted 4.1.34-33-default #1
[ 106.058432] Hardware name: System manufacturer System Product Name/F2A85-M
PRO, BIOS 6601 11/25/2014
[ 106.058434] 0000000000000286 0000000000000000 ffffffff8165f7d1
0000000000000000
[ 106.058436] ffff88083ed83de8 ffffffff81aa162c ffffffff81068961
0000000000000000
[ 106.058439] ffff880818c16000 0000000000000001 ffff880818c163e0
0000000000000003
[ 106.058441] Call Trace:
[ 106.058452] [<ffffffff810055cc>] dump_trace+0x8c/0x340
[ 106.058456] [<ffffffff8100597c>] show_stack_log_lvl+0xfc/0x1a0
[ 106.058459] [<ffffffff81006ec1>] show_stack+0x21/0x50
[ 106.058466] [<ffffffff8165f7d1>] dump_stack+0x5d/0x79
[ 106.058470] [<ffffffff81068961>] warn_slowpath_common+0x81/0xb0
[ 106.058474] [<ffffffff810689da>] warn_slowpath_fmt+0x4a/0x50
[ 106.058476] [<ffffffff8158acee>] dev_watchdog+0x22e/0x240
[ 106.058481] [<ffffffff810d16c0>] call_timer_fn+0x30/0x170
[ 106.058484] [<ffffffff810d1b4b>] run_timer_softirq+0x25b/0x310
[ 106.058489] [<ffffffff8106cef1>] __do_softirq+0xf1/0x300
[ 106.058492] [<ffffffff8106d345>] irq_exit+0x95/0xa0
[ 106.058496] [<ffffffff81668c6e>] smp_apic_timer_interrupt+0x3e/0x50
[ 106.058500] [<ffffffff81666ede>] apic_timer_interrupt+0x6e/0x80
[ 106.058506] [<00007f99bdac8d23>] 0x7f99bdac8d23
[ 106.058507] ---[ end trace 09802ad09b12a2d5 ]---
[ 106.068708] r8169 0000:09:00.0 eth4: link up
[ 184.026800] r8169 0000:09:00.0 eth4: link up


ifconfig eth4
eth4 Link encap:Ethernet HWaddr 00:13:3B:0F:42:9B
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:94 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)



lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh)
I/O Memory Management Unit
00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI]
Trinity [Radeon HD 7660D]
00:01.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio
Controller
00:10.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI
Controller (rev 03)
00:10.1 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI
Controller (rev 03)
00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller
[AHCI mode] (rev 40)
00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI
Controller (rev 11)
00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI
Controller (rev 11)
00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI
Controller (rev 11)
00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI
Controller (rev 11)
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 14)
00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller
(rev 01)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 11)
00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD] FCH PCI Bridge (rev 40)
00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 0)
00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 1)
00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 2)
00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge
(PCIE port 3)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 5
03:00.0 USB controller: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host
Controller
04:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 09)
05:00.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
06:01.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
06:02.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
06:03.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
07:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 06)
09:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411
PCI Express Gigabit Ethernet Controller (rev 06)



lspci -tv
-[0000:00]-+-00.0 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Root Complex
+-00.2 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) I/O Memory Management Unit
+-01.0 Advanced Micro Devices, Inc. [AMD/ATI] Trinity [Radeon HD
7660D]
+-01.1 Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio
Controller
+-10.0 Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
+-10.1 Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
+-11.0 Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI
mode]
+-12.0 Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
+-12.2 Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
+-13.0 Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
+-13.2 Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
+-14.0 Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
+-14.2 Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller
+-14.3 Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
+-14.4-[01]--
+-15.0-[02]--
+-15.1-[03]----00.0 ASMedia Technology Inc. ASM1042 SuperSpeed USB
Host Controller
+-15.2-[04]----00.0 Realtek Semiconductor Co., Ltd.
RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
+-15.3-[05-09]----00.0-[06-09]--+-01.0-[07]----00.0 Realtek
Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet
Controller
| +-02.0-[08]--
| \-03.0-[09]----00.0 Realtek
Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet
Controller
+-18.0 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 0
+-18.1 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 1
+-18.2 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 2
+-18.3 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 3
+-18.4 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 4
\-18.5 Advanced Micro Devices, Inc. [AMD] Family 15h (Models
10h-1fh) Processor Function 5

[b***@bugzilla.kernel.org]

https://bugzilla.kernel.org/show_bug.cgi?id=183851

Len Brown <***@kernel.org> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |***@kernel.org
Summary|pci(e) ethernet nonworking |pci(e) ethernet nonworking
|when without acpi=off when |when without acpi=off when
|using pcie-switch based eth |using pcie-switch based eth
|card |card - Asus A88XM-PLUS/AMD

[b***@bugzilla.kernel.org]

https://bugzilla.kernel.org/show_bug.cgi?id=183851

Jose Luis Mantilla <***@gmail.com> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |***@gmail.com

--- Comment #3 from Jose Luis Mantilla <***@gmail.com> ---
I have the same issue. The possible fix right now is booting from whatever
kernel 4.8.x or < 4.9.x. -- The kernel 4.9 includes something strange and I
have the last bios firmware.

[b***@bugzilla.kernel.org]

https://bugzilla.kernel.org/show_bug.cgi?id=183851

Crys Mi (***@live.com) changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |***@live.com