The performance of your PCI-X bus maybe because of the design of your
motherboard. Many chipsets will only allow you to run one card per two
slots. I know that this is the case with the Dell 6650s for example.
This maybe something that you should look into.
http://forum.lucidnow.com
news.tele.dk wrote:
Hi,
I'm having problem with PCI-X performance, and I'm not sure why...
Running Fedor Core 3 e.g. 2.6.9-1.667smp
I'm suspecting that the problem is with the PCI hosts bus speed, the problem
card is a 3ware 9500 Raid controller card, running in a SE7320SP2 intel
mother board.
I'm not sure how to read the lspci command, and I'm hoping that someone
would help me.
This is what I think how I should read the output, please correct me if i'm
wrong (and if not, what can I do to make it go at 66Mhz???)
The RAID card (03) is attached to the bridge (1c) with is attached to the
memory conrtoller hub (00.0)
(see lspci -tv futher down)
The 3ware controller I suspect is running at 66Mhz so that Ok (lspci -vv |
grep [controller]):
03:03.0 RAID bus controller: 3ware Inc 3ware Inc 3ware 9xxx-series SATA-RAID
Subsystem: 3ware Inc 3ware Inc 3ware 9xxx-series SATA-RAID
Control: I/O+ Mem+ BusMaster+ SpecCycle+ MemWINV+ VGASnoop- ParErr-
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium TAbort-
TAbort- MAbort- SERR- PERR-
So is the PCI bridge that it is attached to is also running at 66Mhz (ok
too):
00:1c.0 PCI bridge: Intel Corp. 6300ESB 64-bit PCI-X Bridge (rev 02)
(prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=fast TAbort-
TAbort- MAbort- SERR- PERR-
But hte host bridge is not (I suspect that 66Mhz- means it cannot run 66Mhz
??? or ):
00:00.0 Host bridge: Intel Corp. E7320 Memory Controller Hub (rev 0a)
Subsystem: Intel Corp.: Unknown device 343f
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=fast TAbort-
TAbort- MAbort- SERR- PERR-
Here's the lspci -tv
[root@dhcp157 ~]# lspci -tv
-[0000:00]-+-00.0 Intel Corp. E7320 Memory Controller Hub
+-00.1 Intel Corp. E7320 Error Reporting Registers
+-02.0-[0000:01]--
+-03.0-[0000:02]--
+-1c.0-[0000:03]----03.0 3ware Inc 3ware Inc 3ware 9xxx-series
SATA-RAID
+-1e.0-[0000:04]--+-02.0 ATI Technologies Inc Rage XL
| \-03.0 Intel Corp. 82541GI/PI Gigabit Ethernet
Controller
+-1f.0 Intel Corp. 6300ESB LPC Interface Controller
+-1f.1 Intel Corp. 6300ESB PATA Storage Controller
\-1f.3 Intel Corp. 6300ESB SMBus Controller
Full lspci -vv
[root@dhcp157 ~]# lspci -vv
00:00.0 Host bridge: Intel Corp. E7320 Memory Controller Hub (rev 0a)
Subsystem: Intel Corp.: Unknown device 343f
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=fast TAbort-
TAbort- MAbort- SERR- PERR-
Latency: 0
Capabilities: [40] Vendor Specific Information
00:00.1 Class ff00: Intel Corp. E7320 Error Reporting Registers (rev 0a)
Subsystem: Intel Corp.: Unknown device 343f
Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping- SERR+ FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast TAbort-
TAbort- MAbort- SERR- PERR-
00:02.0 PCI bridge: Intel Corp. E7525/E7520/E7320 PCI Express Port A (rev
0a) (prog-if 00 [Normal decode])
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast TAbort-
TAbort- MAbort- SERR- PERR-
Latency: 0, Cache Line Size 10
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
Secondary status: 66Mhz- FastB2B- ParErr- DEVSEL=fast TAbort-
TAbort- MAbort+ SERR- PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- Reset- FastB2B-
Capabilities: [50] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1
Enable-
Address: fee00000 Data: 0000
Capabilities: [64] Express Root Port (Slot-) IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0,
ExtTag-
Device: Latency L0s 64ns, L1 1us
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 128 bytes, MaxReadReq 128 bytes
Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 2
Link: Latency L0s 4us, L1 unlimited
Link: ASPM Disabled RCB 64 bytes Disabled CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x8
Root: Correctable+ Non-Fatal+ Fatal+ PME+
Capabilities: [100] Advanced Error Reporting
00:03.0 PCI bridge: Intel Corp. E7525/E7520/E7320 PCI Express Port A1 (rev
0a) (prog-if 00 [Normal decode])
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast TAbort-
TAbort- MAbort- SERR- PERR-
Latency: 0, Cache Line Size 10
Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
Secondary status: 66Mhz- FastB2B- ParErr- DEVSEL=fast TAbort-
TAbort- MAbort+ SERR- PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- Reset- FastB2B-
Capabilities: [50] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1
Enable-
Address: fee00000 Data: 0000
Capabilities: [64] Express Root Port (Slot-) IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0,
ExtTag-
Device: Latency L0s 64ns, L1 1us
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 128 bytes, MaxReadReq 128 bytes
Link: Supported Speed 2.5Gb/s, Width x4, ASPM L0s, Port 3
Link: Latency L0s 4us, L1 unlimited
Link: ASPM Disabled RCB 64 bytes Disabled CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x4
Root: Correctable+ Non-Fatal+ Fatal+ PME+
Capabilities: [100] Advanced Error Reporting
00:1c.0 PCI bridge: Intel Corp. 6300ESB 64-bit PCI-X Bridge (rev 02)
(prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=fast TAbort-
TAbort- MAbort- SERR- PERR-
Latency: 64, Cache Line Size 10
Bus: primary=00, secondary=03, subordinate=03, sec-latency=48
I/O behind bridge: 0000d000-0000dfff
Memory behind bridge: dee00000-deefffff
Prefetchable memory behind bridge: 00000000dd800000-00000000ddf00000
Secondary status: 66Mhz+ FastB2B+ ParErr- DEVSEL=medium TAbort-
TAbort- MAbort+ SERR- PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- Reset- FastB2B-
Capabilities: [50] PCI-X bridge device.
Secondary Status: 64bit+, 133MHz-, SCD-, USC-, SCO-, SRD-
Freq=0
Status: Bus=0 Dev=28 Func=0 64bit+ 133MHz- SCD- USC-, SCO-,
SRD-
: Upstream: Capacity=65535, Commitment Limit=65535
: Downstream: Capacity=65535, Commitment Limit=65535
00:1e.0 PCI bridge: Intel Corp. 82801 PCI Bridge (rev 0a) (prog-if 00
[Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=fast TAbort-
TAbort- MAbort- SERR- PERR-
Latency: 0
Bus: primary=00, secondary=04, subordinate=04, sec-latency=32
I/O behind bridge: 0000e000-0000efff
Memory behind bridge: def00000-dfffffff
Secondary status: 66Mhz- FastB2B+ ParErr- DEVSEL=medium TAbort-
TAbort- MAbort+ SERR- PERR-
BridgeCtl: Parity+ SERR+ NoISA- VGA+ MAbort- Reset- FastB2B-
00:1f.0 ISA bridge: Intel Corp. 6300ESB LPC Interface Controller (rev 02)
Control: I/O+ Mem+ BusMaster+ SpecCycle+ MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium TAbort-
TAbort- MAbort- SERR- PERR-
Latency: 0
00:1f.1 IDE interface: Intel Corp. 6300ESB PATA Storage Controller (rev 02)
(prog-if 8a [Master SecP PriP])
Subsystem: Intel Corp.: Unknown device 343f
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping- SERR- FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium TAbort-
TAbort- MAbort- SERR- PERR-
Latency: 0
Interrupt: pin A routed to IRQ 177
Region 0: I/O ports at unassigned
Region 1: I/O ports at unassigned
Region 2: I/O ports at unassigned
Region 3: I/O ports at unassigned
Region 4: I/O ports at fc00 [size=16]
Region 5: Memory at f6000000 (32-bit, non-prefetchable) [size=1K]
00:1f.3 SMBus: Intel Corp. 6300ESB SMBus Controller (rev 02)
Subsystem: Intel Corp.: Unknown device 343f
Control: I/O+ Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping- SERR- FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium TAbort-
TAbort- MAbort- SERR- PERR-
Interrupt: pin B routed to IRQ 185
Region 4: I/O ports at 0400 [size=32]
03:03.0 RAID bus controller: 3ware Inc 3ware Inc 3ware 9xxx-series SATA-RAID
Subsystem: 3ware Inc 3ware Inc 3ware 9xxx-series SATA-RAID
Control: I/O+ Mem+ BusMaster+ SpecCycle+ MemWINV+ VGASnoop- ParErr-
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium TAbort-
TAbort- MAbort- SERR- PERR-
Latency: 64 (2250ns min), Cache Line Size 10
Interrupt: pin A routed to IRQ 193
Region 0: I/O ports at d800 [size=256]
Region 1: Memory at deeffc00 (64-bit, non-prefetchable) [size=256]
Region 3: Memory at dd800000 (64-bit, prefetchable) [size=8M]
Expansion ROM at deee0000 [disabled] [size=64K]
Capabilities: [40] PCI-X non-bridge device.
Command: DPERE- ERO- RBC=0 OST=0
Status: Bus=255 Dev=31 Func=0 64bit+ 133MHz+ SCD- USC-,
DC=simple, DMMRBC=0, DMOST=0, DMCRS=0, RSCEM-
Capabilities: [48] Power Management version 2
Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA
PME(D0+,D1+,D2-,D3hot+,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
04:02.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27)
(prog-if 00 [VGA])
Subsystem: Intel Corp.: Unknown device 343f
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping+ SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium TAbort-
TAbort- MAbort- SERR- PERR-
Latency: 64 (2000ns min), Cache Line Size 10
Interrupt: pin A routed to IRQ 185
Region 0: Memory at df000000 (32-bit, non-prefetchable) [size=16M]
Region 1: I/O ports at e800 [size=256]
Region 2: Memory at defff000 (32-bit, non-prefetchable) [size=4K]
Expansion ROM at defc0000 [disabled] [size=128K]
Capabilities: [5c] Power Management version 2
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA
PME(D0-,D1-,D2-,D3hot-,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
04:03.0 Ethernet controller: Intel Corp. 82541GI/PI Gigabit Ethernet
Controller (rev 05)
Subsystem: Intel Corp.: Unknown device 343f
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium TAbort-
TAbort- MAbort- SERR- PERR-
Latency: 64 (63750ns min), Cache Line Size 10
Interrupt: pin A routed to IRQ 169
Region 0: Memory at defa0000 (32-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at ec00 [size=64]
Capabilities: [dc] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [e4] PCI-X non-bridge device.
Command: DPERE- ERO+ RBC=0 OST=0
Status: Bus=0 Dev=0 Func=0 64bit- 133MHz- SCD- USC-,
DC=simple, DMMRBC=2, DMOST=0, DMCRS=0, RSCEM-
Regards,
Carsten
|