HPE-FlexibleLOM-adapter
HPE-FlexibleLOM-adapter copied to clipboard
TobleMiner
Modification required for Broadcom based FlexLOM cards (530/533FLR)
The HPE 530FLR-SFP+ and 533FLR-T cards are based on the Broadcom BCM57810. These cards do not work with the adapter without modification.
The KCORES FlexibleLOM Adapter appears to have a more accurate pinout of the FlexLOM connector:
The following modifications to the adapter make it compatible with the Broadcom-based FlexibleLOM cards:
- Cut the trace between Vdet (to make pin B1 N/C)
- Cut the trace connecting PERST to pin A1 (between the center/right solder pads)
- Bridge the PERST left/center solder pads so PERST is connected to A14
- Bridge 3.3V pad to pin A1
- Connect 3.3V pad to A10/A11
- Bridge GND between pins A4/A5/A6/A7/A8
With the above changes, the 533FLR-T adapter is working for me: lspci output
Here is an annotated photo of the modifications required:
(The additional wire is to connect nWAKE)
Cool! I'll prepare a RevB for testing. Many thanks for bringing this to my attention.
For the pins requiring +3.3V, I bridged from +3.3V_AUX because it was easy and exposed on RevA, but I'm not sure if this is the "correct" way. KCORES are using +3.3V from pins B8/A9/A10 in their adapter.
I don't know enough KiCad to modify the adapter in this way, sorry.
Hey, no worries. I'm not entirely sure about the 3.3V domains either. I wil derive PWROK from the main 3.3V rail since it is likely intended to be a power good signal for the 12V rail. To me another worry are the software deifned pins (SDP). I'm not entirely sure what they are doing. To me it seems a bit risky to pull them to 3.3V that hard. Unfortunately I don't have access to any HP servers with a FlexibleLOM slot. Thus I can't verify whether the KCORES adapter matches what HP is doing.
Hello,
I tested successfully the modification with a HP 530FLR-SFP+, without such hack, card was not visible through lspci. I did not add the additional wire. Thanks for the trick !
Thanks Tobias for the adapter and Hal for the mods! I wanted to confirm that revision A didn't work for me, but with the mods above I got 533FLR-T working. I haven't benchmarked it at 10GbE yet, but lspci/LnkSta says it's 5GT/s x8, ssh/scp works fine over it, etc.
However, the adapter still does not work for 561FLR-T (Intel X540), the only mod I didn't do is the nWAKE one, not sure if required?
One other suggestion I have for rev B is to reduce the copper plane that gets exposed when beveled: this might also be the reason JLCPCB doesn't bevel the PCBs. They didn't for me either, I did it manually and ended up exposing this plane and managed to kill a motherboard with it. I did notice the copper was exposed even though bevel was very light compared to other PCIe cards, but I figured I'd be safe once inserted because it should sit under the PCIe contacts in the connector, but I forgot to disconnect the PSU (rookie mistake) so the motherboard powered on while I was inserting the adapter and that was that! Luckily it was not a super expensive mb.
Hi!
I'm super sorry to hear that. Retracting the GND plane a bit is something I should have done in the initial design. I've just redesigned the adapter, fixing both the pin assignments for the Flexible LOM slot (I've left out the SPD pins for now though) and the GND plane in the beveled area: https://github.com/TobleMiner/HPE-FlexibleLOM-adapter/tree/revb-untested
The design is not tested yet, but I've ordered it yesterday. So it should be here within the next two weeks or so.
Small update, I think I figured out why the rev A PCB (without any mods) worked with 561FLR-T for others but not for me initially: the reason seems to be as simple as using a PCIe powered video card vs one with separate power from PSU. I guess it has to do with total power draw of the two cards or possible mb quirks? Anyway, wanted to confirm that 561FLR-T without mods does work for me as well (when using a beefier video card with separate power connector).
Unfortunately I don't have access to any HP servers with a FlexibleLOM slot. Thus I can't verify whether the KCORES adapter matches what HP is doing
I have a bunch of machines with FlexLOM and 544FLR. Anything in particular you want tested? Bricking a few MBs or HBAs is not a problem.
@obedouet Did you add GND on pins B9 and B11?
I purchased a 530FLR-SFP+ that draws 2W and does not enumerate on the PCIe bus without grounding pins B9 and B11. Grounding pins B9 and B11 results in the card consuming 6W and successfully initializing.
@halmartin Are you sure grounding B9 is required? According to the information I got that should only be TX enable for NC-SI.
@TobleMiner I'm not certain, I have two versions of the modified adapter, one with the modifications I describe above, and the other with those modifications plus B9/B11 grounded.
The 530FLR-SFP+ I have does not work in the adapter that does not have B9/B11 grounded. Unfortunately my soldering iron has broken, so I cannot desolder connections to test if only B11 is required. I can test this when my new soldering iron arrives.
@obedouet Did you add GND on pins B9 and B11?
I purchased a 530FLR-SFP+ that draws 2W and does not enumerate on the PCIe bus without grounding pins B9 and B11. Grounding pins B9 and B11 results in the card consuming 6W and successfully initializing.
Hello, I did not modify B9 and B11. I've only applied your steps 1-6. The card is working in a ESX since my comment (1/5) without any issue, really stable.
@dmg244 Oops, sorry for that. I've just updated the branch to now feature the RevB gerbers in that file.
@TobleMiner Can you make revision C with the grounding of lines B9, B11, A4, A6, A7 and the connected WAKE line - A9 LOM to B11 PCI-E, A10 and A11 to +3.3V (all lines like KCORES design)? I want try to order this design for test. Why you use only +3.3V_AUX and don't use +3.3V?
I have ordered the RevB, I have some 530FLR-SFP+ (647581-B21) and QDR 544+FLR-QSFP (764286-B21)
I will update you in about two weeks
Does anyone know if these 544 cards are confirmed working in rev A?
@dmg244
@TobleMiner Can you make revision C with the grounding of lines B9, B11, A4, A6, A7 and the connected WAKE line - A9 LOM to B11 PCI-E, A10 and A11 to +3.3V (all lines like KCORES design)? want try to order this design for test
Sure, will do. I don't feel that comfortable pulling the SDP pins that hard, but at least for a test it should be fine.
Why you use only +3.3V_AUX and don't use +3.3V?
By mistake. PWROK shoudl have been connected to the 3v3 power rail. However, I think B10 is supposed to be +3v3_aux to allow NC-SI to work even during system shutdown.
@dmg244 Here you go: https://github.com/TobleMiner/HPE-FlexibleLOM-adapter/blob/revc-experimental/gerbers/revC_panel.zip
Think that should cover everything you might want to test. I've made sure to expose a good lenght of trace to any of the pins where we are not sure whether they are required for cards to enumerate or not. Feel free to experiment with cutting any of those traces and pulling them high/low or leaving them floating :)
Thank you! Already ordered from e-bay 2pcs HP 647579-001 649869-001 2-Port 530FLR SFP+ 10Gbps Ethernet Adapter 2pcs HPE 669281-001 Ethernet 560FLR-SFP+ 10GB 2-Ports PCI Express 2.0 x8 Adapter HP 4-Port 684208-B21 629135-B21 634025-001 Ethernet 1Gb 331FLR Adapter
and connectors for testing.
JLCPCB will be produced PCB from 19 Feb
I have ordered the RevB, I have some 530FLR-SFP+ (647581-B21) and QDR 544+FLR-QSFP (764286-B21)
I also bought some 530FLR-SFP+ (647581-B21), do you have any update?
Hello! Thank you for you attention!
Latest news )))
Already received: 2pcs HPE 669281-001 Ethernet 560FLR-SFP+ 10GB 2-Ports PCI Express 2.0 x8 Adapter 2pcs HPE AJ838A LC/LC FC 30m Multi-mode OM3 Cable (491028-001)
still waiting PCB's and connectors.
Also still waiting: 2pcs HP 647579-001 649869-001 2-Port 530FLR SFP+ 10Gbps Ethernet Adapter 1pcs HP 4-Port 684208-B21 629135-B21 634025-001 Ethernet 1Gb 331FLR Adapter 2pcs Intel E10GSFPSR FTLX8571D3BCV-IT E65689-001 SFP+ Transceiver For X520-DA2/SR2 2pcs JD092B HPE X130 10G SFP+SR LC FTLX8571D3BCL-HZ 850nm for 5900AF
My PCBs arrived today. I got some soldered up and can confirm the revB worked with the 40gbe FLOM card QDR 544+FLR-QSFP (764286-B21)
I purchased 100 PCBs as the cost was not really much more than 20 from JLPCB due to the paneling of the design (required for edge chamfering with no extra cost) If anyone would like to buy some PCBS or completed cards off me do let me know. I am in the UK and will list on ebay also
@Nooby1 Are you in the EU? I'd be interested in buying some PCBs from you.
@Nooby1 Are you in the EU? I'd be interested in buying some PCBs from you
Uk, and sure happy to sell up to 80 of them. I dont know the best way to share contact details on here however.
@Nooby1 Is this offer still on the table? Buying is preferable to waiting for shipping.
Regarding all the other adapters you ordered, have you managed to confirm if revB works with the 647579-001 model?
@Nooby1 Is this offer still on the table? Buying is preferable to waiting for shipping.
Regarding all the other adapters you ordered, have you managed to confirm if revB works with the 647579-001 model?
Yes I still have pcb and completed models avalable, not tested with anything but connectx3 pro currently. Could test with 530flr in future
@Nooby1 I have added you to a project with my email address in the description - shame about github's lack of social features. Drop me a line when you are able.
Received all components.
I may confirm that adapter ver.C working with:
HPE 669281-001 Ethernet 560FLR-SFP+ 10GB 2-Ports PCI Express 2.0 x8 Adapter
#lspci
02:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
02:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
HP 647579-001 649869-001 2-Port 530FLR SFP+ 10Gbps Ethernet Adapter
#lspci
02:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10)
02:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10)
HP 4-Port 684208-B21 629135-B21 634025-001 Ethernet 1Gb 331FLR Adapter
#lspci
02:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
02:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
02:00.2 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
02:00.3 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)