Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[202012] [Mellanox] [SKU] Mellanox-SN4700-A96V16 SKU added #32

Closed
wants to merge 4 commits into from
Closed

[202012] [Mellanox] [SKU] Mellanox-SN4700-A96V16 SKU added #32

wants to merge 4 commits into from

Conversation

vivekrnv
Copy link
Owner

@vivekrnv vivekrnv commented Sep 13, 2022 •
edited
Loading

Signed-off-by: Vivek Reddy Karri vkarri@nvidia.com

Why I did it

A new SKU for MSN4700 Platform i.e. Mellanox-SN4700-V16A96

Requirements:

  • Breakout:
    Port 1-24: 4x25G
    Port 25-32: 2x200G
  • Downlinks: 96 (1-24)
  • Uplinks: 16 (31-32)
  • Shared Headroom: Enabled
  • Over Subscribe Ratio: 1:8
  • Default Topology: T0
  • Default Cable Length for T1: 5m
  • VxLAN source port range set: No
  • Static Policy Based Hashing Supported: No
Additional Details:
  • QoS params: The default ones defined in qos_config.j2 will be applied
  • Small Packet Percentage: Used 50% for traditional buffer model Note: For dynamic model, the value defined in LOSSLESS_TRAFFIC_PATTERN|AZURE|small_packet_percentage is used
  • SKU was drafted under the assumption that the downlink ports uses xcvr's that will only support the first 4 lanes of the physical port they are connected to. Hence for the ports 1-24, the last four lanes are not used
  • Cable Lengths used for generating buffer_defaults_{t0,t1}.j2 values
 "t1": {
            "up": "300m",
            "down": "300m",
            "default_cable": "300m" 
        },
        "t0": {
            "up": "300m",
            "down": "5m",
            "default_cable": "5m"
        }

How I did it

How to verify it

root@r-leopard-58:~# show int status
  Interface            Lanes    Speed    MTU    FEC    Alias    Vlan    Oper    Admin                                             Type    Asym PFC
-----------  ---------------  -------  -----  -----  -------  ------  ------  -------  -----------------------------------------------  ----------
  Ethernet0                0      25G   9100    N/A    etp1a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
  Ethernet1                1      25G   9100    N/A    etp1b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
  Ethernet2                2      25G   9100    N/A    etp1c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
  Ethernet3                3      25G   9100    N/A    etp1d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
  Ethernet8                8      25G   9100    N/A    etp2a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
  Ethernet9                9      25G   9100    N/A    etp2b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet10               10      25G   9100    N/A    etp2c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet11               11      25G   9100    N/A    etp2d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet16               16      25G   9100    N/A    etp3a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet17               17      25G   9100    N/A    etp3b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet18               18      25G   9100    N/A    etp3c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet19               19      25G   9100    N/A    etp3d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet24               24      25G   9100    N/A    etp4a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet25               25      25G   9100    N/A    etp4b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet26               26      25G   9100    N/A    etp4c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet27               27      25G   9100    N/A    etp4d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet32               32      25G   9100    N/A    etp5a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet33               33      25G   9100    N/A    etp5b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet34               34      25G   9100    N/A    etp5c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet35               35      25G   9100    N/A    etp5d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet40               40      25G   9100    N/A    etp6a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet41               41      25G   9100    N/A    etp6b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet42               42      25G   9100    N/A    etp6c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet43               43      25G   9100    N/A    etp6d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet48               48      25G   9100    N/A    etp7a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet49               49      25G   9100    N/A    etp7b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet50               50      25G   9100    N/A    etp7c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet51               51      25G   9100    N/A    etp7d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet56               56      25G   9100    N/A    etp8a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet57               57      25G   9100    N/A    etp8b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet58               58      25G   9100    N/A    etp8c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet59               59      25G   9100    N/A    etp8d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet64               64      25G   9100    N/A    etp9a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet65               65      25G   9100    N/A    etp9b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet66               66      25G   9100    N/A    etp9c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet67               67      25G   9100    N/A    etp9d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet72               72      25G   9100    N/A   etp10a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet73               73      25G   9100    N/A   etp10b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet74               74      25G   9100    N/A   etp10c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet75               75      25G   9100    N/A   etp10d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet80               80      25G   9100    N/A   etp11a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet81               81      25G   9100    N/A   etp11b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet82               82      25G   9100    N/A   etp11c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet83               83      25G   9100    N/A   etp11d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet88               88      25G   9100    N/A   etp12a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet89               89      25G   9100    N/A   etp12b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet90               90      25G   9100    N/A   etp12c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet91               91      25G   9100    N/A   etp12d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet96               96      25G   9100    N/A   etp13a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet97               97      25G   9100    N/A   etp13b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet98               98      25G   9100    N/A   etp13c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
 Ethernet99               99      25G   9100    N/A   etp13d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet104              104      25G   9100    N/A   etp14a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet105              105      25G   9100    N/A   etp14b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet106              106      25G   9100    N/A   etp14c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet107              107      25G   9100    N/A   etp14d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet112              112      25G   9100    N/A   etp15a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet113              113      25G   9100    N/A   etp15b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet114              114      25G   9100    N/A   etp15c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet115              115      25G   9100    N/A   etp15d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet120              120      25G   9100    N/A   etp16a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet121              121      25G   9100    N/A   etp16b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet122              122      25G   9100    N/A   etp16c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet123              123      25G   9100    N/A   etp16d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet128              128      25G   9100    N/A   etp17a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet129              129      25G   9100    N/A   etp17b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet130              130      25G   9100    N/A   etp17c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet131              131      25G   9100    N/A   etp17d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet136              136      25G   9100    N/A   etp18a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet137              137      25G   9100    N/A   etp18b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet138              138      25G   9100    N/A   etp18c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet139              139      25G   9100    N/A   etp18d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet144              144      25G   9100    N/A   etp19a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet145              145      25G   9100    N/A   etp19b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet146              146      25G   9100    N/A   etp19c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet147              147      25G   9100    N/A   etp19d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet152              152      25G   9100    N/A   etp20a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet153              153      25G   9100    N/A   etp20b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet154              154      25G   9100    N/A   etp20c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet155              155      25G   9100    N/A   etp20d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet160              160      25G   9100    N/A   etp21a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet161              161      25G   9100    N/A   etp21b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet162              162      25G   9100    N/A   etp21c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet163              163      25G   9100    N/A   etp21d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet168              168      25G   9100    N/A   etp22a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet169              169      25G   9100    N/A   etp22b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet170              170      25G   9100    N/A   etp22c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet171              171      25G   9100    N/A   etp22d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet176              176      25G   9100    N/A   etp23a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet177              177      25G   9100    N/A   etp23b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet178              178      25G   9100    N/A   etp23c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet179              179      25G   9100    N/A   etp23d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet184              184      25G   9100    N/A   etp24a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet185              185      25G   9100    N/A   etp24b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet186              186      25G   9100    N/A   etp24c   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet187              187      25G   9100    N/A   etp24d   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet192  192,193,194,195     200G   9100    N/A   etp25a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet196  196,197,198,199     200G   9100    N/A   etp25b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet200  200,201,202,203     200G   9100    N/A   etp26a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet204  204,205,206,207     200G   9100    N/A   etp26b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet208  208,209,210,211     200G   9100    N/A   etp27a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet212  212,213,214,215     200G   9100    N/A   etp27b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet216  216,217,218,219     200G   9100    N/A   etp28a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet220  220,221,222,223     200G   9100    N/A   etp28b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet224  224,225,226,227     200G   9100    N/A   etp29a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet228  228,229,230,231     200G   9100    N/A   etp29b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet232  232,233,234,235     200G   9100    N/A   etp30a   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet236  236,237,238,239     200G   9100    N/A   etp30b   trunk      up       up  QSFP-DD Double Density 8X Pluggable Transceiver         N/A
Ethernet240  240,241,242,243     200G   9100    N/A   etp31a  routed    down       up                                  QSFP28 or later         N/A
Ethernet244  244,245,246,247     200G   9100    N/A   etp31b  routed    down       up                                  QSFP28 or later         N/A
Ethernet248  248,249,250,251     200G   9100    N/A   etp32a  routed    down       up                                  QSFP28 or later         N/A
Ethernet252  252,253,254,255     200G   9100    N/A   etp32b  routed    down       up                                  QSFP28 or later         N/A

root@r-leopard-58:~# show buffer configuration
Pool: ingress_lossless_pool
----  --------
mode  dynamic
size  47149056
type  ingress
xoff  1249280
----  --------

Pool: egress_lossy_pool
----  --------
mode  dynamic
size  47149056
type  egress
----  --------

Pool: egress_lossless_pool
----  --------
mode  dynamic
size  60817392
type  egress
----  --------

Profile: egress_lossless_profile
----------  ----------------------------------
dynamic_th  7
pool        [BUFFER_POOL|egress_lossless_pool]
size        0
----------  ----------------------------------

Profile: ingress_lossy_profile
----------  -----------------------------------
dynamic_th  3
pool        [BUFFER_POOL|ingress_lossless_pool]
size        0
----------  -----------------------------------

Profile: egress_lossy_profile
----------  -------------------------------
dynamic_th  7
pool        [BUFFER_POOL|egress_lossy_pool]
size        9216
----------  -------------------------------

Profile: pg_lossless_200000_5m_profile
----------  -----------------------------------
dynamic_th  0
pool        [BUFFER_POOL|ingress_lossless_pool]
size        19456
xoff        66560
xon         19456
----------  -----------------------------------

Profile: pg_lossless_25000_5m_profile
----------  -----------------------------------
dynamic_th  0
pool        [BUFFER_POOL|ingress_lossless_pool]
size        19456
xoff        26624
xon         19456
----------  -----------------------------------

Profile: q_lossy_profile
----------  -------------------------------
dynamic_th  3
pool        [BUFFER_POOL|egress_lossy_pool]
size        0
----------  -------------------------------

Profile: ingress_lossless_profile
----------  -----------------------------------
dynamic_th  7
pool        [BUFFER_POOL|ingress_lossless_pool]
size        0
----------  -----------------------------------

Which release branch to backport (provide reason below if selected)

  • 201811
  • 201911
  • 202006
  • 202012
  • 202106
  • 202111
  • 202205

Description for the changelog

Link to config_db schema for YANG module changes

A picture of a cute animal (not mandatory but encouraged)

syslog.gz

@vivekrnv
Added T0 SKI
05e7c96 
Signed-off-by: Vivek Reddy <vkarri@nvidia.com>
@vivekrnv
buffer values updated
24b3605 
Signed-off-by: Vivek Reddy <vkarri@nvidia.com>
@vivekrnv
name updated
b3d66c6 
Signed-off-by: Vivek Reddy <vkarri@nvidia.com>
@vivekrnv vivekrnv changed the title [202012] [Mellanox] [SKU] Mellanox-SN4700-V16A96 SKU added [202012] [Mellanox] [SKU] Mellanox-SN4700-A96V16 SKU added Sep 13, 2022
stephenxs
stephenxs suggested changes Sep 19, 2022
View reviewed changes
Copy link

@stephenxs stephenxs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As commented.
The buffer sizes are correct.

device/mellanox/x86_64-mlnx_msn4700-r0/Mellanox-SN4700-A96V16/pg_profile_lookup.ini Outdated
@@ -0,0 +1,41 @@
##
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you make this file a symbol link to ../Mellanox-SN4700-C128/pg_profile_lookup.ini?

Copy link
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated, please review

@vivekrnv
made pg_profile a symbolic link and added ports2cable map
e83445c 
Signed-off-by: Vivek Reddy <vkarri@nvidia.com>
@vivekrnv vivekrnv closed this Sep 21, 2022
vivekrnv added a commit that referenced this pull request Mar 30, 2023
@vivekrnv
[202211] Advance sonic-dhcp-relay submodule
eb1fe52 
67a3bdf show counters wrong cli output fixed (#36)
5b3eea1 Update package cache, and bail on the first error (#35)
1d221b0 dhcpv6 relay UT code coverage improve (#32)
514b084 dhcpv6 packet handling code refine (#30)

Signed-off-by: Vivek Reddy <vkarri@nvidia.com>
vivekrnv pushed a commit that referenced this pull request Jun 28, 2023
@mssonicbld
[submodule] Update submodule sonic-host-services to the latest HEAD a…
a06ffc9 
…utomatically (sonic-net#15645)

#### Why I did it
src/sonic-host-services
```
* bc08806 - (HEAD -> master, origin/master, origin/HEAD) Implemented ssh configurations (#32) (14 hours ago) [ycoheNvidia]
```
#### How I did it
#### How to verify it
#### Description for the changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@stephenxs stephenxs stephenxs approved these changes

@dgsudharsan dgsudharsan dgsudharsan approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@vivekrnv @stephenxs @dgsudharsan