Author Archives: Admin

Managed vs Unmanaged vs Smart Switch: Understanding the Distinctions

Posted on by

Switches form the backbone of LANs, efficiently connecting devices within a specific LAN and ensuring effective data transmission among them. There are three main types of switches: managed switches, smart managed switches, and unmanaged switches. Choosing the right switch during network infrastructure upgrades can be challenging. In this article, we delve into the differences between these three types of switches to help determine which one can meet your actual network requirements.

What are Managed Switches, Unmanaged Switches and Smart Switches?

Managed switches typically use SNMP protocol, allowing users to monitor the switch and its port statuses, enabling them to read throughput, port utilisation, etc. These switches are designed and configured for high workloads, high traffic, and custom deployments. In large data centres and enterprise networks, managed switches are often used in the core layer of the network.

Unmanaged switches, also known as dumb switches, are plug-and-play devices with no remote configuration, management, or monitoring options. You cannot log in to an unmanaged switch or read any port utilisation or throughput of the devices. However, unmanaged switches are easy to set up and are used in small networks or adding temporary device groups to large networks to expand Ethernet port counts and connect network hotspots or edge devices to small independent networks.

Smart managed switches are managed through a web browser, allowing users to maintain their network through intuitive guidance. These smart Ethernet switches are particularly suitable for enterprises needing remote secure management and troubleshooting, enabling network administrators to monitor and control traffic for optimal network performance and reliability. Web smart managed switches have become a viable solution for small and medium-sized enterprises, with the advantage of being able to change the switch configuration to meet specific network requirements.

What is the Difference Between Them？

Next, we will elaborate on the differences between these three types of switches from the following three aspects to help you lay the groundwork for purchasing.

Configuration and Network Performance

Managed switches allow administrators to configure, monitor, and manage them through interfaces such as Command Line Interface (CLI), web interface, or SNMP. They support advanced features like VLAN segmentation, network monitoring, traffic control, protocol support, etc. Additionally, their advanced features enable users to recover data in case of device or network failures. On the other hand, unmanaged switches come with pre-installed configurations that prevent you from making changes to the network and do not support any form of configuration or management. Smart managed switches, positioned between managed and unmanaged switches, offer partial management features such as VLANs, QoS, etc., but their configuration and management options are not as extensive as fully managed switches and are typically done through a web interface.

Security Features

The advanced features of managed switches help identify and swiftly eliminate active threats while protecting and controlling data. Unmanaged switches do not provide any security features. In contrast, smart managed switches, while also offering some security features, usually do not match the comprehensiveness or sophistication of managed switches.

Cost

Due to the lack of management features, unmanaged switches are the least expensive. Managed switches typically have the highest prices due to the advanced features and management capabilities they provide. Smart managed switches, however, tend to be lower in cost compared to fully managed switches.

FeaturesPerformanceSecurityCostApplication
Managed SwitchComprehensive functionsMonitoring and controlling a whole networkHigh-levels of network securityExpensiveData center, large size enterprise networks
Smart Managed SwitchLimited but intelligent functionsIntelligent manage via a Web browserBetter network securityCheapSMBs, home offices
Unmanaged SwitchFixed configurationPlug and play with limited configurationNo security capabilitiesAffordableHome, conference rooms

How to Select the Appropriate Switch?

After understanding the main differences between managed, unmanaged, and smart managed switches, you should choose the appropriate switch type based on your actual needs. Here are the applications of these three types of switches, which you can consider when making a purchase:

  • Managed switches are suitable for environments that require highly customised and precise network management, such as large enterprise networks, data centres, or scenarios requiring complex network policies and security controls.
  • Smart managed switches are suitable for small and medium-sized enterprises or departmental networks that require a certain level of network management and flexible configuration but may not have the resources or need to maintain the complex settings of a fully managed switch.
  • Unmanaged switches are ideal for home use, small offices, or any simple network environment that does not require complex configuration and management. Unmanaged switches are the ideal choice when the budget is limited, and network requirements are straightforward.

In brief, the choice of switch type depends on your network requirements, budget, and how much time you are willing to invest in network management. If you need high control and customisation capabilities, a managed switch is the best choice. If you are looking for cost-effectiveness and a certain level of control, a smart managed switch may be more suitable. For the most basic network needs, an unmanaged switch provides a simpler and more economical solution.

Conclusion

Ultimately, selecting the appropriate switch type is essential to achieve optimal network performance and efficiency. It is important to consider your network requirements, budget, and management preferences when making this decision for your network infrastructure.

As a leading global provider of networking products and solutions, FS not only offers many types of switches, but also customised solutions for your business network. For more product or technology-related knowledge, you can visit FS Community.

Discovering Powerful FS Enterprise Switches for Your Network

Posted on by

Enterprise switches are specifically designed for networks with multiple switches and connections, often referred to as campus LAN switches. These switches are tailored to meet the needs of enterprise networks, which typically follow a three-tier hierarchical design comprising core, aggregation, and access layers. Each layer serves distinct functions within the network architecture. In this guide, we’ll delve into the intricacies of enterprise switches and discuss important factors to consider when buying them.

Data Centre, Enterprise, and Home Network Switches: Key Differences

Switch vendors provide network switches designed for different network environments. The following comparison will help you understand more about enterprise switches:

Data Centre Switches

These switches have high port density and bandwidth requirements, handling both north-south traffic (traffic between data centre external users and servers or between data centre servers and the Internet) and east-west traffic (traffic between servers within the data centre).

Enterprise Switches

They need to track and monitor users and endpoint devices to protect each connection point from security issues. Some have special features to meet specific network environments, such as PoE capabilities. With PoE technology, enterprise network switches can manage the power consumption of many endpoint devices connected to the switch.

Home Network Switches

Home network traffic is not high, meaning the requirements for switches are much lower. In most cases, switches only need to extend network connections and transfer data from one device to another without handling data congestion. Unmanaged plug-and-play switches are often used as the perfect solution for home networks because they are easy to manage, require no configuration, and are more cost-effective than managed switches.

For SOHO offices with fewer than 10 users, a single 16-port Ethernet switch is usually sufficient. However, for tech-savvy users who like to build fast, secure home networks, managed switches are often the preferred choice.

Selecting the Ideal Switch: Data Centre vs. Enterprise Networks

For large enterprise networks, redundancy in the uplink links such as aggregation and core layers should be much higher than in the access layer. This means that high availability should be the primary consideration when designing the network. To cope with high traffic volumes and minimize the risk of failures, it’s advisable to deploy two or more aggregation or core layer switches at each level. This ensures that the failure of one switch does not affect the other.

In complex networks with a large number of servers to manage, network virtualization is needed to optimise network speed and reliability. Data centre switches offer richer functionality compared to traditional LAN enterprise switches, making them crucial for the successful deployment of high-density virtual machine environments and handling the increasing east-west traffic associated with virtualization.

Key Considerations Before Selecting Enterprise Switches

Ethernet switches play a crucial role in enterprise networks, regardless of whether it’s a small or large-scale network. Before you decide to buy enterprise switches, there are several criteria you should consider:

Network Planning

Identify your specific needs, including network scale, purpose, devices to be connected, and future network plans. For small businesses with fewer than 200 users and no expansion plans, a two-tier architecture might suffice. Medium to large enterprises typically require a three-tier hierarchical network model, comprising access, distribution, and core layer switches.

Evaluate Enterprise Switches

Once you’ve established your network architecture, delve deeper into information to make an informed decision.

  • Port Speeds and Wiring Connections: Modern enterprise switches support various port speeds such as 1G Ethernet, 10GE, 40GE, and 100GE. Consider whether you need RJ45 ports for copper connections or SFP/SFP+ ports for fibre connections based on your wiring infrastructure.
  • Installation Environment: Factor in the switch’s dimensions, operating temperature, and humidity based on the installation environment. Ensure adequate rack space and consider switches that can operate in extreme conditions if needed.
  • Advanced Features: Look for advanced features like built-in troubleshooting tools, converged wired or wireless capabilities, and other specific functionalities to meet your network requirements.

Other Considerations

PoE (Power over Ethernet) switches simplify wiring for devices like security cameras and IP phones. Stackable switches offer scalability for future expansion, enhancing network availability. By considering these factors, you can make a well-informed decision when selecting enterprise switches for your network infrastructure.

How to Choose Your Enterprise Switch Supplier

Creating a functional network is often more complex than anticipated. With numerous suppliers offering similar specifications for switches, how do you make the right choice? Here are some tips for selecting a different switch supplier:

  • Once you have an idea of your ideal switch ports and speeds, opt for a supplier with a diverse range of switch types and models. This makes it easier to purchase the right enterprise switches in one go and avoids compatibility and interoperability issues.
  • Understanding hardware support services, costs, and the software offered by switch suppliers can save you from unnecessary complications. Warranty is a crucial factor when choosing a switch brand. Online and offline technical assistance and troubleshooting support are also important considerations.

If you’ve reviewed the above criteria but are still unsure about the feasibility of your plan, seek help from network technicians. Most switch suppliers offer technical support and can recommend products based on your specific needs.

Conclusion

In summary, enterprise switches are essential components of contemporary network infrastructures, meeting the varied requirements of various network environments. When choosing, it’s essential to factor in elements like network planning, port speeds, installation environment, advanced features, and supplier support services. By carefully assessing these criteria and seeking guidance as necessary, you can ensure optimal performance and reliability for the network infrastructure.

How FS Can Help

FS offers a variety of models of enterprise switches and provides high-performance, highly reliable, and premium service network solutions, helping your enterprise network achieve efficient operations. Furthermore, FS not only offers a 5-year warranty for most switches but also provides free software upgrades. Additionally, our 24/7 customer service and free technical support are available in all time zones.

Exploring FS Enterprise Switches: A Comprehensive Insight

Posted on by

As a business owner, selecting the right switch for your enterprise network can be an ongoing challenge. You not only need to deal with dozens of suppliers offering various switch options but also consider the actual setup environment. In such situations, you may encounter a variety of questions, such as compatibility with existing equipment, required functionalities, and more.

FS enterprise switches perform exceptionally well in multiple scenarios, meeting the fundamental needs of modern enterprises by optimising networking, enhancing network reliability, and simplifying operations. In this article, we will introduce three series of enterprise switches from FS to help you make better choices.

FS S3910 Series Enterprise Switches

Considering users’ needs for security, availability, and ease of operation, the FS S3910 series gigabit Ethernet switches are equipped with a variety of features at both the software and hardware levels.

Software

The S3910 series enterprise switches support various security policies and protocols. Administrators can utilise the S3910 switch’s anti-DDoS attack, illegal ARP packet inspection, and various hardware ACL policies for protection, creating a clean network environment for end users. Additionally, it supports various IPv4 and IPv6 protocols, allowing users to build flexible networks according to their requirements. Lastly, it supports multiple standard management methods such as SNMP, CLI, RMON, SSH, Syslog, NTP/SNTP, FTP, TFTP, and Web GUI, catering to different user preferences.

Hardware

The key components of the S3910 series enterprise switches are reinforced with conformal coating, enhancing device protection and reliability in harsh environments. Additionally, the switch ports can withstand 8 kV lightning strikes. Furthermore, hot-swappable power supplies and redundant power can minimise downtime. Four fixed SFP or SFP+ ports can be used for physical stacking, providing greater flexibility in network topology design.

An important feature of the FS S3910 series gigabit switches is their green energy-saving capability. They incorporate a port auto-power-off function. If a port remains idle for a while, the system automatically switches the port to energy-saving mode. When there is data transmission or reception, the port is awakened by periodically sending monitoring frames, resuming service.

Application

The S3910 series gigabit enterprise switches can fully meet the requirements of various medium- to large-scale network aggregation layers and can serve as core switches in some small-scale networks. Common application areas include:

  • Gigabit access for LAN networks in large-scale park networks such as government buildings, universities, large enterprises, and manufacturing industries.
  • Gigabit access for commercial networks in sectors such as healthcare, libraries, conference centres, and exhibition halls.

FS S5800 Series Enterprise Switches

The FS S5800 series switches are layer 3 switches designed in a compact 1U form factor, suitable for most rack-mount scenarios requiring high density. They come with 1+1 hot-swappable DC power supplies and redundant fans, support MLAG, and offer higher reliability with the advantage of individual device upgrades.

There are seven types in the FS S5800 series, each with different port configurations, but all featuring multifunctional design, flexible operations, and enhanced security for validated performance, addressing common challenges in network solutions. Here are the notable advantages of the FS S5800 series switches:

  • Achieve higher capacity with up to 600 Gbps switching capacity at a lower cost, with optimal traffic control for microsecond-level latency.
  • Support ARP checks and IP Source Guard features to protect business networks from attacks.
  • Real-time configuration, monitoring, and troubleshooting of devices without CLI expertise. Visual interface for clear system status.
  • Build high-speed and future-ready networks for applications requiring higher bandwidth, such as 4K videos, HD video conferences, low-latency gaming, etc.

Different layers in the three-tiered model may have varying requirements for switches. Whether current or future demands, the FS S5800 series switches offer multiple options. For more FAQs about the FS S5800 series switches, you can visit the FS community.

FS S3900 Series Enterprise Switches

The FS S3900 series switches are gigabit Ethernet L2/L3 Lite managed switches, typically featuring 24 or 48 1G downlink ports and 4 10G uplink ports for stacking. The S3900 series switches also support various features such as advanced QoS, 1+1 redundant power supplies, and fans, making them an ideal choice for small and medium-sized enterprises, campuses, and branch networks. Here are the key features of the FS S3900 series switches:

Support Stacking

Simplified network management. The 10G high-speed uplink ports provide flexibility and scalability for enterprise access deployments.

Minimised Power Consumption

The S3900-24T4S switch adopts a fanless design for low-noise operation, addressing the issue of high noise levels in small switch deployments in office environments, thus enhancing overall system reliability.

Efficient Traffic Management

The QoS of the S3900 series switches enables better traffic control, reducing network latency and congestion, and providing improved service capabilities for designated network communications.

Enhanced Security

Leveraging the Secure Shell (SSH) protocol of the S3900 series switches, remote servers can be easily controlled and modified via the Internet. Furthermore, SSH uses key login functionality to encrypt and authenticate network data, limiting unauthorized access and effectively ensuring the normal operation of user network services.

Conclusion

Overall, FS provides three series of enterprise switches – S3900, S3910, and S5800 – designed to meet various network scales and requirements, delivering flexible, efficient, and secure network solutions.

While the S3900 series is a stackable switch supporting high-performance Ethernet stacking technology for easier network expansion and management, the S3910 series goes a step further as a high-performance enterprise-level switch with higher stacking bandwidth and more stack members, making it ideal for demanding network environments. On the other hand, the S5800 series stands out as a high-performance switch specifically designed for data centres and large enterprise networks, featuring high-density 10G and 40G port configurations, making it perfect for high-bandwidth scenarios.

If you’re still hesitating about choosing FS switches, why not take a look at what FS users have to say about our switches?

How FS Can Help

As a global cross-industry network solutions provider in the ICT sector, FS offers products and customised solutions to global data centres, telecommunications, and various enterprises. Register on the FS website now to enjoy comprehensive services immediately.

Accelerating Data Centers: FS Unveils Next-Gen 400G Solutions

Posted on by

As large-scale data centers transition to faster and more scalable infrastructures and with the rapid adoption of hyperscale cloud infrastructures and services, existing 100G networks fall short in meeting current demands. As the next-generation mainstream port technology, 400G significantly increases network bandwidth, enhances link utilization, and assists operators, OTT providers, and other clients in effectively managing unprecedented data traffic growth.

To meet the demand for higher data rates, FS has been actively developing a series of 400G products, including 400G switches, optical modules, cables, and network adapters.

FS 400G Switches

The emergence of 400G data center switches has facilitated the transition from 100G to 400G in data centers, providing flexibility for building large-scale leaf and spine designs while reducing the total number of network devices. This reduction can save costs and decrease power consumption. Whether it’s the powerful N9510-64D or the versatile N9550 series, FS 400G data center switches can deliver the performance and flexibility required for today’s data-intensive applications.

Of particular note is that, as open network switches, the N8550 and N9550 series switches can enhance flexibility by freely choosing preferred operating systems. They are designed to meet customer requirements by providing comprehensive support for L3 features, SONiC and Broadcom chips, and data center functionalities. Additionally, FS offers PicOS-based open network switch operating system solutions, which provide a more flexible, programmable, and scalable network operating system (NOS) at a lower total cost of ownership (TCO).

FS 400G Transceivers

FS offers two different types of packaging for its 400G transceivers: QSFP-DD and OSFP, developed to support 400G with performance as their hallmark. Additionally, FS provides CFP2 DCO transceivers for coherent transmission at various rates (100G/200G/400G) in DWDM applications. Moreover, FS has developed InfiniBand cables and transceivers to enhance the performance of HPC networks, meeting the requirements for high bandwidth, low latency, and highly reliable connections.

FS conducts rigorous testing on its 400G optical modules using advanced analytical equipment, including TX/RX testing, temperature measurement, rate testing, and spectrometer evaluation tests, to ensure the performance and compatibility of the optical modules.

FS 400G Cables

When planning 400G Ethernet cabling or connection schemes, it’s essential to choose devices with low insertion loss and good return loss to meet the performance requirements of high-density data center links. FS offers various wiring options, including DAC/AOC cables and breakout cables. FS DAC/AOC breakout cables provide three connection types to meet high-density requirements for standard and combination connector configurations: 4x100G, 2x200G, and 8x50G. Their low insertion loss and ultra-low crosstalk effectively enhance transmission performance, while their high bend flexibility offers cost-effective solutions for short links.

FS 400G Network Adapters

FS 400G network adapters utilize the industry-leading ConnectX-7 series cards. The ConnectX-7 VPI card offers a 400Gb/s port for InfiniBand, ultra-low latency, and delivers between 330 to 3.7 billion messages per second, enabling top performance and flexibility to meet the growing demands of data center applications. In addition to all existing innovative features from previous versions, the ConnectX-7 card also provides numerous enhanced functionalities to further boost performance and scalability.

FS 400G Networking Soluitons

To maximize the utilization of the 400G product series, FS offers comprehensive 400G network solutions, such as solutions tailored for upgrading from 100G to high-density 400G data centers. These solutions provide diverse and adaptable networking options customized for cloud data centers and AI applications. They are designed to tackle the continuous increase in data center traffic and the growing need for high-bandwidth solutions in extensive 400G data center networks.

For more information about FS 400G products, please read FS 400G Product Family Introduction.

How FS Can Help

Register for an FS account now, choose from our range of 400G products and solutions tailored to your needs, and effortlessly upgrade your network.

Exploring FS 100G EDR InfiniBand Solutions: Powering HPC and AI

Posted on by

In the realm of high-speed processing and complex workloads, InfiniBand is pivotal for HPC, AI, and hyperscale clouds. This article explores FS’s 100G EDR InfiniBand solution, emphasizing the deployment of QSFP28 EDR transceivers and cables to boost network performance.

What are the InfiniBand HDR 100G Cables and Transceivers

InfiniBand EDR 100G Active AOC Cables

The NVIDIA InfiniBand MFA1A00-E001, an active optical cable based on Class 1 FDA Laser, is designed for InfiniBand 100Gb/s EDR systems. With lengths ranging from 1m to 100m, these cables offer predictable latency, consuming a max of 3.5W, and enhancing airflow in high-speed HPC environments.

InfiniBand EDR 100G Passive Copper Cables

The NVIDIA InfiniBand MCP1600-E001E30 is available in lengths of 0.5m to 3m. With four high-speed copper pairs supporting up to 25Gb/s, it offers efficient short-haul connectivity. Featuring EEPROM on each QSFP28 port, it enhances host system communication, enabling higher port bandwidth, density, and configurability while reducing power demand in data centers.

InfiniBand EDR 100G Optical Modules

The 100Gb EDR optical modules, packaged in QSFP28 form factor with LC duplex or MTP/MPO-12 connectors, are suitable for both EDR InfiniBand and 100G Ethernet. They can be categorized into QSFP28 SR4, QSEP28 PSM4, QSFP28 CWDM4, and QSFP28 LR4 based on transmission distance requirements.

100Gb InfiniBand EDR System Scenario Applications

InfiniBand has gained widespread adoption in data centers, artificial intelligence, and other domains, primarily employing the spine-leaf architecture. In data centers, transceivers and cables play a pivotal role in two key scenarios: Data Center to User and Data Center Interconnects.

For more on application scenarios, please read 100G InfiniBand EDR Solution.

Conclusion

Amidst the evolving landscape of 100G InfiniBand EDR, FS’s solution emerges as mature and robust. Offering high bandwidth, low latency, and reduced power consumption, it enables higher port density and configurability at a lower cost. Tailored for large-scale data centers, HPC, AI, and future network expansion, customers can choose products based on application needs, transmission distance, and deployment. FS 100G EDR InfiniBand solution meets the escalating demands of modern computational workloads.

Navigating Optimal GPU-Module Ratios: Decoding the Future of Network Architecture

Posted on by

The market’s diverse methods for calculating the optical module-to-GPU ratio lead to discrepancies due to varying network structures. The precise number of optical modules required hinges on critical factors such as network card models, switch models, and the scalable unit count.

Network Card Model

The primary models are ConnectX-6 (200Gb/s, for A100) and ConnectX-7 (400Gb/s, for H100), with the upcoming ConnectX-8 800Gb/s slated for release in 2024.

Switch Model

MQM 9700 switches (64 channels of 400Gb/s) and MQM8700 switches (40 channels of 200Gb/s) are the main types, affecting optical module needs based on transmission rates.

Number of Units (Scalable Unit)

Smaller quantities use a two-tier structure, while larger quantities employ a three-tier structure, as seen in H100 and A100 SuperPODs.

  • H100 SuperPOD: Each unit consists of 32 nodes (DGX H100servers) and supports a maximum of 4 units to form a cluster, using a two-layer switching architecture.
  • A100 SuperPOD: Each unit consists of 20 nodes (DGX A100 servers) and supports a maximum of 7 units to form a cluster. If the number of units exceeds 5, a three-layer switching architecture is required.

Optical Module Demand Under Four Network Configurations

Projected shipments of H100 and A100 GPUs in 2023 and 2024 indicate substantial optical module demands, with a significant market expansion forecasted. The following are four application scenarios:

  • A100+ConnectX6+MQM8700 Three-layer Network: Ratio 1:6, all using 200G optical modules.
  • A100+ConnectX6+MQM9700 Two-layer Network: 1:0.75 of 800G optical modules + 1:1 of 200G optical modules.
  • H100+ConnectX7+MQM9700 Two-layer Network: 1:1.5 of 800G optical modules + 1:1 of 400G optical modules.
  • H100+ConnectX8 (yet to be released)+MQM9700 Three-layer Network: Ratio 1:6, all using 800G optical modules.

For detailed calculations regarding each scenario, you can click on this article to learn more.

Conclusion

As technology progresses, the networking industry anticipates the rise of high-speed solutions like 400G multimode optical modules. FS offers optical modules from 1G to 800G, catering to evolving network demands.

Register for an FS account, select products that suit your needs, and FS will tailor an exclusive solution for you to achieve network upgrades.

Revolutionizing Data Center Networking: From Traditional to Advanced Architectures

Posted on by

As businesses upgrade their data centers, they’re transitioning from traditional 2-layer network architectures to more advanced 3-layer routing frameworks. Protocols like OSPF and BGP are increasingly used to manage connectivity and maintain network reliability. However, certain applications, especially those related to virtualization, HPC, and storage, still rely on 2-layer network connectivity due to their specific requirements.

VXLAN Overlay Network Virtualization

In today’s fast-paced digital environment, applications are evolving to transcend physical hardware and networking constraints. An ideal networking solution offers scalability, seamless migration, and robust reliability within a 2-layer framework. VXLAN tunneling technology has emerged as a key enabler, constructing a virtual 2-layer network on top of the existing 3-layer infrastructure. Control plane protocols like EVPN synchronize network states and tables, fulfilling contemporary business networking requirements.

Network virtualization divides a single physical network into distinct virtual networks, optimizing resource use across data center infrastructure. VXLAN, utilizing standard overlay tunneling encapsulation, extends the control plane using the BGP protocol for better compatibility and flexibility. VXLAN provides a larger namespace for network isolation across the 3-layer network, supporting up to 16 million networks. EVPN disseminates layer 2 MAC and layer 3 IP information, enabling communication between VNIs and supporting both centralized and distributed deployment models.

For enhanced flexibility, this project utilizes a distributed gateway setup, supporting agile execution and deployment processes. Equal-Cost Multipath (ECMP) routing and other methodologies optimize resource utilization and offer protection from single node failures.

RoCE over EVPN-VXLAN

RoCE technology facilitates efficient data transfer between servers, reducing CPU overhead and network latency. Integrating RoCE with EVPN-VXLAN enables high-throughput, low-latency network transmission in high-performance data center environments, enhancing scalability. Network virtualization divides physical resources into virtual networks tailored to distinct business needs, allowing for agile resource management and rapid service deployment.

Simplified network planning, deployment, and operations are essential for managing large-scale networks efficiently. Unnumbered BGP eliminates the need for complex IP address schemes, improving efficiency and reducing operational risks. Real-time fault detection tools like WJH provide deep network insights, enabling quick resolution of network challenges.

Conclusion

Essentially, recent advancements in data center networking focus on simplifying network design, deployment, and management. Deploying technological solutions such as Unnumbered BGP eliminates the need for complex IP address schemes, reducing setup errors and boosting productivity. Tools like WJH enable immediate fault detection, providing valuable network insights and enabling quick resolution of network issues. The evolution of data center infrastructures is moving towards distributed and interconnected multi-data center configurations, requiring faster network connections and improving overall service quality for users.

For detailed information on EVPN-VXLAN and RoCE, you can read: Optimizing Data Center Networks: Harnessing the Power of EVPN-VXLAN, RoCE, and Advanced Routing Strategies.

HPC and Future Networks: Architectures, Technologies, and Innovations

Posted on by

High-Performance Computing (HPC) has become a crucial tool for solving complex problems and pushing the boundaries of scientific research, artificial intelligence, and various other applications. However, efficient operation of HPC systems requires specialized infrastructure and support. HPC has emerged as an indispensable tool across various domains, capable of addressing complex challenges and driving innovation in fields such as science, meteorology, finance, healthcare, and artificial intelligence.

Understanding the importance of data centers in supporting HPC is essential, as knowing the three fundamental components—compute, storage, and networking—that constitute high-performance computing systems is crucial.

Facilities in High-Performance Computing

Intensive computations in HPC environments generate substantial heat, necessitating advanced cooling solutions. Efficient cooling prevents overheating, ensuring system stability and prolonging hardware lifespan. Supporting HPC, data centers employ cutting-edge cooling facilities, including liquid cooling systems and precision air conditioning. Moreover, data center architects explore innovative cooling technologies like immersion cooling, submerging servers in special liquids for effective heat dissipation.

Success in HPC data centers relies on a range of specialized equipment tailored to meet the unique demands of high-performance computing. Key components include data center switches, server network cards, high-speed optical modules, DAC and AOC cables, and power supplies.

The Growing Demand for Network Infrastructure in High-Performance Computing

With revolutionary technologies like 5G, big data, the Internet of Things (IoT), and artificial intelligence (AI) permeating various aspects of society, the trajectory towards an intelligent, digitized society over the next two to three decades is inevitable. Data center computing power has become a powerful driving force, shifting focus from resource scale to computational scale.

To meet the ever-growing demand for computing power, high-performance computing (HPC) has become a top priority, especially as computational cluster scales expand from the petascale to the exascale. This shift imposes increasingly higher demands on interconnect network performance, marking a clear trend of deep integration between computation and networking. HPC introduces different network performance requirements in three typical scenarios: loosely coupled computing scenarios, tightly coupled scenarios, and data-intensive computing scenarios.

In summary, high-performance computing (HPC) imposes stringent requirements on network throughput and latency. To meet these demands, the industry widely adopts Remote Direct Memory Access (RDMA) as an alternative to the TCP protocol to reduce latency and maximize CPU utilization on servers. Despite its advantages, the sensitivity of RDMA to network packet loss highlights the importance of lossless networks.

The Evolution of High-Performance Computing Networks

Traditional data center networks have historically adopted a multi-hop symmetric architecture based on Ethernet technology, relying on the TCP/IP protocol stack for transmission. However, despite over 30 years of development, Remote Direct Memory Access (RDMA) technology has gradually replaced TCP/IP, becoming the preferred protocol for HPC networks. Additionally, the choice of RDMA network layer protocols has evolved from expensive lossless networks based on the InfiniBand (IB) protocol to intelligent lossless networks based on Ethernet.

From TCP to RDMA

In traditional data centers, Ethernet technology and the TCP/IP protocol stack have been the norm for building multi-hop symmetric network architectures. However, due to two main limitations—latency issues and CPU utilization—the TCP/IP network is no longer sufficient to meet the demands of high-performance computing. To address these challenges, RDMA functionality has been introduced at the server side. RDMA is a direct memory access technology that enables data transfer directly between computer memories without involving the operating system, thus bypassing time-consuming processor operations. This approach achieves high bandwidth, low latency, and low resource utilization.

From IB to RoCE

RDMA enables direct data read and write between applications and network cards. RDMA’s zero-copy mechanism allows the receiving end to read data directly from the sending end’s memory, significantly reducing CPU burden and improving CPU efficiency. Currently, there are three choices for RDMA network layer protocols: InfiniBand, iWARP (Internet Wide Area RDMA Protocol), and RoCE (RDMA over Converged Ethernet). Although RoCE offers many advantages, its sensitivity to packet loss requires support from lossless Ethernet. This evolution of HPC networks reflects a continuous pursuit of enhanced performance, efficiency, and interoperability.

Enterprise Innovative Solution: Designing High-Performance Data Center Networks

The architecture of data center networks has evolved from the traditional core-aggregation-access model to the modern Spine-Leaf design. This approach fully utilizes network interconnection bandwidth, reduces multi-layer convergence rates, and is easy to scale. When traffic bottlenecks occur, horizontal expansion can be achieved by increasing uplink links and reducing convergence ratios, minimizing the impact on bandwidth expansion. Overlay networks utilize EVPN-VXLAN technology to achieve flexible network deployment and resource allocation.

This solution draws on the design experience of internet data center networks, adopting the Spine-Leaf architecture and EVPN-VXLAN technology to provide a versatile and scalable network infrastructure for upper-layer services. Production and office networks are isolated by domain firewalls and connected to office buildings, labs, and regional center exits. The core switches of the production network provide up to 1.6Tb/s of inter-POD communication bandwidth and 160G of high-speed network egress capacity, with each POD’s internal horizontal network capacity reaching 24Tb, ensuring minimal packet loss. The building wiring is planned based on the Spine-Leaf architecture, with each POD’s switches interconnected using 100G links and deployed in TOR mode. The overall network structure is more streamlined, improving cable deployment and management efficiency.

Future-Oriented Equipment Selection

When envisioning and building data center networks, careful consideration of technological advancements, industry trends, and operational costs over the next five years is crucial. The choice of network switches plays a vital role in the overall design of data center networks. Traditional large-scale network designs often opt for chassis-based equipment to enhance the overall capacity of the network system, but scalability is limited.

Therefore, for the network equipment selection of this project, NVIDIA strongly advocates for adopting a modular switch network architecture. This strategic approach facilitates rapid familiarization by maintenance teams. Additionally, it provides operational flexibility for future network architecture adjustments, equipment reuse, and maintenance replacements.

In response to the ongoing trend of business transformation and the surge in demand for big data, most data center network designs adopt the mature Spine-Leaf architecture, coupled with EVPN-VXLAN technology to achieve efficient network virtualization. This architectural approach ensures convenient high-bandwidth, low-latency network traffic, laying the foundation for scalability and flexibility.

How FS Can Help

FS is a professional provider of communication and high-speed network system solutions for network, data center, and telecommunications customers. Leveraging NVIDIA® InfiniBand switches, 100G/200G/400G/800G InfiniBand transceivers, and NVIDIA® InfiniBand adapters, FS offers customers a comprehensive set of solutions based on InfiniBand and lossless Ethernet (RoCE). These solutions meet diverse application requirements, enabling users to accelerate their businesses and enhance performance. For more information, please visit FS.COM.

The Future Network: Unlocking the Potential of Training Super-Large-Scale AI Models

Posted on by

From Transformers to the widespread adoption of ChatGPT in 2023, people have come to realize that increasing model parameters can enhance performance, aligning with the scaling law of parameters and performance. Particularly, when the parameter scale exceeds trillions, the language comprehension, logical reasoning, and problem-solving capabilities of large AI models improve rapidly.

To meet the demands of efficient distributed computing in large-scale training clusters, the training process of AI models typically involves various parallel computing modes such as data parallelism, pipeline parallelism, and tensor parallelism. In these parallel modes, collective communication operations among multiple computing devices become crucial. Therefore, designing efficient cluster networking schemes in large-scale training clusters of AI models is key to reducing communication overhead and improving the effective computation-to-communication time ratio of GPUs.

Challenges in Scaling GPU Networks for Efficient Training of Ultra-Large AI Models

The computing demands of artificial intelligence applications are experiencing exponential growth, with model sizes continuously expanding, necessitating significant computational power and high memory requirements. Appropriate parallelization methods such as data, pipeline, and tensor parallelism have become key to improving training efficiency. Training extra-large models requires clusters containing thousands of GPUs, utilizing high-performance GPUs and RDMA protocols to achieve throughputs of 100 to 400 Gbps. Specifically, achieving high-performance interconnection among thousands of GPUs poses several challenges in terms of network scalability:

  • Challenges encountered in large-scale RDMA networks, such as head-of-line blocking and PFC deadlock storms.
  • Network performance optimization, including more effective congestion control and load balancing techniques.
  • Issues with NIC connectivity, as individual hosts are subject to hardware performance limitations. Addressing how to establish thousands of RDMA QP connections.
  • Selection of network topology, considering whether to adopt traditional Fat Tree structures or reference high-performance computing network topologies like Torus or Dragonfly.

Optimizing GPU Communication for Efficient AI Model Training Across Machines

In AI large-scale model training, GPU communication within and across machines generates significant data. With billions of model parameters, communication from parallelism can reach hundreds of GB. Efficient completion relies on GPU communication bandwidth within machines. GPUs should support high-speed protocols to reduce CPU memory copying. PCIe bus bandwidth determines if network card bandwidth is fully utilized. For example, with PCIe 3.0 (16 lanes = 16GB/s), if inter-machine communication has 200Gbps bandwidth, network performance may not be fully utilized.

Crucial Factors in AI Large-Scale Model Training Efficiency

In data communication, network latency comprises two components: static latency and dynamic latency. Static latency includes data serialization, device forwarding, and electro-optical transmission delays, determined by the forwarding chip’s capacity and transmission distance, representing a constant value when network topology and data volume are fixed. In contrast, dynamic latency significantly affects network performance, including queuing delays within switches and delays caused by packet loss and retransmission typically due to network congestion. Besides latency, network fluctuations introduce latency jitter, affecting training efficiency.

Critical for Computational Power in Large-Scale AI Model Training

Cluster computing power is crucial for AI model training speed. Network system reliability forms the foundation of cluster stability. Network failures disrupt computing node connections, impairing overall computing capability. Performance fluctuations may decrease resource utilization. Fault-tolerant replacement or elastic expansion may be necessary to address failed nodes during training tasks. Additionally, unexpected network failures can lead to communication library timeouts, severely impacting efficiency. Therefore, obtaining detailed throughput, packet loss, and other information is vital for fault detection.

The Role of Automated Deployment and Fault Detection in Large-Scale AI Clusters

The establishment of intelligent lossless networks often relies on RDMA protocols and congestion control mechanisms, accompanied by a variety of complex configurations. Any misconfiguration of these parameters can potentially impact network performance and lead to unforeseen issues. Therefore, efficient and automated deployment can effectively enhance the reliability and efficiency of large-scale model cluster systems.

Similarly, in complex architectural and configuration scenarios, timely and accurate fault localization during business operations is crucial for ensuring overall business efficiency. Automated fault detection aids in quickly identifying issues, notifying management accurately, and reducing costs associated with issue identification. It can swiftly identify root causes and provide corresponding solutions.

Large-scale AI models have specific requirements in terms of scale, bandwidth, stability, latency/jitter, and automation capabilities. However, there still exists a technological gap in current data center network configurations to fully meet these requirements.

Al Intelligent Computing Center Network Architecture Design Practice

Traditional cloud data center networks prioritize north-south traffic, leading to congestion, high latency, and bandwidth constraints for east-west traffic. For intelligent computing scenarios, it’s recommended to build dedicated high-performance networks to accommodate workloads, meeting high-bandwidth, low-latency, and lossless requirements.

Based on current mature commercial switches, it is recommended to consider different models of InfiniBand/RoCE switches and the supported GPU scale to set the following specifications for physical network architecture:

Standard: Based on InfiniBand HDR switches, a dual-layer Fat-Tree network architecture supports up to 800 GPU cards per cluster.

Large-scale: Based on 128-port 100G Ethernet switches, a RoCE dual-layer Fat-Tree network architecture supports up to 8192 GPU cards per cluster.

Extra-large: Based on InfiniBand HDR switches, an InfiniBand three-layer Fat-Tree network architecture supports up to 16000 GPU cards per cluster.

Extra-extra-large: Based on InfiniBand Quantum-2 switches or equivalent Ethernet data center switches, adopting a three-layer Fat-Tree network architecture supports up to 100000 GPU cards per cluster.

In addition, high-speed network connections are crucial for ensuring efficient data transmission and processing.

How FS Can Help

FS provides high-quality connectivity products to meet the demands of AI model network deployment. The FS product portfolio includes (200G, 400G) InfiniBand switches, data center switches (10G, 40G, 100G, 400G) network cards, and (10/25G, 40G, 50/56G, 100G) optical modules, accelerating AI model training and inference processes. Optical modules offer high bandwidth, low latency, and low error rates, enhancing data center network capabilities for faster and more efficient AI computing. For more information, please visit the FS website.

Enhancing Data Center Networks with InfiniBand Solutions

Posted on by

With the rapid growth of data centers driven by expansive models, cloud computing, and big data analytics, there is an increasing demand for high-speed data transfer and low-latency communication. In this complex network ecosystem, InfiniBand (IB) technology has become a market leader, playing a vital role in addressing the challenges posed by the training and deployment of expansive models. Constructing high-speed networks within data centers requires essential components such as high-rate network cards, optical modules, switches, and advanced network interconnect technologies.

NVIDIA Quantum™-2 InfiniBand Switch

When selecting switches, NVIDIA’s QM9700 and QM9790 series stand out as the most advanced devices. Built on NVIDIA Quantum-2 architecture, they offer 64 NDR 400Gb/s InfiniBand ports within a standard 1U chassis. This breakthrough translates to an individual switch providing a total bidirectional bandwidth of 51.2 terabits per second (Tb/s), along with an unprecedented handling capacity exceeding 66.5 billion packets per second (BPPS).

The NVIDIA Quantum-2 InfiniBand switches extend beyond their NDR high-speed data transfer capabilities, incorporating extensive throughput, on-chip compute processing, advanced intelligent acceleration features, adaptability, and sturdy construction. These attributes establish them as the quintessential selections for sectors involving high-performance computing (HPC), artificial intelligence, and expansive cloud-based infrastructures. Additionally, the integration of NDR switches helps minimize overall expenses and complexity, propelling the progression and evolution of data center network technologies.

It can be said that NVIDIA Quantum-2 InfiniBand switches not only feature high-speed NDR data transfer capabilities but also integrate extensive throughput, on-chip compute processing, advanced intelligent acceleration features, and robust structure. These attributes make them a typical choice in the realm of High-Performance Computing (HPC), Artificial Intelligence, and a wide range of cloud-based infrastructure applications. Moreover, the integration of NDR switches helps minimize overall cost and complexity, thereby promoting the development of data center network technology.

Also Check- Revolutionizing Data Center Networks: 800G Optical Modules and NDR Switches | FS Community

ConnectX®-7 InfiniBand Card

The NVIDIA ConnectX®-7 InfiniBand network card (HCA) ASIC delivers a staggering data throughput of 400Gb/s, supporting 16 lanes of PCIe 5.0 or PCIe 4.0 host interface. Utilizing advanced SerDes technology with 100Gb/s per lane, the 400Gb/s InfiniBand is achieved through OSFP connectors on both the switch and HCA ports. The OSFP connector on the switch supports two 400Gb/s InfiniBand ports or 200Gb/s InfiniBand ports, while the network card HCA features one 400Gb/s InfiniBand port. The product range includes active and passive copper cables, transceivers, and MPO fiber cables. Notably, despite both using OSFP packaging, there are differences in physical dimensions, with the switch-side OSFP module equipped with heat fins for cooling.

OSFP 800G Optical Transceiver

The OSFP-800G SR8 Module is designed for use in 800Gb/s 2xNDR InfiniBand systems throughput up to 30m over OM3 or 50m over OM4 multimode fiber (MMF) using a wavelength of 850nm via dual MTP/MPO-12 connectors. The dual-port design is a key innovation that incorporates two internal transceiver engines, fully unleashing the potential of the switch. This allows the 32 physical interfaces to provide up to 64 400G NDR interfaces. This high-density and higgh-bandwidth design enables data centers to meet the growing network demands and requirements of applications such as high-performance computing artificial intelligence, and cloud infrastructure.

FS’s OSFP-800G SR8 Module offers superior performance and dependability, offering strong optical interconnection options for data centers. This module empowers data centers to harness the full performance capabilities of the QM9700/9790 series switch, supporting the transmission of data with both high bandwidth and low latency.

NDR Optical Connection Solution

Addressing the NDR optical connection challenge, the NDR switch ports utilize OSFP with eight channels per interface, each employing 100Gb/s SerDes. This allows for three mainstream connection speed options: 800G to 800G, 800G to 2X400G, and 800G to 4X200G. Additionally, each channel supports downgrade from 100Gb/s to 50Gb/s, facilitating interoperability with previous-generation HDR devices. The 400G NDR series cables and transceivers offer diverse product choices for configuring network switch and adapter systems, focusing on data center lengths of up to 500 meters to accelerate AI computing systems. The various connector types, including passive copper cables (DAC), active optical cables (AOC), and optical modules with jumpers, cater to different transmission distances and bandwidth requirements, ensuring low latency and an extremely low bit error rate for high-bandwidth AI and accelerated computing applications. Please see the article Infiniband NDR OSFP Solution for deployment details from FS community.