Intel-sponsored
Multiple times a day, you make strategic business decisions based on what your data tells you about your , current market trends, and future projections. And you are not alone. The demand for data-driven insights has reached unprecedented levels in businesses of all sizes. To meet these needs, your organization needs high-performance servers and cloud-computing platforms capable of handling workloads associated with artificial intelligence (AI), high-performance computing (HPC), secure web servers, data analytics, and network storage. At the same time, you must strike a balance between achieving optimal performance, maintaining robust security, and optimizing your total cost of ownership (TCO). This paradox underscores the need to find innovative solutions that can answer both imperatives in the complex landscape of today’s IT infrastructures.
In this Intel-sponsored article, we suggest there are two key steps you can follow to achieve the right balance between performance and expense: choose the right hardware for your needs and match it to the right workloads. General-purpose hardware can serve you well for certain workloads, but for modern ones such as AI and predictive analytics, you’ll get better performance from processors built to handle those demanding tasks.
How to Use Intel® Accelerator Engines
Accelerate AI
Processor: 4th Gen Intel Xeon Scalable processor
Built-in accelerator: Intel® Advanced Matrix Extensions (Intel® AMX)
Example workloads: Natural language processing (NLP), recommender system, and image classification
Results:
- Up to 10x higher training and inference performance, compared to 3rd Gen Intel Xeon Scalable processors.1
- Up to 4x higher inference performance, compared to 4th Generation AMD EPYC™ processors using the same number of cores.2
Accelerate HPC
Processor: 4th Gen Intel Xeon Scalable processor
Built-in accelerator: Intel AMX
Example workloads: Scientific simulations; financial analytics; 3D modeling and analysis; and image, audio, and video processing
Results:
- Up to 2.9x higher performance per watt, compared to 3rd Gen Intel Xeon Scalable processors.3
- Up to 3.9x higher performance per watt, compared to non-accelerated workloads.4
Accelerate Data Compression and Encryption
Processor: 4th Gen Intel Xeon Scalable processor
Built-in accelerator: Intel® QuickAssist Technology (Intel® QAT)
Example workloads: Web server handshakes, data compression/decompression, and cryptography
Results:
- Up to 47% fewer cores used to support the same number of NGINX® key handshake connections per second, compared to 3rd Gen Intel Xeon Scalable processors.5
- Up to 2x higher compression throughput while using 95% fewer cores, compared to 3rd Gen Intel Xeon Scalable processors.6
Accelerate Data Analytics
Processor: 4th Gen Intel Xeon Scalable processor
Built-in accelerator: Intel® In-Memory Analytics Accelerator (Intel® IAA)
Example workloads: Database, database management system (DBMS), online analytical processing (OLAP), and online transaction processing (OLTP)
Results:
- Up to 3x higher RocksDB performance, compared to 3rd Gen Intel Xeon Scalable processors.7
- Up to 52% lower TCO, compared to 3rd Gen Intel Xeon Scalable processors.8
Accelerate Data Transformation
Processor: 4th Gen Intel Xeon Scalable processor
Built-in accelerator: Intel® Data Streaming Accelerator (Intel® DSA)
Example workloads: Network storage, software-defined networking (SDN), video streaming, and content delivery network (CDN)
Results:
- Up to 1.95x higher virtual switch (vSwitch) bi-directional throughput, compared to a software-only vSwitch solution.9
- Up to 1.6x higher input/output operations per second (IOPS) and 37% lower sequential-read latency, compared to 3rd Gen Intel Xeon Scalable processors.10
Learn More
Explore the Intel Accelerator Engines portfolio.
Read about other use cases that can benefit from built-in accelerators:
- Accelerate AI and HPC using Intel AMX.
- Accelerate HPC, storage, analytics, network, and security using Intel QAT.
- Accelerate analytics using Intel IAA.
- Accelerate analytics, storage, and networking using Intel DSA.
To learn more about what we do at Prowess Consulting, view our latest research and follow us on LinkedIn.
1 See [A16] and [A17] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
2 See [A222] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
3 See [E1] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
4 See [E2] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
5 See [N15] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
6 See [N16] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
7 See [D1] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
8 See [E8] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
9 See [W8] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
10 See [N18] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
