6 TOPS AI BOX-AIBOX-3576 ,  Large language models

Introduction

AIBOX-3576 is an AIOT computing module featuring the Rockchip RK3576 octa-core 64-bit processor. It's designed for high performance and low power consumption, making it suitable for various applications such as smart edge devices and AI-powered industrial solutions. With its integrated NPU providing 6 TOPS of computing power, it supports the deployment of large-scale parametric models under the Transformer architecture. The module also supports multiple deep learning frameworks and Docker container management technology, offering a versatile solution for AI deployment. 

Features

1. [Octa-core 64-bit Al0T Processor RK3576]  RK3576, the new octa-core 64-bit high-performance AlOT processor, features a big.LlTTLE architecture (4xA72 +4xA53), an advanced lithography process, and a frequency of up to 2.2 GHz.lt ensures powerful support for high-performance computing and multitasking. The Mali-G52 MC3 GPU, delivering 145G FLOPS, is capable of supporting efficient heterogeneous computing to meet the demands of graphics-intensive applications.

2. [Strong Network Communication Capability] With dual 1000Mbps Ethernet, the Al box ensures high-speed and stable network communication, meeting the needs of various application scenarios.

3. [A Wide Range of Applications]  AIBOX-3576 is widely used in intelligent surveillance, Al education, services based on computing power, edge computing, private deployment of large models, data security, and privacy protection.

4.[Software Support]  The private deployment of ultra-large-scale parameter models under the Transformer architecture. Traditional network architectures such as CNN, RNN, and LSTM. Various deep learning frameworks including TensorFlow, PyTorch, MXNet, PaddlePaddle, ONNX, and Darknet. custom operator development. Docker container management technology.

5. [All-aluminum alloy enclosure for heat dissipation] The industrial-grade al-metal enclosure with an aluminum alloy structure for thermal conduction, The side of the top cover features a grille design for external airflow and efficient heat dissipation, ensuring computing performance and stability even under high-temperature operating conditions.

Shipping List

1 x AΙBOX-3576
1 x 12V3A Power Adapter
1 X Type-C 2.0 USB Cable

Applications

visual computing, edge computing, general arithmetic services, intelligent transportation, unmanned supermarkets, drones

Specification

• SOC:
  
  • Rockchip RK3576
  • Octa-core 64-bit processor(4xA72+4xA53),up to 2.2GHz
• GPU:
  • G52 MC3 @ 1GHz,supporting OpenGL Es 1.1/2.0/3.2, OpenCL 2.0, Vulkan 1.1
  • Built-in high-performance 2D acceleration hardware

• NPU:
  • 6 TOPS NPU, supporting INT4/8/16/FP16/BF16/TF32 mixed operations
• VPU:
  • Decoding:4K@120fps:H.265/HEVC,VP9,AVS2,AV1;4K@60fps: H.264/AVC
  • Encoding:4K@60fps: H.265/HEVC,H.264/AVC
• RAM:
  • LPDDR4(4GB/8GB optional)
• Storage:
  • eMMC(16GB/32GB/64GB/128GB/256GB optional),UFS 2.0 (optional)
• Power:
  • DC 12V/3A (DC5.5*2.1mm)
• OS:
  • Linux OS (Ubuntu)

Detailed Descriptions