��ǿAIоƬ��AMD��MI325X��ܳ�Ӣΰ��H200

2024-10-12 11:02

��գ��оƬ��ͷAMD��һ��ӡ��̵�AI��

��ʱ��10��10�գ�AMD�ھɽ�ɽ�ٿ��Advancing AI��ᡣ��һ�Σ��Ǵ��Ӳ��Ʒ��°�Instinct MI325X ��EPYC ��µĵ�� DPU Pensandoϵ�С�

��Щ�¼��Ƴ��AMD ��ŵ��ʽ AI ��ܷ��±�׼��Щ�� AMD ��оƬ��һ��֡�AMD �ڸ��Ѿ��ռ�˳��ھ��Ӣ�ض��˾��г��ݶռ�� 34% ��оƬ��롣AMD רע��ЩоƬ��õ��Ӧ AI��

“��ǵ�Ŀ�� AMD ��Ϊ�˵�� AI ��쵼�ߣ�”��ϯִ�й��˷� (Lisa Su)�ڽ��Ļ��ݽ��б�ʾ��о��΢��˾��Meta Platforms Inc.��Databricks Inc. �ͼ׹��Ĺ�˾�� AI �쵼�ߵĸ߹ܣ��Լ� Reka AI Inc.��Essential AI Labs Inc.��Fireworks AI �� Luma AI Inc. �ȳ��˾�ĸ߹ܣ��Ƕ�� AMD �ĺ��͡�

AMD��Ѹ��𣬶�Ӣΰ�﹫˾��˹��ܻ��ʩ��ҵ��λ��Խ��Խ��в�� MI300X �˹��оƬ�ĳɹ��ڽ�һ��г��λ��оƬ�ڽ��Щʱ��Ƴ��Ԥ�ƽ�Ϊ�ù�˾�� 40 ��Ԫ��˹��оƬ��۶

AMD ��Ϊֹ��ǿ�� AI оƬ

AMD Instinct MI325X ��ڸù�˾�� CDNA 3 �ܹ��ּ��ʵ�ֳ��ܺ͸��ߵ��Ч��ִ��̵� AI ��񣬰��ѵ��ģ�͡�΢��ܺ� AI ��Ȼ��ģ�ͽ��ṩ��û��

MI325X�� AMD CDNA 3 GPU �ܹ��䱸 256GB ��һ�� HBM3E �ߴ��ڴ档�� 1530 �ڸ��ܡ��ṩ�� 6TB/s ��ڴ�� FP8 �� FP16 ��·ֱ�ﵽ 2.6 PF �� 1.3 PF �ķ�ֵ��ܡ�

��Ӣΰ��һ��콢GPU ��H200��ȣ�MI325X��ڴ��256Gvs141G��ڴ��Ҳ��ߣ�6TB/s vs 4.8TB/s��棬��ȻӢΰ��ٷ��H200��FP16 ��ɴ�1.9 PF��semianalysisʵ�⣬��ʵ��ԼΪ1 PF��H100��ƽ��MI325X��30%��

��AMD MI325X��ı��ƽ��ԽH200 30%��һ��ơ�

��MI325X��ļ��ɵ�GPUƽ̨�� 8 �� MI325X��ƽ̨�ܹ��ṩ 2TB HBM3E �ߴ��ڴ棬FP8 ��µ��۷�ֵ��ܴﵽ 20.8 PF��FP16 ��´ﵽ 10.4 PF��ϵͳ�䱸 AMD Infinity Fabric ��ߴ� 896 GB/s��ڴ��ﵽ�� 48 TB/s��

��H200�ļ��ƽ̨H200 HGX��MI325Xƽ̨�ṩ1.8��ڴ��1.3��ڴ��1.3��ˮƽ��

��H200 HGX��1.4��ı��ˮƽ��

AMD��GPU��ϵͳROCm�ڹ�ȥһ��ں��AI��ƽ̨��һֱ��ĥ��ڣ��⵼��ѵ��Ч��д��һ��AMDһ��ǿ��ROCm��һ��AI��ƽ̨��Ⱥ��һ��ҵ��

��һ��Ľ��ǣ��Meta Llama-2��ģ�ͣ�MI325X�ĵ�GPUѵ��Ч��ڳ�Խ��H200��ڼ�Ⱥ�У��ѵ��Ч��Ժ�H200 HGX�൱��

MI325XԤ�ƽ�� 2024 ��ļ��ȿ�ʼ��H200�Ĵ��ģ��һ��ȡ��ĿǰӢΰ��B200��B100�ķ�װƿ��ģ��ӳ٣��OpenAI��Ҳ��ǹ��MI325X�ķ��ģ�ܿ��ϵĴ��ͻᱻʵ�ʵĳ��Ĩƽ��MI325X��г��ϵ�ʵ�ʶ��־��H200��H200��Ըߡ�

��˹��ܵ��

AMD ��㽫��µ� Instinct ��µ��缼��ϣ�� AMD Pensando Salina DPU �� AMD Pensando Pollara 400��ҵ��׿�֧�ֳ��̫�� AI ��ӿڿ��¼�� AMD �� AI ��ȷ��㹻��Թ��Ҫ��

AMD Pensando Salina DPU �� AMD ��ǰ�ˣ��ݴ�� Instinct ��Ⱥ�� AMD Pensando Pollara 400 ��ˣ��ͼ�Ⱥ֮��ݴ��䡣��Ʒ��С�

Pensando Salini DPU �� DPU ϵ�еĵ��Ʒ��ǰ��Ʒ��ô��͹�ģ��һ��ϡ��ܶ��֮��֧�� 400G ��ȷ��ʷ��ݴ��ʡ��ˣ��Ϊ AI ǰ��缯Ⱥ�Ĺؼ��Ż� AI Ӧ�ó��ܡ�Ч�ʺͿ��չ�ԡ�

�ڷ��ϣ�AMD ��缼��ҵ��߼��ܲü��ܾ��AMD�� 2022 ��չ�� Pensando Systems Inc. ��ϴ�ʼ�� Soni Jiandaniǿ��Ҫ�ԡ��˵��AI ϵͳ��ҪΪ�û��ǰ�ˣ��ں��ӵ��ǧ�� GPU ��ȷ��ܡ�

“��ƶ�� AI ϵͳ��ܣ�”��˵��“Meta ��ʾ��ѵ��ڵ� 30% ʱ��ͨ��ڵȴ��ʱ��š��ˣ��Ҫ��ƶ� AI ��ܵĻ��”

IDC ��ʦ Brandon Hoff �Դ˱�ʾͬ�⡣��˵��“AI ��أ�� AI ��أ��ǵ�һ��ܹ��ķ��ڵ��е��м��㡢�ڴ桢�洢��Ĺ��ء�AI ��չ�� AI ��ڵ�֮�⣬��Ҫ�� GPU �໥ͨ�š�”

��ˣ��“AI Factory �ڵ�֮��ͨ��ʱ��Ϊ‘��ʱ��’��ռѵ��ڵ�� AI ��д��ʱ�� 60%��仰˵��ģ��ҵ�� GPU �ϻ�� 10 ��Ԫ�� 4 ��Ԫ�Ĺ�� 6 ��Ԫ�� GPU ��״̬��Ҫ��Ҳ�ǵڶ��Ҫ�Ĳ��֡�”

��ˣ�� AMD ��˵��˵��“ӵ��һ��ǿ��Ʒ�Ǵ�� AI ҵ��Ҫ��ɲ��֡��Щ��ʺ� DPU �� SmartNIC �Ĳ�Ʒ��̫��ֵ��Ͷ�ʵ��ȷ��”

Bajarin ��ʾ��AMD ��缼��ȡ��˳��“��Ϊ��AMD �ܹ�ͨ��չ� ZT ϵͳ��һ��뵽��Ի��ܽ��Ż��ȫջ��У��ô��ǵ��缼��ͻ��ø��Ҫ��”��˵��

δ�� GPU ��з��

Salina DPU �� Pollara 400 Ҳ��Ƴ��ڹ�˾�ȴ��Щ��ͬʱ��ٿ��չ��δ��ķ�չ��

��˼��Ƴ��оƬ��缼��֮�⣬AMD ��Ԥ��һ��оƬ AMD Instinct MI350 ϵ�м��Ԥ�ƽ��°��Ƴ��

�� AMD ��ܣ�Instinct MI350 ��ڸù�˾�� CDNA 4 �ܹ��죬�� Instinct MI325X ��ȣ��ܷ��ʵ��ŵ� 35 ��ͬʱ�ṩ 288GB ��HBM3E �ڴ档

�ù�˾��ᵽ��µ� MI355X ��оƬ�ƻ��Ԥ�ƽ�� 2025 ��׿�ʼ��ǻ��ȫ�¼ܹ�� MI400 оƬ�� 2026 ��ĳ��ʱ��Ƴ��

��һ�� EPYC ��оƬ

��ܴ�Ҷ��ڹ�ע�˹��ܣ�� AMD ��ɶ��ķ��г��Ĺ㷺��ڴ˴λ�У��ù�˾��Ƴ��µ� EPYC ��봦��ǰ��Ϊ“Turin”��ּ��ҵ��˹��ܺ��ƹ��ص��

�� AMD EPYC ϵ�д��ڸù�˾�� Zen 5 ��ļܹ��ù�˾ּ��ṩ��ֺ��㲻ͬ��ʹ�� 8 ��ĵ�� 192 ��ģ��̵Ĺ��ء�

�ù�˾��ŵ�� EPYC оƬ��еĵ��Ĵ� EPYC ƽ̨��Ϊ�� 192 �� EPYC 9005 ϵ�е��ܱ��ǿ��оƬ�߳� 2.7 ��ͬʱ��µ� 64 �� EPYC 9575F �� GPU �� AI ��ض��Ƶģ��ܸߴ�ÿ�� 5 ǧ��λ��ٶȱȾ��оƬ�� 28%��

AMD ��ҵ��߼��ܲü��ܾ�� Dan McNamara ��ʾ��ͻ��ù�˾��“ƾ��ʱִ�е�·��ͼ��AMD ��֤��г��󣬲�Ϊ�ͻ��ṩ��ܡ�Ч�ʡ��ơ��ҵ�� AI ��ؽ��͹��ܵı�׼��”��˵��

�� PC �� Ryzen AI Pro оƬ

��AMD ͸¶��Ƴ��ƶ��ʼǱ��ԺͱʼǱ��¿�Ryzen AI Pro 300 ϵ�д��Ƚ��׹��죬�ݳƹ��ǿ��֧��豸�ϵ� AI ��أ��ʽ AI ��ʻ��ʵʱ��Ļ�� AI ��롣��һ��Ryzen оƬ��ȣ��ǵ� AI ��Ϊ��ҵ�û��ṩ�˸߼��ȫ�ԺͿɹ��Թ��ܡ�

��µ� EPYC оƬһ��¿� Ryzen �� AMD �� Zen 5 �ܹ��Ӣ�ض� Core Ultra 7 165U ��ȣ��ǵ��ߴ� 40%��Ч��ߴ� 14%��ù�˾��˵��ǻ��“��”�ӳ��豸�ĵ��

��⣬AMD ��ʾ��ǻ��䱸��ɵ��񾭴��Ԫ��ṩÿ�� 50 ��ڴ�� AI ��΢��˾�� AI �� Copilot ��ߵ�Ҫ��

AMD ��ͼ��ҵ��߼��ܲü��ܾ�� Jack Huynh ��ʾ��PRO 300 ϵ��ּ��ҵ��û��߼��Ч��“��ǵ��֧�� AI ��õ��Դ��ǰ��δ�е� AI ��ĵ��û��Ӧ�ó��޷��ԣ�”��˵��

Creative Strategies �� Bajarin ��ʾ��Ҫ��“��ھ��һ��׵ı���Դ��ڱ��ڽ׶Σ��δ�� 10 ��ʱ����Ȼ��һ��ŵľ��Ҳ�ȷ��ܷ�϶��˵��ʱ��Σ��Ҫ��ǣ��д��г��ݶ��ʽ�ɹ� AMD��Nvidia �� Intel æ��ͣ��”

ԭ�ı�� : ��ǿAIоƬ��AMD��MI325X��ܳ�Ӣΰ��H200