Meta Platforms Crafts its Own Chip
Meta Platforms, formerly known as Facebook, has unveiled its homegrown AI inference and video encoding chips at the AI Infra @ Scale event. The company, being a pure hyperscaler and not a cloud infrastructure provider, has the freedom to design and create its own hardware to support its software stacks. By developing its own chips, Meta Platforms aims to optimize performance, reduce costs, and address the increasing demands of AI workloads. Meta Platforms' custom silicon team, comprised of key executives from Intel and Broadcom, has introduced the Meta Training and Inference Accelerator (MTIA) v1. This chip is specifically designed to handle the computational and memory requirements of deep learning recommendation models (DLRMs), which utilize embeddings for context representation. The growth in size and demand of DLRMs has surpassed the capabilities of existing solutions such as CPUs and neural network processors for inference (NNPIs), necessitating the use of GPUs for inferenci...