Data & Infrastructure
AWS Inferentia
Amazon-designed AI inference accelerator chip. Inf2 instances offer cost/performance advantages over GPUs for certain inference workloads on Bedrock and self-managed EC2. Not a full training replacement but a mature inference option in the AWS stack.
Last reviewed:
Related terms
Related on this site
Where this fits
AWS Inferentia is part of the Data & Infrastructure vocabulary used in the Generative AI Maturity Framework. See the full glossary for the complete set of 159 defined terms, or take the free maturity assessment to see where your organisation stands.