Two third-party Amazon sellers employed automated pricing algorithms that lacked sanity checks, resulting in a recursive price-hike loop. The algorithms continuously adjusted prices in response to one another, inflating the cost of a biology reference book to over $23 million before the sellers manually intervened.
Amazon's pricing algorithm was implicated in a reference book about flies' unusual high price of millions of dollars, allegedly due to two sellers using the paid service which based their product's pricing on one another's as competitors.
Risk classification
- Primary risk domain: 7 AI system safety, failures, & limitations
- Primary risk subdomain: 7.3 Lack of capability or robustness
The incident was caused by a lack of robustness in the pricing algorithms, specifically the absence of sanity checks or price ceilings to prevent an infinite feedback loop.
Causal factors
- Entity: AI
- Intent: Unintentional
- Timing: Post-deployment
The pricing anomaly was caused by the autonomous interaction of two deployed pricing algorithms, which produced an unexpected and unintended price escalation.
EU AI Act risk tier
- Risk tier: 4 Minimal or No Risk
Minimal or No Risk: The AI systems involved are simple algorithmic pricing tools used by third-party e-commerce sellers, which pose low or negligible risks to safety or fundamental rights.
AI system and alleged parties
- AI system: Amazon algorithmic pricing (Amazon)
- AI purpose: Personalized Pricing; Value Estimation
- Behaviour type: Multi-agent
- Alleged developer: Amazon
- Alleged deployer: Amazon
- Alleged harmed parties: Amazon
Harm severity
Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
People affected
- Occurrences reported: 1
- People reportedly exposed: 2
Potential causes
Management
- Inadequate Algorithmic Risk Assessment: Management failed to assess risks of automated pricing interactions.
Technology
- Feedback Loop in Pricing Algorithms: The interaction of two algorithms created an upward price spiral.
- Lack of Algorithmic Sanity Checks: Algorithms did not have built-in price ceilings or sanity checks.
Data Inputs
- Competitor Price as Sole Input: The algorithms relied solely on the competitor price to set their own.
Human Factors
- Lack of Active Human Oversight: Retailers failed to monitor the astronomical price increases for days.
Process and Methods
- Flawed Arbitrage Pricing Strategy: Bordeebook priced at 1.27x competitor price to cover dropshipping costs.
- Flawed Undercutting Strategy: Profnath consistently priced at 0.9983x competitor price to undercut.
Information quality
- Classification confidence: High
- Reason for confidence: The reports provide a clear, consistent, and detailed mathematical explanation of how the two pricing algorithms interacted to cause the price spiral. There is no conflicting information regarding the mechanics of the glitch.
An accidental feedback loop between two automated retail pricing algorithms on Amazon inflated a textbook price to over 23 million dollars before manual intervention. The incident represents a classic example of algorithmic instability but has negligible national security implications.
- Overall national security impact: Negligible
- Response level: Minor
- Scope: Single nation
- Primary target: No clear primary
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. The incident was a historical event resolved in 2011, posing no immediate or near-term threat.
- Autonomy: Full autonomy. The two pricing algorithms operated and adjusted prices recursively without human intervention until manual correction.
- Novelty: First-of-its-kind. One of the earliest and most prominent documented cases of an autonomous algorithmic feedback loop causing extreme price distortion.
Impact by dimension
- Physical security: Negligible. The incident was a commercial retail pricing anomaly with no impact on physical systems, critical infrastructure, or human safety.
- Information security: Negligible. No intelligence assets, classified information, or public information systems were compromised or targeted.
- Sovereignty: Negligible. Core government operations, electoral systems, and state sovereignty were entirely unaffected by this commercial pricing glitch.
- Economic security: Negligible. While involving an extreme book price, no actual financial transactions occurred, and there was no disruption to strategic industries or financial markets.
- Societal stability: Negligible. The incident did not involve mass surveillance, civil rights violations, or threats to societal stability.
.avif){kind=small}