Budapest Bank's AI Call Analysis Was Found to Have Violated Callers' and Employees' Privacy Rights in Hungary

Budapest Bank was fined HUF 250,000,000 by the Hungarian data protection authority for unlawfully using an AI-powered voice analytics system to analyze the emotions of customers and employees without consent or proper transparency.

Hungary's data-protection authority found Budapest Bank's AI analysis of recorded customer-service calls violated callers' and employees' privacy rights. The system analyzed emotions and helped select callbacks and assess staff without a lawful basis or adequate notice and objection safeguards. The authority ordered an end to emotion analysis and imposed a HUF 250 million fine.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 2 Privacy & Security
  • Primary risk subdomain: 2.1 Compromise of privacy by obtaining, leaking or correctly inferring sensitive information

The bank used an AI system to automatically analyze and infer the sensitive emotional and psychological states of callers and employees from voice recordings without their consent.

Additional risk subdomains

  • 7.3 Lack of capability or robustness: The AI system's emotion recognition was highly unreliable, failing to recognize emotions in 91.96% of cases, yet it was still used to rank calls and evaluate employees.
  • 6.2 Increased inequality and decline in employment quality: The bank used the AI system to monitor and evaluate the performance of its 180 call center employees, directly affecting their performance pay in a dependent workplace relationship.

Causal factors

  • Entity: Human
  • Intent: Intentional
  • Timing: Post-deployment

The privacy violations and subsequent regulatory fine resulted from the bank's intentional decision to deploy the AI voice analysis system post-deployment without establishing a lawful basis or informing users.

EU AI Act risk tier

  • Risk tier: 2 High Risk

High Risk: The AI system was used as an employment and worker management system to evaluate employee performance and determine performance pay, which is classified as high risk under the EU AI Act.

AI system and alleged parties

  • AI system: Voice Analytics Platform
  • AI purpose: Sentiment Analysis; Workforce Monitoring and Evaluation
  • Behaviour type: Assistant
  • Alleged developer: AI-assisted call center software developers
  • Alleged deployer: Budapest Bank, Banks
  • Alleged harmed parties: Privacy, Call center workers, Budapest Bank customers, Budapest Bank callers, Budapest Bank call center employees, Biometric data subjects, Bank customers

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Severe. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Negligible
  • Infrastructure: direct Negligible, indirect Negligible
  • Property: direct Negligible, indirect Negligible
  • Financial: direct Minor, indirect Negligible
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Negligible, indirect Negligible
  • Differential treatment: direct Minor, indirect Negligible
  • Civil rights: direct Severe, indirect Negligible
  • Democracy: direct Negligible, indirect Negligible
  • Privacy: direct Severe, indirect Negligible
  • Psychological: direct Negligible, indirect Negligible
  • Epistemic: direct Negligible, indirect Negligible
  • Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Financial

Reported: The report describes 1 incident causing a total financial loss of HUF 250,000,000 due to an administrative fine.

Directly caused: Budapest Bank suffered a direct financial loss of HUF 250,000,000 from the regulatory fine imposed by the NAIH.

Inferred additional harm: Employees may have suffered unquantified financial losses due to automated performance evaluations affecting their performance pay.

Differential treatment

Reported: The report describes differential treatment where certain customers were prioritized for callbacks and employees were profiled for performance evaluations.

Directly caused: Customers identified as dissatisfied by the AI were prioritized for callbacks, and employees' performance evaluations and pay were influenced by automated voice analysis.

Civil rights

Reported: The report explicitly describes systemic violations of fundamental data protection and privacy rights under the GDPR.

Directly caused: The bank violated GDPR Articles 5, 6, 12, 13, 21, 24, and 25, denying data subjects their right to information, right to object, and right to self-determination.

Privacy

Reported: Yes, the report explicitly describes systemic privacy violations affecting millions of customer calls and 180 employees.

Directly caused: The bank unlawfully processed sensitive voice recordings and inferred emotional states of approximately 1 to 1.5 million callers annually and 180 employees without a valid legal basis.

People affected

  • Occurrences reported: 1
  • People reportedly harmed: 181
  • People reportedly exposed: 1000180

Potential causes

Management

  • Prioritizing Profit over Safety: Management deployed risky AI to reduce staff costs without safety safeguards.
  • Lack of Algorithmic Oversight: Management did not review or understand the closed software's criteria.
  • Intentional Non-Disclosure: Management withheld details of voice analysis from users and regulators.

Technology

  • Inaccurate Emotion Recognition: Emotion was unrecognizable in 91.96% of cases, leading to false results.
  • Lack of Explainability in Software: Evaluation criteria and characteristics were closed and unknown to the bank.
  • Automated Profiling Risk: AI automatically analyzed and ranked caller dissatisfaction for callbacks.

Data Inputs

  • Processing of Voice Recordings: The software used sensitive voice and emotional data without explicit consent.
  • Unlabeled Employee Voice Data: Employee voices were analyzed alongside customers, affecting performance pay.

Human Factors

  • Subordination of Employees: Staff could not realistically object to voice monitoring due to dependency.
  • Overreliance on Flawed AI Output: Bank staff relied on flawed emotion scores to prioritize customer callbacks.

Process and Methods

  • Flawed Interest Assessment: The assessment merged multiple purposes and ignored data subjects' rights.
  • Lack of Information and Opt-Out: No clear notice or mechanism was provided for users to object to analysis.
  • Absence of Data Protection by Design: The system was designed without safeguards for transparency and user rights.

Regulatory Environment

  • Non-Compliance with GDPR Articles: The processing violated several key GDPR articles on lawfulness and transparency.
  • Failure of Prior Approval: The bank failed to seek mandatory prior authority approval before deployment.

Information quality

  • Classification confidence: High
  • Reason for confidence: The reports provide highly detailed legal and factual findings from the Hungarian data protection authority (NAIH), including specific GDPR articles violated, the fine amount, the number of affected employees, and the annual volume of processed calls.
  • Ambiguities identified: The exact name of the software developer is redacted or omitted, and the precise financial impact on individual employees' performance pay is not quantified.
  • Alternative interpretations: None. The regulatory ruling is clear and definitive regarding the illegality of the processing.

Budapest Bank was fined HUF 250,000,000 by Hungary's data protection authority for unlawfully using an AI voice analytics tool to monitor employee performance and prioritize customer calls without consent. The incident represents a domestic regulatory and privacy violation with minor national security implications, successfully managed through standard legal and regulatory procedures.

  • Overall national security impact: Minor
  • Scope: Single nation
  • Primary target: Hungary
  • Alleged perpetrator: Budapest Bank

Threat characteristics

  • Imminence: Long-term. The incident represents a past compliance failure that has been resolved by the national data protection authority.
  • Autonomy: Human-controlled. The AI acted as an assistant to analyze voice recordings, but humans made final decisions regarding customer callbacks and employee performance evaluations.
  • Novelty: Established threat. Unlawful data processing and algorithmic profiling are well-established regulatory risks with existing legal frameworks like GDPR.

Impact by dimension

  • Physical security: Negligible. The incident involves a commercial bank's customer service software and has no impact on physical systems, kinetic operations, or critical infrastructure.
  • Information security: Negligible. No intelligence compromise, classified data theft, or foreign information warfare operations are associated with this domestic banking incident.
  • Sovereignty: Negligible. Core government operations, electoral systems, and state sovereignty were unaffected by this commercial regulatory compliance issue.
  • Economic security: Minor. The bank suffered a regulatory fine of HUF 250,000,000 and minor internal disruption, but there is no threat to national economic stability or strategic technological competitive advantage.
  • Societal stability: Minor. While the bank violated GDPR privacy rights of 180 employees and millions of customers, the impact is localized to a corporate context and handled through standard regulatory mechanisms.
Explore in the interactive Incident Tracker