Independent · Nonprofit · Open access
Deep Lex

AI Glossary

Deep Learning

ML using deep neural networks with many layers

Short definition

A subset of machine learning using deep neural networks with many layers to extract features from data.

Definition

Definition

Deep learning is a subset of machine learning that utilises artificial neural networks with multiple layers (typically three or more hidden layers) to model and understand complex patterns in data. The term "deep" refers to the multiple layers of neural networks that enable the system to learn hierarchical representations of data, progressively extracting more abstract features at each layer.

Deep learning represents the technological foundation underlying most contemporary artificial intelligence applications, including large language models, computer vision systems, and autonomous vehicles. Unlike traditional machine learning approaches that require manual feature engineering, deep learning systems automatically discover relevant patterns and representations from raw data through statistical analysis and pattern recognition.

Deep learning systems are characterised by their ability to process vast amounts of unstructured data, learn complex non-linear relationships, and improve performance through exposure to additional training data. This capability has made deep learning the dominant approach in modern AI applications, though it has also introduced significant challenges for legal systems regarding explainability, accountability, and liability.

Technical Architecture and Methodology

Deep learning systems employ neural networks with multiple hidden layers between input and output layers, enabling the network to learn increasingly abstract representations of data. Each layer transforms input data through weighted connections and activation functions, with the learning process occurring through backpropagation—a method that adjusts network weights based on prediction errors.

The training process involves exposing the network to large datasets, often requiring substantial computational resources and time. Deep learning models learn through statistical pattern matching rather than rule-based logic, making their decision-making processes fundamentally different from traditional software systems. This statistical approach enables remarkable performance on complex tasks but creates challenges for understanding how specific decisions are reached.

Modern deep learning encompasses various architectures optimised for different tasks: convolutional neural networks for image processing, recurrent neural networks for sequential data, transformer networks for natural language processing, and generative adversarial networks for content creation. Each architecture addresses specific types of data and problems whilst maintaining the core principle of hierarchical feature learning.

Liability and Accountability Frameworks

The autonomous learning capabilities of deep learning systems complicate traditional liability frameworks. Academic analysis suggests that deep learning systems "rely on complex statistical models and algorithms with multiple layers of parallel processing that loosely model the way the biological brain works," creating challenges for existing tort law principles that assume predictable cause-and-effect relationships.

Product liability theories struggle to address deep learning systems that modify their behaviour through continued learning. Traditional product liability assumes static products with foreseeable risks, but deep learning systems can develop new capabilities or exhibit unexpected behaviours after deployment. This dynamic nature challenges concepts of defective design and failure to warn when system capabilities evolve beyond original specifications.

Professional liability concerns arise when practitioners rely on deep learning systems without adequate understanding of their limitations. Legal and medical professionals using AI assistance face questions about the duty to understand AI recommendations, the appropriate level of verification required, and the standard of care when incorporating AI insights into professional judgment.

Intellectual Property and Data Rights

Deep learning systems raise complex intellectual property questions regarding both the algorithms and the training data used to develop them. The process of training deep learning models on copyrighted materials has sparked significant litigation, with courts grappling with questions of fair use, transformative use, and the rights of content creators whose works contribute to model training.

Patent protection for deep learning innovations presents challenges due to the mathematical nature of many algorithms and the abstract nature of software patents. Trade secret protection often covers specific implementations, training methodologies, and datasets, creating additional layers of IP complexity in commercial deep learning applications.

The outputs generated by deep learning systems also raise novel copyright questions. Courts must determine whether AI-generated content can be copyrighted, who would hold such rights, and how to address situations where deep learning systems produce outputs that closely resemble existing copyrighted works.

Privacy and Data Protection Implications

Deep learning systems' voracious appetite for training data creates significant privacy and data protection challenges. These systems can learn to infer sensitive personal information from seemingly innocuous data, creating privacy risks that extend beyond traditional concepts of personal data collection and processing.

The General Data Protection Regulation (GDPR) and similar privacy frameworks struggle to address deep learning systems that can extract sensitive insights from data that individuals may not consider private. The right to explanation under GDPR becomes particularly complex when applied to deep learning systems whose decision-making processes are inherently opaque.

Data minimisation principles conflict with deep learning systems' tendency to perform better with larger, more diverse datasets. This tension requires organisations to balance privacy protection with system performance, often leading to complex compliance decisions about data collection, retention, and processing practices.

Regulatory Approaches and Compliance

Different jurisdictions have adopted varying approaches to regulating deep learning systems and their applications. The EU AI Act includes provisions that specifically address the opacity and unpredictability of deep learning systems, particularly in high-risk applications where explainability requirements may conflict with deep learning's black box nature.

Sector-specific regulations increasingly address deep learning applications. Financial services regulators require model risk management for AI systems, including deep learning models used in lending and trading. Healthcare regulators treat AI as medical devices, requiring clinical validation and ongoing monitoring of deep learning systems used in diagnosis and treatment.

The challenge for legal practitioners lies in navigating the intersection of general AI regulations, sector-specific requirements, and traditional legal principles when advising clients on deep learning implementations.

Bias, Discrimination, and Fairness

Deep learning systems can perpetuate and amplify biases present in training data, creating legal risks under anti-discrimination laws. The statistical nature of deep learning means that systems may learn to replicate historical patterns of discrimination without explicit programming to do so.

Employment law applications of deep learning systems face particular scrutiny under Title VII and similar anti-discrimination statutes. When deep learning systems make hiring, promotion, or termination decisions, employers must demonstrate that these systems do not create disparate impact on protected classes whilst acknowledging that the black box nature of these systems makes such demonstrations challenging.

Financial services applications must comply with fair lending requirements, ensuring that deep learning systems used in credit decisions do not discriminate against protected classes. The challenge lies in monitoring and auditing systems whose decision-making processes are not readily interpretable.

Reference material

Sources

Pihlajarinne, T., et al. "Artificial intelligence and civil liability—do we need a new regime?" International Journal of Law and Information Technology 30, no. 4 (2022): 385-411. RAND Corporation, "Liability for Harms from AI Systems: The Application of U.S. Tort Law and Liability to Harms from Artificial Intelligence Systems" (2024). Van Maanen, G., & Straathof, B. "The law and economics of AI liability." Computer Law & Security Review 48 (2023): 105770. Winfield, A. F., & Jirotka, M. "Legal and human rights issues of AI: Gaps, challenges and vulnerabilities." Computer Law & Security Review 37 (2020): 105770.