Articles by Michael Gastpar | Synthical

Synthical

Your space

Profile

Activity

Favorites

Folders

Feeds

Contacts

About

Claim page

Michael Gastpar

Follow

Activity

Upvotes

Folders

Articles

87

Alpha-NML Universal Predictors

19 December 2024 by Marco Bondaschi and Michael Gastpar at

École Polytechnique Fédérale De Lausanne

Information Theory

Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models

11 December 2024 by Alliot Nagle and others

Machine Learning, Computation and Language

Batch Normalization Decomposed

3 December 2024 by Ido Nachum and others

Machine Learning, Neural and Evolutionary Computing

Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants

27 November 2024 by Beatriz Borges and others

Computers and Society, Artificial Intelligence

Characterising high-order interdependence via entropic conjugation

14 October 2024 by Fernando Rosas and others

Information Theory, Data Analysis, Statistics and Probability

Which Algorithms Have Tight Generalization Bounds?

2 October 2024 by Michael Gastpar and others

Machine Learning

Shannon Bounds for Quadratic Rate-Distortion Problems

23 September 2024 by Michael Gastpar and Erixhen Sula

Information Theory

Converse for Multi-Server Single-Message PIR with Side Information

8 September 2024 by Su Li and Michael Gastpar

Information Theory

Transformers on Markov Data: Constant Depth Suffices

25 July 2024 by Nived Rajaraman and others

Machine Learning, Computation and Language

Local to Global: Learning Dynamics and Effect of Initialization for Transformers

27 June 2024 by Ashok Vardhan Makkuva and others

Machine Learning, Information Theory

Software in the natural world: A computational approach to hierarchical emergence

1

5 June 2024 by Fernando Rosas and others at

University of Sussex

Adaptation and Self-Organizing Systems

Properties of the Strong Data Processing Constant for Rényi Divergence

14 May 2024 by Lifu Jin and others

Information Theory

Sibson's α-Mutual Information and its Variational Representations

14 May 2024 by Amedeo Roberto Esposito and others

Information Theory, Probability

Characterising directed and undirected metrics of high-order interdependence

10 April 2024 by Fernando Rosas and others at

École Polytechnique Fédérale De Lausanne

Information Theory

Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains

6 February 2024 by Ashok Vardhan Makkuva and others at

École Polytechnique Fédérale De Lausanne

Machine Learning, Computation and Language

Batch Universal Prediction

6 February 2024 by Marco Bondaschi and Michael Gastpar

Information Theory, Machine Learning

Fantastic Generalization Measures are Nowhere to be Found

28 November 2023 by Michael Gastpar and others at

Machine Learning, Neural and Evolutionary Computing

Generalization Error Bounds for Noisy, Iterative Algorithms via Maximal Leakage

19 July 2023 by Ibrahim Issa and others

Machine Learning, Information Theory

Lower Bound on the Bayesian Risk via Information Measures

23 March 2023 by Amedeo Roberto Esposito and others

Information Theory, Machine Learning

Finite Littlestone Dimension Implies Finite Information Complexity

27 June 2022 by Aditya Pradeep and others

Machine Learning, Information Theory

Lower-bounds on the Bayesian Risk in Estimation Procedures via f-Divergences

9 April 2022 by Adrien Vandenbroucque and others

Information Theory, Probability

From Generalisation Error to Transportation-cost Inequalities and Back

16 March 2022 by Amedeo Roberto Esposito and Michael Gastpar

Information Theory, Machine Learning

A Johnson--Lindenstrauss Framework for Randomly Initialized CNNs

7 March 2022 by Ido Nachum and others

Machine Learning, Neural and Evolutionary Computing

On Sibson's α-Mutual Information

8 February 2022 by Amedeo Roberto Esposito and others

Information Theory, Statistics Theory

The Price of Distributed: Rate Loss in the CEO Problem

3 February 2022 by Arda Atalik and others

Information Theory

Shannon Bounds on Lossy Gray-Wyner Networks

2 February 2022 by Erixhen Sula and Michael Gastpar

Information Theory

Differential Entropy of the Conditional Expectation under Gaussian Noise

7 December 2021 by Arda Atalik and others

Information Theory, Signal Processing

A Unified Discretization Approach to Compute-Forward: From Discrete to Continuous Inputs

1 October 2021 by Adriano Pastore and others

Information Theory

Private Retrieval, Computing and Learning: Recent Progress and Future Challenges

30 July 2021 by Sennur Ulukus and others

Cryptography and Security, Distributed, Parallel, and Cluster Computing

Lower bound on Wyner's Common Information

16 February 2021 by Erixhen Sula and Michael Gastpar

Information Theory

Load more

This is an AI-generated summary

Key points

Topics

Information Theory Machine Learning Probability Cryptography and Security Statistics Theory Neural and Evolutionary Computing Adaptation and Self-Organizing Systems Computation and Language Functional Analysis Signal Processing Distributed, Parallel, and Cluster Computing Information Retrieval Neurons and Cognition Combinatorics