Articles by Liu Ziyin

Claim page

Liu Ziyin

Activity

Upvotes

Folders

Articles

Formation of Representations in Neural Networks

3 October 2024 by Liu Ziyin and others

Machine Learning, Disordered Systems and Neural Networks

Remove Symmetries to Control Model Expressivity

28 August 2024 by Liu Ziyin and others

Machine Learning, Artificial Intelligence

Type-II Saddles and Probabilistic Stability of Stochastic Gradient Descent

2 July 2024 by Liu Ziyin and others at

MIT

Machine Learning, Optimization and Control

Loss Symmetry and Noise Equilibrium of Stochastic Gradient Descent

3 June 2024 by Liu Ziyin and others at

University of Tokyo

Machine Learning, Optimization and Control

Three Mechanisms of Feature Learning in the Exact Solution of a Latent Variable Model

4 May 2024 by Yizhou Xu and Liu Ziyin

Machine Learning, Artificial Intelligence

Symmetry Leads to Structured Constraint of Learning

29 September 2023 by Liu Ziyin

Machine Learning

Law of Balance and Stationary Distribution of Stochastic Gradient Descent

13 August 2023 by Liu Ziyin and others

Machine Learning, Artificial Intelligence

On the Stepwise Nature of Self-Supervised Learning

30 May 2023 by James Simon and others

Machine Learning

Sparsity by Redundancy: Solving L_1 with SGD

12 March 2023 by Liu Ziyin and Zihao Wang

Machine Learning

What shapes the loss landscape of self-supervised learning?

12 March 2023 by Liu Ziyin and others

Machine Learning, Data Analysis, Statistics and Probability

Posterior Collapse of a Linear Latent Variable Model

13 October 2022 by Zihao Wang and Liu Ziyin

Machine Learning

Power Laws and Symmetries in a Minimal Model of Financial Market Economy

13 June 2022 by Liu Ziyin and others

Physics and Society, Statistical Mechanics

Universal Thermodynamic Uncertainty Relation in Non-Equilibrium Dynamics

6 June 2022 by Liu Ziyin and Masahito Ueda

Statistical Mechanics

Exact Phase Transitions in Deep Learning

25 May 2022 by Liu Ziyin and Masahito Ueda

Machine Learning, Disordered Systems and Neural Networks

Stochastic Neural Networks with Infinite Width are Deterministic

24 May 2022 by Liu Ziyin and others

Machine Learning

Exact Solutions of a Deep Linear Network

14 February 2022 by Liu Ziyin and others

Machine Learning

Theoretically Motivated Data Augmentation and Regularization for Portfolio Construction

31 January 2022 by Liu Ziyin and others

Machine Learning, General Finance

Power-law escape rate of SGD

29 January 2022 by Takashi Mori and others

Machine Learning, Disordered Systems and Neural Networks

SGD May Never Escape Saddle Points

22 September 2021 by Liu Ziyin and others

Machine Learning, Optimization and Control

Strength of Minibatch Noise in SGD

6 June 2021 by Liu Ziyin and others

Machine Learning

On the Distributional Properties of Adaptive Gradients

15 May 2021 by Zhang Zhiyi and Liu Ziyin

Machine Learning

Stochastic Gradient Descent with Large Learning Rate

17 December 2020 by Kangqiao Liu and others

Machine Learning

Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment

4 December 2020 by Paul Liang and others

Machine Learning, Artificial Intelligence

Neural Networks Fail to Learn Periodic Functions and How to Fix It

25 October 2020 by Liu Ziyin and others

Machine Learning

An Investigation of how Label Smoothing Affects Generalization

23 October 2020 by Blair Chen and others

Machine Learning

LaProp: Separating Momentum and Adaptivity in Adam

30 July 2020 by Liu Ziyin and others

Machine Learning

Volumization as a Natural Generalization of Weight Decay

1 April 2020 by Liu Ziyin and others

Machine Learning

Think Locally, Act Globally: Federated Learning with Local and Global Representations

28 February 2020 by Paul Liang and others

Machine Learning, Distributed, Parallel, and Cluster Computing

Learning Not to Learn in the Presence of Noisy Labels

16 February 2020 by Liu Ziyin and others

Machine Learning, Information Theory

Deep Gamblers: Learning to Abstain with Portfolio Theory

1 October 2019 by Liu Ziyin and others

Machine Learning

This is an AI-generated summary

Key points

Topics

Machine Learning Optimization and Control Artificial Intelligence Statistical Mechanics Data Analysis, Statistics and Probability Disordered Systems and Neural Networks Information Theory Physics and Society Trading and Market Microstructure Applied Physics General Finance Portfolio Management Computation and Language Computer Vision and Pattern Recognition Distributed, Parallel, and Cluster Computing