Min-Hsiu Hsieh
Hon Hai (Foxconn) Quantum Computing Research Center
Quantum Machine Learning
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8880439/鴻海Logo.jpeg)
Quantum Seminar, Lisbon University
Unknown Function
Training Data
Hypothesis Set
Learning
Algorithm
Comp. Complexity
Sample Complexity
Unknown Function
Training Data
Hypothesis Set
Learning
Algorithm
Comp. Complexity
Sample Complexity
Quantum Ingredients
Quantum Advantage
Type of Input
Type of Algorithms
CQ
CC
QC
QQ
CQ
QQ
QC
-
Linear Equation Solvers
-
Peceptron
-
Recommendation Systems
-
Many Others (such as non-Convex Optimization)
-
State Tomography
-
Entanglement Structure
-
Quantum Control
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9361381/Screen_Shot_2022-02-24_at_11.15.55_am.png)
How could QML achieve better end-to-end runtime?
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9352650/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9352654/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9352655/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9352657/pasted-from-clipboard.png)
QML Process
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9352650/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9352654/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9352655/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9352657/pasted-from-clipboard.png)
1. Readin
2. Readout
Many Challenges!
3.
Learning Machines
4. Noise
Input Oracles for distribution
[1] Aleksandrs Belovs, Quantum Algorithms for Classical Probability Distributions, 27th annual European symposium on algorithms (esa 2019), 2019, pp. 16:1–16:11.
1.
Readin
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/7964711/bucketbrigadescheme_0.jpg)
QRAM
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8880965/Screen_Shot_2021-08-30_at_3.28.47_pm.png)
- V. Giovannetti, S. Lloyd, L. Maccone, Phys. Rev. Lett. 100, 160501 (2008).
1.
Readin
There is no general readin protocol (with nontrivial space-time guarantee) for arbitrary datasets.
1.
Readin
Ongoing Progress:
1.
Readin
Could we find an approximate amplitude encoding (AAE) for real-world datasets with polynomial gates?
Entropy reduction
Ongoing Progress:
1.
Readin
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/11488233/Screenshot_2024-07-23_at_7.40.46_PM.png)
Text
2.
Readout
State tomography:
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9352894/lovepik-big-red-wrong-fork-png-image_401498874_wh1200.png)
Observation:
For ML problems, input and output have certain relationships.
2.
Readout
[1] Efficient State Read-out for Quantum Machine Learning Algorithms. Kaining Zhang, Min-Hsiu Hsieh, Liu Liu, Dacheng Tao. Physical Review Research 3, 04395 (2021). [arXiv:2004.06421]
2.
Readout
poly(\(r,\epsilon^{-1}\)) query to QRAM.
Theorem:
Given:
\(-\) Input \(A\in\mathbb{R}^{m\times n}\) of rank \(r\)
\(-\) Output \( \bm{v} \in\text{row}(A)\)
\(-\) access to QRAM
Proof:
1. \(|v\rangle = \sum_{i=1}^r x_i |A_{g(i)}\rangle\in\text{row}(A)\)
2. quantum Gram-Schmidt Process algorithm to construct \(\{A_{g(i)}\}\)
3. Obtain \(\{x_i\}\).
2.
Readout
[1] Efficient State Read-out for Quantum Machine Learning Algorithms. Kaining Zhang, Min-Hsiu Hsieh, Liu Liu, Dacheng Tao. Physical Review Research 3, 04395 (2021). [arXiv:2004.06421]
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8883660/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8883662/pasted-from-clipboard.png)
3.
Learning
Machine
Expressivity
Trainability
Generalization
Learning
Model
"how the architectural properties of a neural network (depth, width, layer type) affect the resulting functions it can compute"
[1] On the Expressive Power of Deep Neural Networks. (ICML2017) arXiv:1606.05336
3.1
Expressivity
\(\geq\)
[1] Yuxuan Du, Min-Hsiu Hsieh, Tongliang Liu, Dacheng Tao. The Expressive Power of Parameterized Quantum Circuits. Physical Review Research 2, 033125 (2020) [arXiv:1810.11922].
3.1
Expressivity
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9353664/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9353680/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9353685/pasted-from-clipboard.png)
\(\leq\)
\(\geq\)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9353764/pasted-from-clipboard.png)
"How easy is it to find the appropriate weights of the neural networks that fit the given data?"
3.2
Trainability
3.2
Trainability
Barren Plateau problem:
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8292373/pasted-from-clipboard.png)
[1] Jarrod R McClean, Sergio Boixo, Vadim N Smelyanskiy, Ryan Babbush, and Hartmut Neven. Barren plateaus in quantum neural network training landscapes. Nature communications, 9(1):1– 6, 2018.
3.2
Trainability
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355082/pasted-from-clipboard.png)
Known BP Results
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355137/pasted-from-clipboard.png)
3.2
Trainability
Bad News for QML
-
Flat loss landscape.
-
Extremely small toleration to noise.
3.2
Trainability
Contribution 1:
BP free architecture
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355105/pasted-from-clipboard.png)
[1] Kaining Zhang, Min-Hsiu Hsieh, Liu Liu, Dacheng Tao. Toward Trainability of Deep Quantum Neural Networks. [arXiv:2112.15002]
3.2
Trainability
Binary classification on the wine dataset (N=13)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355167/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355168/pasted-from-clipboard.png)
[1] Kaining Zhang, Min-Hsiu Hsieh, Liu Liu, Dacheng Tao. Toward Trainability of Deep Quantum Neural Networks. [arXiv:2112.15002]
3.2
Trainability
Contribution 2:
Initialization Matters
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355550/pasted-from-clipboard.png)
[1] Kaining Zhang, Min-Hsiu Hsieh, Liu Liu, Dacheng Tao. NeurIPS 2022.
3.2
Trainability
Finding the ground energy of the Ising model (N=15, L=10)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355226/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355228/pasted-from-clipboard.png)
[1] Kaining Zhang, Min-Hsiu Hsieh, Liu Liu, Dacheng Tao. NIPS 2022.
[1] Yuxuan Du, Min-Hsiu Hsieh, Tongliang Liu, Shan You, Dacheng Tao. On the learnability of quantum neural networks. PRX-Quantum 2, 040337 (2021)[arXiv:2007.12369]
3.2
Trainability
Contribution 3:
Trainability in ERM
\(d\)= \(|\bm{\theta}|\)
\(T\)= # of iteration
\(L_Q\)= circuit depth
\(p\)= error rate
\(K\)= # of measurements
3.2
Trainability
[1] Yuxuan Du, Min-Hsiu Hsieh, Tongliang Liu, Shan You, Dacheng Tao. On the learnability of quantum neural networks. PRX-Quantum 2, 040337 (2021)[arXiv:2007.12369]
\(d\)= \(|\bm{\theta}|\)
\(T\)= # of iteration
\(L_Q\)= circuit depth
\(p\)= error rate
\(K\)= # of measurements
3.2
Trainability
[1] Yuxuan Du, Min-Hsiu Hsieh, Tongliang Liu, Shan You, Dacheng Tao. On the learnability of quantum neural networks. PRX-Quantum 2, 040337 (2021)[arXiv:2007.12369]
3.3
Generalization
"Generalization refers to the model's ability to adapt properly to new, previously unseen data, drawn from the same distribution as the one used to train the model."
[1] S. Arunachalam, A. B. Grilo, and H. Yuen, arXiv:2002.08240 (2020).
3.3
Generalization
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355377/Screen_Shot_2022-02-22_at_11.57.33_am.png)
Separation between Learning models
3.3
Generalization
Contribution:
"Noisy QNN can efficiently simulate QSQ oracle."
[1] Yuxuan Du, Min-Hsiu Hsieh, Tongliang Liu, Shan You, Dacheng Tao. On the learnability of quantum neural networks. PRX-Quantum 2, 040337 (2021)[arXiv:2007.12369]
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355564/Screen_Shot_2022-02-22_at_3.19.32_pm.png)
3.4
Quantum
Advantage
Any quantum advantage could be achieved using QML?
->No universal quantum advantage.
Qian, Y., Wang, X., Du, Y., Wu, X., & Tao, D. (2022). The dilemma of quantum neural networks. IEEE Transactions on Neural Networks and Learning Systems.
3.4
Quantum
Advantage
How to guarantee problem-dependent quantum advantage using QNN?
->We identify conditions when the expected risk in classification tasks is minimized.
Yuxuan Du, Yibo Yang, Dacheng Tao, Min-Hsiu Hsieh. "Demystify Problem-Dependent Power of Quantum Neural Networks on Multi-Class Classification." Physical Review Letters 131, 140601 (2023)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/10476114/Screenshot_2023-05-16_at_5.19.26_PM.png)
3.4
Quantum
Advantage
Contribution:
Yuxuan Du, Yibo Yang, Dacheng Tao, Min-Hsiu Hsieh. "Demystify Problem-Dependent Power of Quantum Neural Networks on Multi-Class Classification." Physical Review Letters 131, 140601 (2023)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/10476169/Screenshot_2023-05-16_at_5.35.51_PM.png)
經典: 1 error per 6 month in a 128MB PC100 SDRAM (2009)
量子: 1 error per second per qubit (2021)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8793327/pasted-from-clipboard.png)
4
Noise
\(\mathcal{C}\): The collection of all parameters
\(\mathcal{A}\): The collection of all possible circuits
\(\mathcal{E}_{\bm{a}}\): The error for the architecture \(\bm{a}\)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8294054/Screen_Shot_2021-03-01_at_10.50.07_pm.png)
[1] Yuxuan Du, Tao Huang, Shan You, Min-Hsiu Hsieh, Dacheng Tao. Quantum circuit architecture search: error mitigation and trainability enhancement for variational quantum solvers. npj Quantum Information volume 8, Article number: 62 (2022).
4.1
Error Mitigation
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/7973247/Screen_Shot_2020-11-25_at_10.24.17_am.png)
4.1
Error Mitigation
[1] Yuxuan Du, Tao Huang, Shan You, Min-Hsiu Hsieh, Dacheng Tao. Quantum circuit architecture search: error mitigation and trainability enhancement for variational quantum solvers. npj Quantum Information volume 8, Article number: 62 (2022).
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/7973249/Screen_Shot_2020-11-25_at_10.27.29_am.png)
Hydrogen Simulation+EM
4.1
Error Mitigation
[1] Yuxuan Du, Tao Huang, Shan You, Min-Hsiu Hsieh, Dacheng Tao. Quantum circuit architecture search: error mitigation and trainability enhancement for variational quantum solvers. arXiv:2010.10217 (2020).
Could noise become useful in QML?
YES!
4.2
Harnessing Noise
4.2
Harnessing Noise
[Robustness]
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355607/Screen_Shot_2022-02-22_at_3.44.43_pm.png)
[Privacy]
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/9355608/Screen_Shot_2022-02-22_at_3.47.01_pm.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8883720/pasted-from-clipboard.png)
4.2.1
Providing Privacy
Differential Privacy (DP)
Classical DP is well studied; however, Quantum DP is not.
[1] Li Zhou and Mingsheng Ying. Differential privacy in quantum computation. In 2017 IEEE 30th Computer Security Foundations Symposium (CSF), pages 249–262. IEEE, 2017.
[2] Scott Aaronson and Guy N Rothblum. Gentle measurement of quantum states and differential privacy. Proceedings of ACM STOC‘2019.
4.2.1
Providing Privacy
Regression+DP
[1] Yuxuan Du, Min-Hsiu Hsieh, Tongliang Liu, Shan You, Dacheng Tao. Quantum differentially private sparse regression learning. arXiv:2007.11921 (2020)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8890645/pasted-from-clipboard.png)
1. The first quantum DP algorithm.
2. Have the same privacy guarantee with the best classical DP algorithm.
3. Huge runtime improvement.
Contribution:
[1] Yuxuan Du, Min-Hsiu Hsieh, Tongliang Liu, Shan You, Dacheng Tao. Quantum differentially private sparse regression learning. arXiv:2007.11921 (2020)
4.2.1
Providing Privacy
Adversarial Attack
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8883749/pasted-from-clipboard.png)
[1] Lu et.al, “Quantum Adversarial Machine Learning". [arXiv:2001.00030]
4.2.2
Robustness
Adversarial Robustness
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8883759/pasted-from-clipboard.png)
4.2.2
Robustness
2. Depolarizing noise suffices.
![](https://s3.amazonaws.com/media-p.slid.es/uploads/704912/images/8883762/pasted-from-clipboard.png)
Contribution:
1. Explicit relation between p and \(\tau\).
[1]Yuxuan Du, Min-Hsiu Hsieh, Tongliang Liu, Dacheng Tao, Nana Liu. Quantum noise protects quantum classifiers against adversaries. Physical Review Research 3, 023153 (2021). [arXiv:2003.09416].
4.2.2
Robustness
Thank you for your attention!
QML-Lisbon Uni
By Lawrence Min-Hsiu Hsieh
QML-Lisbon Uni
AQIS 2021
- 21