Dueling Deep Q-Network Agent

ML Framework: TensorFlow 2.2.0

May 24, 2020

Dueling deep Q-network (DQN) agent for training/playing classical control environments of OpenAI Gym. The agent can be adapted to interact with similar environments, i.e. with discrete action space etc., by changing a few lines of code.

View on GitHub

Selected publications

Coherent spin manipulation of individual atoms on a surface

Science 366, 509-512 (2019)

Kai Yang, William Paul, Soo-Hyon Phark, Philip Willke, Yujeong Bae, Taeyoung Choi, Taner Esat, Arzhang Ardavan, Andreas J. Heinrich, Christopher P. Lutz

DOI: 10.1126/science.aay6779

Quantitative imaging of electric surface potentials with single-atom sensitivity

Nature Materials 18, 853–859 (2019)

Christian Wagner, Matthew. F. B. Green, Michael Maiworm, Philipp Leinen, Taner Esat, Nicola Ferri, Niklas Friedrich, Rolf Findeisen, Alexandre Tkatchenko, Ruslan Temirov, F. Stefan Tautz

DOI: 10.1038/s41563-019-0382-8

A standing molecule as a single-electron field emitter

Nature 558, 573-576 (2018)

Taner Esat, Niklas Friedrich, F. Stefan Tautz, Ruslan Temirov

DOI: 10.1038/s41586-018-0223-y

A chemically driven quantum phase transition in a two-molecule Kondo system

Nature Physics 12, 867-873 (2016)

Taner Esat, Benedikt Lechtenberg, Thorsten Deilmann, Christian Wagner, Peter Krüger, Ruslan Temirov, Michael Rohlfing, Frithjof B. Anders, F. Stefan Tautz

DOI: 10.1038/nphys3737

About me

Dr. Taner Esat

Quantum Physicist &
Machine Learning Enthusiast

My name is Taner Esat. I am a researcher in the institute for Quantum Nanoscience at the Forschungszentrum Jülich and work in the field of quantum technology. My research focuses on the manipulation of the electronic and magnetic properties of matter, e.g. single molecules and atoms with scanning probe microscopy techniques, and their use for quantum information processing. I have strong background in mathematics and computer science. In addition, I have keen interest in machine learning and artificial intelligence. Among other things I use modern machine learning techniques for data analysis and for the automation of my experiments, e.g. computer vision and reinforcement learning.

In 2018/2019 I worked as a postdoc in the group of Andreas Heinrich at the Center for Quantum Nanoscience (Seoul, South Korea), where I focused on electron spin resonance and pump-probe measurements on single atoms on surfaces. Furthermore, I was a visiting researcher in the group of Christopher Lutz at IBM Almaden (San Jose, California, USA) in 2019. During my stay at IBM I measured Rabi oscillations, Ramsey fringes, and spin echo on individual magnetic atoms.

I obtained my PhD (Dr. rer. nat.) from the RWTH Aachen University in 2017 for my work at the Forschungszentrum Jülich, where I studied the magnetic interaction between molecules and their environment using scanning probe techniques under the supervision of Ruslan Temirov and Stefan Tautz. Previously, I studied physics at the Heinrich Heine University Düsseldorf and worked on quantum optics. In particular, I investigated magneto-optical traps for optical clocks and monolithic resonators for laser systems during my Bachelor and Master thesis in the groups of Axel Görlitz and Stephan Schiller, respectively.