2018: M.Sc., Electrical and Computer Engineering, Technische Universität München Master Thesis: "Hierarchical Control Structure for Autonomic MPSoCs"
05/2018 - 09/2018: Master Thesis at UC Irvine, CA, USA
2016: B.Sc. Electrical and Computer Engineering, Technische Universität München Bachelor Thesis: "Design, Simulation and Optimization of a Variable Optical Attenuator Driver"
Interested in an internship or a thesis? Please send me an email. The given type of work is just a guideline and could be changed if needed. From time to time, there might be some work, that is not announced yet. Feel free to ask!
Ongoing Theses
BAMAIDPFPIPSEMSHK
Title
-✔-----
Development of a Multi-Agent Reinforcement Learning Approach for an MPSoC
Development of a Multi-Agent Reinforcement Learning Approach for an MPSoC
Description
In latest research, machine learning has been successfully applied to many kinds of problems like picture classification or control. Machine learning has shown to be able to build highly accurate models also for a big amount of sensor data. In many problems, like autonomous driving, coordination between different entities (cars) which are controlled individually is necessary to optimize for a specific goal (routing with least average travelling time).
In such problems mainly two approaches exist: the (1) centralized and the (2) decentralized one. In the first (1) one, all sensor data is shared with a central controller which processes it. In the decentralized (2) manner only parts of the data is shared between the different entities, which decide on their actions locally based on the available information.
In our IPF project, we use rule-based RL (LCT) to optimize runtime parameters (DVFS, Task mapping) of MPSoCs. Currently per-core LCTs optimize locally without knowledge about a common goal or the state of other LCTs and their cores.
This MA is investigating how to achieve coordination between the per-core LCTs by
comparing known approaches in literature
comparing thei applicability in simulation
implementation and evaluation of one approach on an FPGA prototype
In contrast to the continued rise of various deep neural network ML variants, we favor the properties that come with explicit knowledge LCS (Learning Classifier System) -type ML techniques in our IPF project: interpretable and explainable rules which also can be pre-initialized with best-practice prior knowledge content.
This Seminar should provide an overview of existing, explainable ML techniques and of methodes to make black-box techniques (NNs) explainable.
The goal of this thesis is to improve the current task migration mechanism in our IPF platform. This one should be especially adapted to heterogeneous MPSoCs.
Therefore, different scheduling methods schould be investigated based on a literature study.
Before implementing in HW, simulations will be done in Matlab.
Today's Multi-Processor System-on-Chip (MPSoCs) are getting more and more complex due to the growing amount of cores and accelerators. Hence it's not possible anymore to set runtime parameters like frequency and task distribution by design time in an optimal manner. Therefore future controllers try to make use of machine learning which is aware of the system's current state (self-awareness).
Information Processing Factory (IPF) is a global project that claims to show self-awareness across multiple abstraction levels. It represents a paradigm shift in platform design by envisioning the move towards a consistent platform-centric design in which the combination of self-organized learning and formal reactive methods guarantee the applicability of such cyber-physical systems in safety-critical and high-availability applications.
At TUM, we explore the application and implementation of machine learning algorithms in hardware to optimize the mode of operation of MPSoCs at runtime.
Currently we are running a quite simple programm on our MPSoC which doesn't allow us to evaluate all the features our self-aware system provides.
Therefore, it would be your task to develop a easely configurable software to be executed on the MPSoC which schedules different benchmarks.
Towards this goal, you'll complete the following tasks:
Literature research on embedded benchmarks + scheduling mechanisms
Getting familiar with our SparcV8 (Leon 3) architecture
Today's Multi-Processor System-on-Chip (MPSoCs) are getting more and more complex due to the growing amount of cores and accelerators. Hence it's not possible anymore to set runtime parameters like frequency and task distribution by design time in an optimal manner. Therefore future controllers try to make use of machine learning which is aware of the system's current state (self-awareness).
Information Processing Factory (IPF) is a global project that claims to show self-awareness across multiple abstraction levels. It represents a paradigm shift in platform design by envisioning the move towards a consistent platform-centric design in which the combination of self-organized learning and formal reactive methods guarantee the applicability of such cyber-physical systems in safety-critical and high-availability applications.
At TUM, we explore the application and implementation of machine learning algorithms in hardware to optimize the mode of operation of MPSoCs at runtime.
Therefore, we currently evaluate our research primary on FPGAs, but also by Gem5 simulations. Unfortunatelly, the FPGA evaluation causes long and quite complex developement and Gem5 simulation is time intensive when running experiments several times for different parameters or approaches.
To overcome these two issues, you will extend a simulation environment which performs trace-based DVFS (should be extended to Task Migration) simulation in Matlab towards a multi-core system.
Your environment should keep using Gem5 traces and provide performance and power metrics, as well as the current state like utilization as outputs when performing DVFS in a multicore system. Hereby, your environment has to account for shared resources.
Towards this goal, you'll complete the following tasks:
Literature research on the state of the art of trace-based simulation
Getting familiar with object orientated programming in Matlab
Developping your simulation environement in Matlab
Verifying your environement by comparing to Gem5
This topic can be extended to a Master Thesis.
Prerequisites
Good Knowledge about MPSoCs
Good Matlab Knowledge
Good Bash Knowledge
Basic Knowledge about Trace-Based Simulation
Maybe Gem5 Knowledge
Contact
flo.maurer@tum.de
Student projects will be continued and started also under the current circumstances (SARS-CoV-2). This task can be executed remotly by accessing our chair's computers, or a students personal device, as all needed programs are either free or a student license is available.
Eberle Andrey Rambo; Bryan Donyanavard; Minjun Seo; Florian Maurer; Thawra Mohammad Kadeed; Caio Batista De Melo; Biswadip Maity; Anmol Surhonne; Andreas Herkersdorf; Fadi Kurdahi; Nikil D. Dutt; Rolf Ernst: The Self-Aware Information Processing Factory Paradigm for Mixed-Critical Multiprocessing. IEEE Transactions on Emerging Topics in Computing, 2020, 1-1 more…BibTeX
Full text (
DOI
)
Florian Maurer, Bryan Donyanavard, Amir M. Rahmani, Nikil Dutt, Andreas Herkersdorf: Emergent Control of MPSoC Operation by a Hierarchical Supervisor / Reinforcement Learning Approach. DATE 2020, 2020 more…BibTeX
2019
Donyanavard, Bryan; Sadighi, Armin; Maurer, Florian; Mück, Tiago; Rahmani, Amir M.; Herkersdorf, Andreas; Dutt, Nikil: SOSA: Self-Optimizing Learning with Self-Adaptive Control for Hierarchical System-on-Chip Management. Proceedings of the 52Nd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO '52), ACM, 2019 more…BibTeX
Full text (
DOI
)
Rambo, Eberle A.; Donyanavard, Bryan; Seo, Minjun; Maurer, Florian; Kadeed, Thawra; de Melo, Caio B.; Maity, Biswadip; Surhonne, Anmol; Herkersdorf, Andreas; Kurdahi, Fadi; Dutt, Nikil; Ernst, Rolf: The Information Processing Factory: Organization, Terminology, and Definitions. , 2019 more…BibTeX
Rambo, Eberle A.; Kadeed, Thawra; Ernst, Rolf; Seo, Minjun; Kurdahi, Fadi; Donyanavard, Bryan; de Melo, Caio Batista; Maity, Biswadip; Moazzemi, Kasra; Stewart, Kenneth; Yi, Saehanseul; Rahmani, Amir M.; Dutt, Nikil; Maurer, Florian; Doan, Nguyen Anh Vu; Surhonne, Anmol; Wild, Thomas; Herkersdorf, Andreas: The Information Processing Factory: A Paradigm for Life Cycle Management of Dependable Systems. ESweek, 2019 more…BibTeX
Full text (
DOI
)