<span itemscope itemtype="http://schema.org/InformAction"><span style="display:none" itemprop="about" itemscope itemtype="http://schema.org/Person"><meta itemprop="description" content="Einladung von piller@in.tum.de"/></span><span itemprop="object" itemscope itemtype="http://schema.org/Event"><div style=""><table cellspacing="0" cellpadding="8" border="0" summary="" style="width:100%;font-family:Arial,Sans-serif;border:1px Solid #ccc;border-width:1px 2px 2px 1px;background-color:#fff;"><tr><td><meta itemprop="eventStatus" content="http://schema.org/EventScheduled"/><h4 style="padding:6px 0;margin:0 0 4px 0;font-family:Arial,Sans-serif;font-size:13px;line-height:1.4;border:1px Solid #fff;background:#fff;color:#090;font-weight:normal"><strong>Sie wurden zum folgenden Termin eingeladen.</strong></h4><div style="padding:2px"><span itemprop="publisher" itemscope itemtype="http://schema.org/Organization"><meta itemprop="name" content="Google Calendar"/></span><meta itemprop="eventId/googleCalendar" content="370peef08vfmaai04jllr9hbf1"/><h3 style="padding:0 0 6px 0;margin:0;font-family:Arial,Sans-serif;font-size:16px;font-weight:bold;color:#222"><span itemprop="name">Verified Solution Methods for Markov Decision Processes</span></h3><table style="display:inline-table" cellpadding="0" cellspacing="0" border="0" summary="Termindetails"><tr><td style="padding:0 1em 10px 0;font-family:Arial,Sans-serif;font-size:13px;color:#888;white-space:nowrap;width:90px" valign="top"><div><i style="font-style:normal">Wann</i></div></td><td style="padding-bottom:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222" valign="top"><div style="text-indent:-1px"><time itemprop="startDate" datetime="20210609T120000Z"></time><time itemprop="endDate" datetime="20210609T123000Z"></time>Mi 9. Jun. 2021 14:00 – 14:30 <span style="color:#888">Mitteleuropäische Zeit - Berlin</span></div></td></tr><tr><td style="padding:0 1em 10px 0;font-family:Arial,Sans-serif;font-size:13px;color:#888;white-space:nowrap;width:90px" valign="top"><div><i style="font-style:normal">Wo</i></div></td><td style="padding-bottom:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222" valign="top"><div style="text-indent:-1px"><span itemprop="location" itemscope itemtype="http://schema.org/Place"><span itemprop="name" class="notranslate">https://tinyurl.com/ls21coffee</span><span dir="ltr"> (<a href="https://www.google.com/url?q=https%3A%2F%2Ftinyurl.com%2Fls21coffee&sa=D&ust=1623481884639000&usg=AOvVaw2B2W3LbMi0YiZRCs4_7688" style="color:#20c;white-space:nowrap" target="_blank" itemprop="map">Karte</a>)</span></span></div></td></tr><tr><td style="padding:0 1em 10px 0;font-family:Arial,Sans-serif;font-size:13px;color:#888;white-space:nowrap;width:90px" valign="top"><div><i style="font-style:normal">Kalender</i></div></td><td style="padding-bottom:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222" valign="top"><div style="text-indent:-1px">club2@mailbroy.informatik.tu-muenchen.de</div></td></tr><tr><td style="padding:0 1em 10px 0;font-family:Arial,Sans-serif;font-size:13px;color:#888;white-space:nowrap;width:90px" valign="top"><div><i style="font-style:normal">Wer</i></div></td><td style="padding-bottom:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222" valign="top"><table cellspacing="0" cellpadding="0"><tr><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222;width:10px"><div style="text-indent:-1px"><span style="font-family:Courier New,monospace">•</span></div></td><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222"><div style="text-indent:-1px"><div><div style="margin:0 0 0.3em 0"><span class="notranslate">piller@in.tum.de</span><span style="font-size:11px;color:#888">- Veranstalter</span></div></div></div></td></tr><tr><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222;width:10px"><div style="text-indent:-1px"><span style="font-family:Courier New,monospace">•</span></div></td><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222"><div style="text-indent:-1px"><div><div style="margin:0 0 0.3em 0"><span itemprop="attendee" itemscope itemtype="http://schema.org/Person"><span itemprop="name" class="notranslate">maximilian.schaeffeler@tum.de</span><meta itemprop="email" content="maximilian.schaeffeler@tum.de"/></span></div></div></div></td></tr><tr><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222;width:10px"><div style="text-indent:-1px"><span style="font-family:Courier New,monospace">•</span></div></td><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222"><div style="text-indent:-1px"><div><div style="margin:0 0 0.3em 0"><span itemprop="attendee" itemscope itemtype="http://schema.org/Person"><span itemprop="name" class="notranslate">club2@mailbroy.informatik.tu-muenchen.de</span><meta itemprop="email" content="club2@mailbroy.informatik.tu-muenchen.de"/></span></div></div></div></td></tr></table></td></tr></table><div style="float:right;font-weight:bold;font-size:13px"> <a href="https://calendar.google.com/calendar/event?action=VIEW&eid=MzcwcGVlZjA4dmZtYWFpMDRqbGxyOWhiZjEgY2x1YjJAbWFpbGJyb3kuaW5mb3JtYXRpay50dS1tdWVuY2hlbi5kZQ&tok=NTIjc2U2ZWJlM3RvZmY0Y2g1bm11bmlibTVtOThAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbWEyNzZhYjhkYTg5NGNiMTM3MWE0NDJiYjE5YWM4NTIxMTgzNzBkOTE&ctz=Europe%2FBerlin&hl=de&es=0" style="color:#20c;white-space:nowrap" itemprop="url">Mehr Details »</a><br></div><div style="padding-bottom:15px;font-family:Arial,Sans-serif;font-size:13px;color:#222;white-space:pre-wrap!important;white-space:-moz-pre-wrap!important;white-space:-pre-wrap!important;white-space:-o-pre-wrap!important;white-space:pre;word-wrap:break-word"><span>Speaker: Maximilian Schäffeler<p>Type: Master's Thesis Presentation</p><p>Abstract: Markov decision processes (MDPs) allow modeling decision-making in systems that<br>exhibit both random and deterministic behavior. In our work, we extend an existing for-<br>malization of MDPs in the interactive theorem prover Isabelle/HOL. First, we introduce<br>policies that formalize the strategy of the decision-maker. To assign a value to policies,<br>we add reward functions to the MDP formalization. The problem arises of how to find<br>an optimal policy, one that maximizes the rewards accumulated over time. We solve<br>the problem by formalizing its Bellman equation and give conditions under which an<br>optimal policy exists.<br>Based on these developments, we verify the value iteration and policy iteration<br>algorithms which compute (close to) optimal policies. This formalization may serve as a<br>basis for future work on reinforcement learning algorithms, planning under uncertainty,<br>and partially observable MDPs.</p></span><meta itemprop="description" content="Speaker: Maximilian Schäffeler
Type: Master's Thesis Presentation
Abstract: Markov decision processes (MDPs) allow modeling decision-making in systems that
exhibit both random and deterministic behavior. In our work, we extend an existing for-
malization of MDPs in the interactive theorem prover Isabelle/HOL. First, we introduce
policies that formalize the strategy of the decision-maker. To assign a value to policies,
we add reward functions to the MDP formalization. The problem arises of how to find
an optimal policy, one that maximizes the rewards accumulated over time. We solve
the problem by formalizing its Bellman equation and give conditions under which an
optimal policy exists.
Based on these developments, we verify the value iteration and policy iteration
algorithms which compute (close to) optimal policies. This formalization may serve as a
basis for future work on reinforcement learning algorithms, planning under uncertainty,
and partially observable MDPs."/></div></div><p style="color:#222;font-size:13px;margin:0"><span style="color:#888">Teilnehmen (club2@mailbroy.informatik.tu-muenchen.de)? </span><wbr><strong><span itemprop="potentialaction" itemscope itemtype="http://schema.org/RsvpAction"><meta itemprop="attendance" content="http://schema.org/RsvpAttendance/Yes"/><span itemprop="handler" itemscope itemtype="http://schema.org/HttpActionHandler"><link itemprop="method" href="http://schema.org/HttpRequestMethod/GET"/><a href="https://calendar.google.com/calendar/event?action=RESPOND&eid=MzcwcGVlZjA4dmZtYWFpMDRqbGxyOWhiZjEgY2x1YjJAbWFpbGJyb3kuaW5mb3JtYXRpay50dS1tdWVuY2hlbi5kZQ&rst=1&tok=NTIjc2U2ZWJlM3RvZmY0Y2g1bm11bmlibTVtOThAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbWEyNzZhYjhkYTg5NGNiMTM3MWE0NDJiYjE5YWM4NTIxMTgzNzBkOTE&ctz=Europe%2FBerlin&hl=de&es=0" style="color:#20c;white-space:nowrap" itemprop="url">Ja</a></span></span><span style="margin:0 0.4em;font-weight:normal"> - </span><span itemprop="potentialaction" itemscope itemtype="http://schema.org/RsvpAction"><meta itemprop="attendance" content="http://schema.org/RsvpAttendance/Maybe"/><span itemprop="handler" itemscope itemtype="http://schema.org/HttpActionHandler"><link itemprop="method" href="http://schema.org/HttpRequestMethod/GET"/><a href="https://calendar.google.com/calendar/event?action=RESPOND&eid=MzcwcGVlZjA4dmZtYWFpMDRqbGxyOWhiZjEgY2x1YjJAbWFpbGJyb3kuaW5mb3JtYXRpay50dS1tdWVuY2hlbi5kZQ&rst=3&tok=NTIjc2U2ZWJlM3RvZmY0Y2g1bm11bmlibTVtOThAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbWEyNzZhYjhkYTg5NGNiMTM3MWE0NDJiYjE5YWM4NTIxMTgzNzBkOTE&ctz=Europe%2FBerlin&hl=de&es=0" style="color:#20c;white-space:nowrap" itemprop="url">Vielleicht</a></span></span><span style="margin:0 0.4em;font-weight:normal"> - </span><span itemprop="potentialaction" itemscope itemtype="http://schema.org/RsvpAction"><meta itemprop="attendance" content="http://schema.org/RsvpAttendance/No"/><span itemprop="handler" itemscope itemtype="http://schema.org/HttpActionHandler"><link itemprop="method" href="http://schema.org/HttpRequestMethod/GET"/><a href="https://calendar.google.com/calendar/event?action=RESPOND&eid=MzcwcGVlZjA4dmZtYWFpMDRqbGxyOWhiZjEgY2x1YjJAbWFpbGJyb3kuaW5mb3JtYXRpay50dS1tdWVuY2hlbi5kZQ&rst=2&tok=NTIjc2U2ZWJlM3RvZmY0Y2g1bm11bmlibTVtOThAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbWEyNzZhYjhkYTg5NGNiMTM3MWE0NDJiYjE5YWM4NTIxMTgzNzBkOTE&ctz=Europe%2FBerlin&hl=de&es=0" style="color:#20c;white-space:nowrap" itemprop="url">Nein</a></span></span></strong> <wbr><a href="https://calendar.google.com/calendar/event?action=VIEW&eid=MzcwcGVlZjA4dmZtYWFpMDRqbGxyOWhiZjEgY2x1YjJAbWFpbGJyb3kuaW5mb3JtYXRpay50dS1tdWVuY2hlbi5kZQ&tok=NTIjc2U2ZWJlM3RvZmY0Y2g1bm11bmlibTVtOThAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbWEyNzZhYjhkYTg5NGNiMTM3MWE0NDJiYjE5YWM4NTIxMTgzNzBkOTE&ctz=Europe%2FBerlin&hl=de&es=0" style="color:#20c;white-space:nowrap" itemprop="url">Weitere Optionen »</a></p></td></tr><tr><td style="background-color:#f6f6f6;color:#888;border-top:1px Solid #ccc;font-family:Arial,Sans-serif;font-size:11px"><p>Einladung von <a href="https://calendar.google.com/calendar/" target="_blank" style="">Google Kalender</a></p><p>Sie erhalten diese E-Mail unter club2@mailbroy.informatik.tu-muenchen.de, da Sie ein Gast bei diesem Termin sind.</p><p>Lehnen Sie diesen Termin ab, um keine weiteren Informationen zu diesem Termin zu erhalten. Sie können auch unter https://calendar.google.com/calendar/ ein Google-Konto erstellen und Ihre Benachrichtigungseinstellungen für Ihren gesamten Kalender steuern.</p><p>Wenn Sie diese Einladung weiterleiten, kann jeder Empfänger eine Antwort an den Organisator senden und zur Gästeliste hinzugefügt werden. Außerdem könnte er weitere Nutzer einladen und Ihre Antwort ändern. <a href="https://support.google.com/calendar/answer/37135#forwarding">Weitere Informationen</a>.</p></td></tr></table></div></span></span>