<span itemscope itemtype="http://schema.org/InformAction"><span style="display:none" itemprop="about" itemscope itemtype="http://schema.org/Thing/Paragraph"><meta itemprop="description" content="Beschreibung aktualisiert"/></span><span itemprop="object" itemscope itemtype="http://schema.org/Event"><div style=""><table cellspacing="0" cellpadding="8" border="0" summary="" style="width:100%;font-family:Arial,Sans-serif;border:1px Solid #ccc;border-width:1px 2px 2px 1px;background-color:#fff;"><tr><td><meta itemprop="eventStatus" content="http://schema.org/EventRescheduled"/><h4 style="padding:6px 0;margin:0 0 4px 0;font-family:Arial,Sans-serif;font-size:13px;line-height:1.4;border:1px Solid #fff;background:#fff;color:#090;font-weight:normal"><strong>Dieser Termin wurde geändert.</strong></h4><div style="padding:2px"><span itemprop="publisher" itemscope itemtype="http://schema.org/Organization"><meta itemprop="name" content="Google Calendar"/></span><meta itemprop="eventId/googleCalendar" content="370peef08vfmaai04jllr9hbf1"/><h3 style="padding:0 0 6px 0;margin:0;font-family:Arial,Sans-serif;font-size:16px;font-weight:bold;color:#222"><span itemprop="name">Verified Solution Methods for Markov Decision Processes</span></h3><table style="display:inline-table" cellpadding="0" cellspacing="0" border="0" summary="Termindetails"><tr><td style="padding:0 1em 10px 0;font-family:Arial,Sans-serif;font-size:13px;color:#888;white-space:nowrap;width:90px" valign="top"><div><i style="font-style:normal">Wann</i></div></td><td style="padding-bottom:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222" valign="top"><div style="text-indent:-1px"><time itemprop="startDate" datetime="20210609T120000Z"></time><time itemprop="endDate" datetime="20210609T123000Z"></time>Mi 9. Jun. 2021 14:00 – 14:30 <span style="color:#888">Mitteleuropäische Zeit - Berlin</span></div></td></tr><tr><td style="padding:0 1em 10px 0;font-family:Arial,Sans-serif;font-size:13px;color:#888;white-space:nowrap;width:90px" valign="top"><div><i style="font-style:normal">Wo</i></div></td><td style="padding-bottom:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222" valign="top"><div style="text-indent:-1px"><span itemprop="location" itemscope itemtype="http://schema.org/Place"><span itemprop="name" class="notranslate">https://tinyurl.com/ls21coffee</span><span dir="ltr"> (<a href="https://www.google.com/url?q=https%3A%2F%2Ftinyurl.com%2Fls21coffee&sa=D&ust=1623482053996000&usg=AOvVaw39V-OXLaDJ31IfA5900guW" style="color:#20c;white-space:nowrap" target="_blank" itemprop="map">Karte</a>)</span></span></div></td></tr><tr><td style="padding:0 1em 10px 0;font-family:Arial,Sans-serif;font-size:13px;color:#888;white-space:nowrap;width:90px" valign="top"><div><i style="font-style:normal">Kalender</i></div></td><td style="padding-bottom:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222" valign="top"><div style="text-indent:-1px">club2@mailbroy.informatik.tu-muenchen.de</div></td></tr><tr><td style="padding:0 1em 10px 0;font-family:Arial,Sans-serif;font-size:13px;color:#888;white-space:nowrap;width:90px" valign="top"><div><i style="font-style:normal">Wer</i></div></td><td style="padding-bottom:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222" valign="top"><table cellspacing="0" cellpadding="0"><tr><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222;width:10px"><div style="text-indent:-1px"><span style="font-family:Courier New,monospace">&#x2022;</span></div></td><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222"><div style="text-indent:-1px"><div><div style="margin:0 0 0.3em 0"><span class="notranslate">piller@in.tum.de</span><span style="font-size:11px;color:#888">- Veranstalter</span></div></div></div></td></tr><tr><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222;width:10px"><div style="text-indent:-1px"><span style="font-family:Courier New,monospace">&#x2022;</span></div></td><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222"><div style="text-indent:-1px"><div><div style="margin:0 0 0.3em 0"><span itemprop="attendee" itemscope itemtype="http://schema.org/Person"><span itemprop="name" class="notranslate">maximilian.schaeffeler@tum.de</span><meta itemprop="email" content="maximilian.schaeffeler@tum.de"/></span></div></div></div></td></tr><tr><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222;width:10px"><div style="text-indent:-1px"><span style="font-family:Courier New,monospace">&#x2022;</span></div></td><td style="padding-right:10px;font-family:Arial,Sans-serif;font-size:13px;color:#222"><div style="text-indent:-1px"><div><div style="margin:0 0 0.3em 0"><span itemprop="attendee" itemscope itemtype="http://schema.org/Person"><span itemprop="name" class="notranslate">club2@mailbroy.informatik.tu-muenchen.de</span><meta itemprop="email" content="club2@mailbroy.informatik.tu-muenchen.de"/></span></div></div></div></td></tr></table></td></tr></table><div style="float:right;font-weight:bold;font-size:13px"> <a href="https://calendar.google.com/calendar/event?action=VIEW&eid=MzcwcGVlZjA4dmZtYWFpMDRqbGxyOWhiZjEgY2x1YjJAbWFpbGJyb3kuaW5mb3JtYXRpay50dS1tdWVuY2hlbi5kZQ&tok=NTIjc2U2ZWJlM3RvZmY0Y2g1bm11bmlibTVtOThAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbWEyNzZhYjhkYTg5NGNiMTM3MWE0NDJiYjE5YWM4NTIxMTgzNzBkOTE&ctz=Europe%2FBerlin&hl=de&es=0" style="color:#20c;white-space:nowrap" itemprop="url">Mehr Details »</a><br></div><div style="padding-bottom:15px;font-family:Arial,Sans-serif;font-size:13px;color:#222;white-space:pre-wrap!important;white-space:-moz-pre-wrap!important;white-space:-pre-wrap!important;white-space:-o-pre-wrap!important;white-space:pre;word-wrap:break-word"><strong style="color:#080">Geändert: </strong><span>Speaker: Maximilian Schäffeler<br><br>Type: Master's Thesis Presentation<br><p><span>Abstract: Markov decision processes (MDPs) allow modeling decision-making in systemsthat exhibit both random and deterministic behavior. In our work, we extend anexisting formalization of MDPs in the interactive theorem prover Isabelle/HOL.First, we introduce policies that formalize the strategy of the decision-maker.To assign a value to policies, we add reward functions to the MDPformalization. The problem arises of how to find an optimal policy, one thatmaximizes the rewards accumulated over time. We solve the problem byformalizing its Bellman equation and give conditions under which an optimalpolicy exists. </span></p><p><span>Based on these developments, we verify the value iteration andpolicy iteration algorithms which compute (close to) optimal policies. Thisformalization may serve as a basis for future work on reinforcement learningalgorithms, planning under uncertainty, and partially observable MDPs.</span></p></span><meta itemprop="description" content="Speaker: Maximilian SchäffelerType: Master's Thesis PresentationAbstract: Markov decision processes (MDPs) allow modeling decision-making in systemsthat exhibit both random and deterministic behavior. In our work, we extend anexisting formalization of MDPs in the interactive theorem prover Isabelle/HOL.First, we introduce policies that formalize the strategy of the decision-maker.To assign a value to policies, we add reward functions to the MDPformalization. The problem arises of how to find an optimal policy, one thatmaximizes the rewards accumulated over time. We solve the problem byformalizing its Bellman equation and give conditions under which an optimalpolicy exists.&nbsp;Based on these developments, we verify the value iteration andpolicy iteration algorithms which compute (close to) optimal policies. Thisformalization may serve as a basis for future work on reinforcement learningalgorithms, planning under uncertainty, and partially observable MDPs."/></div></div><p style="color:#222;font-size:13px;margin:0"><span style="color:#888">Teilnehmen (club2@mailbroy.informatik.tu-muenchen.de)?   </span><wbr><strong><span itemprop="potentialaction" itemscope itemtype="http://schema.org/RsvpAction"><meta itemprop="attendance" content="http://schema.org/RsvpAttendance/Yes"/><span itemprop="handler" itemscope itemtype="http://schema.org/HttpActionHandler"><link itemprop="method" href="http://schema.org/HttpRequestMethod/GET"/><a href="https://calendar.google.com/calendar/event?action=RESPOND&eid=MzcwcGVlZjA4dmZtYWFpMDRqbGxyOWhiZjEgY2x1YjJAbWFpbGJyb3kuaW5mb3JtYXRpay50dS1tdWVuY2hlbi5kZQ&rst=1&tok=NTIjc2U2ZWJlM3RvZmY0Y2g1bm11bmlibTVtOThAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbWEyNzZhYjhkYTg5NGNiMTM3MWE0NDJiYjE5YWM4NTIxMTgzNzBkOTE&ctz=Europe%2FBerlin&hl=de&es=0" style="color:#20c;white-space:nowrap" itemprop="url">Ja</a></span></span><span style="margin:0 0.4em;font-weight:normal"> - </span><span itemprop="potentialaction" itemscope itemtype="http://schema.org/RsvpAction"><meta itemprop="attendance" content="http://schema.org/RsvpAttendance/Maybe"/><span itemprop="handler" itemscope itemtype="http://schema.org/HttpActionHandler"><link itemprop="method" href="http://schema.org/HttpRequestMethod/GET"/><a href="https://calendar.google.com/calendar/event?action=RESPOND&eid=MzcwcGVlZjA4dmZtYWFpMDRqbGxyOWhiZjEgY2x1YjJAbWFpbGJyb3kuaW5mb3JtYXRpay50dS1tdWVuY2hlbi5kZQ&rst=3&tok=NTIjc2U2ZWJlM3RvZmY0Y2g1bm11bmlibTVtOThAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbWEyNzZhYjhkYTg5NGNiMTM3MWE0NDJiYjE5YWM4NTIxMTgzNzBkOTE&ctz=Europe%2FBerlin&hl=de&es=0" style="color:#20c;white-space:nowrap" itemprop="url">Vielleicht</a></span></span><span style="margin:0 0.4em;font-weight:normal"> - </span><span itemprop="potentialaction" itemscope itemtype="http://schema.org/RsvpAction"><meta itemprop="attendance" content="http://schema.org/RsvpAttendance/No"/><span itemprop="handler" itemscope itemtype="http://schema.org/HttpActionHandler"><link itemprop="method" href="http://schema.org/HttpRequestMethod/GET"/><a href="https://calendar.google.com/calendar/event?action=RESPOND&eid=MzcwcGVlZjA4dmZtYWFpMDRqbGxyOWhiZjEgY2x1YjJAbWFpbGJyb3kuaW5mb3JtYXRpay50dS1tdWVuY2hlbi5kZQ&rst=2&tok=NTIjc2U2ZWJlM3RvZmY0Y2g1bm11bmlibTVtOThAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbWEyNzZhYjhkYTg5NGNiMTM3MWE0NDJiYjE5YWM4NTIxMTgzNzBkOTE&ctz=Europe%2FBerlin&hl=de&es=0" style="color:#20c;white-space:nowrap" itemprop="url">Nein</a></span></span></strong>    <wbr><a href="https://calendar.google.com/calendar/event?action=VIEW&eid=MzcwcGVlZjA4dmZtYWFpMDRqbGxyOWhiZjEgY2x1YjJAbWFpbGJyb3kuaW5mb3JtYXRpay50dS1tdWVuY2hlbi5kZQ&tok=NTIjc2U2ZWJlM3RvZmY0Y2g1bm11bmlibTVtOThAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbWEyNzZhYjhkYTg5NGNiMTM3MWE0NDJiYjE5YWM4NTIxMTgzNzBkOTE&ctz=Europe%2FBerlin&hl=de&es=0" style="color:#20c;white-space:nowrap" itemprop="url">Weitere Optionen »</a></p></td></tr><tr><td style="background-color:#f6f6f6;color:#888;border-top:1px Solid #ccc;font-family:Arial,Sans-serif;font-size:11px"><p>Einladung von <a href="https://calendar.google.com/calendar/" target="_blank" style="">Google Kalender</a></p><p>Sie erhalten diese E-Mail unter club2@mailbroy.informatik.tu-muenchen.de, da Sie ein Gast bei diesem Termin sind.</p><p>Lehnen Sie diesen Termin ab, um keine weiteren Informationen zu diesem Termin zu erhalten. Sie können auch unter https://calendar.google.com/calendar/ ein Google-Konto erstellen und Ihre Benachrichtigungseinstellungen für Ihren gesamten Kalender steuern.</p><p>Wenn Sie diese Einladung weiterleiten, kann jeder Empfänger eine Antwort an den Organisator senden und zur Gästeliste hinzugefügt werden. Außerdem könnte er weitere Nutzer einladen und Ihre Antwort ändern. <a href="https://support.google.com/calendar/answer/37135#forwarding">Weitere Informationen</a>.</p></td></tr></table></div></span></span>