<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">=========================================<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Spring 2024 CS 4900/5900 – Game AI (Artificial Intelligence in Games)
<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Instructor: Dr. Chang Liu (<a href="mailto:liuc@ohio.edu">liuc@ohio.edu</a>)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Credits: 3<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Class Meetings: Tu/Th 5:00pm-6:20pm @ ARC 314
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Office Hours: Thursdays from 9 to 11am @ Stocker 321c
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Course Description:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">A course that focuses on computational intelligence for computer video games. Topics include classical Markov decision processes, Monte Carlo tree search, tabular
reinforcement learning methods, and reinforcement learning with deep neural networks. All students will participate in simulated game AI competitions using the MicroRTS platform (<a href="https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FFarama-Foundation%2FMicroRTS&data=05%7C01%7Ceecs_mscs%40listserv.ohio.edu%7C26ac87641e4d4df3fc8f08dbe067d248%7Cf3308007477c4a70888934611817c55a%7C0%7C0%7C638350508754142508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Eb0TauZ5lIHNMi8Xj2SkKmI5cjn6WDp%2FreWuZlbX2c0%3D&reserved=0" originalsrc="https://github.com/Farama-Foundation/MicroRTS" shash="itq2TGCw1Prpvh3kfg+9TrkskHmIXEuGS6hKT/wkB6mIUu94EHsrrH0UIMA1D0JcQdOusTjnBlla2q3Y62aPobDhHLbHFIosxedNypPEPLMXuKYd+25b3r7kAVYbqfa0OCD/ra52BM0SidOldXnXvjmow5aVJlXRXqnjhDJ1Ujc=">https://github.com/Farama-Foundation/MicroRTS</a>)
or StarCraft II. Students will be encouraged to compete in the IEEE Conference on Games (CoG) competition of game AI (<a href="https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2F2024.ieee-cog.org%2Fcompetitions%2F&data=05%7C01%7Ceecs_mscs%40listserv.ohio.edu%7C26ac87641e4d4df3fc8f08dbe067d248%7Cf3308007477c4a70888934611817c55a%7C0%7C0%7C638350508754142508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D0%2BafFBSLgC3dtYU1NuwJKm7GjjXJ8Hz7NnJQ1kP2Rc%3D&reserved=0" originalsrc="https://2024.ieee-cog.org/competitions/" shash="ZE4mNM8JNwCJFl+IBh0CiKwup7hI87k25DrQHwXiyHzUn/XC72wnxSF7yOautPcWUQjkuJbQ/7jgIzMQlmB2O+gWWESiFozBwbFEkXCriACsQIEcSySTBfrjrH9PAngDkbb8BCQQtBk3NNOV7ggLWviXFu2Aqs99FC6QgOO1AtM=">https://2024.ieee-cog.org/competitions/</a>)
based on what they develop as part of their class activities.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Students will be required to program in Python, Java, or C++. It is not necessary to know all three programming languages, but students must be proficient in at least
one of these languages.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">This course helps student accomplish the following objectives:
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Understand current challenges in computer game AI;
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Learn classic and state-of-the-art AI algorithms for game agents;<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Analyze existing game AI algorithms;
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Run hands-on experiments on simulated computer game tournaments;
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Develop a report on the research and development of game AI in this class;
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Identify potential topics for a potential HTC/M.Sc./Ph.D. degree project, thesis, or dissertation.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Prerequisites for CS4900: CS 3560 or equivalent courses.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Prerequisites for CS5900: None.
<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">===========================<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
</div>
</body>
</html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">=========================================<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Spring 2024 CS 4900/5900 – Game AI (Artificial Intelligence in Games)
<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Instructor: Dr. Chang Liu (<a href="mailto:liuc@ohio.edu">liuc@ohio.edu</a>)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Credits: 3<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Class Meetings: Tu/Th 5:00pm-6:20pm @ ARC 314
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Office Hours: Thursdays from 9 to 11am @ Stocker 321c
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Course Description:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">A course that focuses on computational intelligence for computer video games. Topics include classical Markov decision processes, Monte Carlo tree search, tabular
reinforcement learning methods, and reinforcement learning with deep neural networks. All students will participate in simulated game AI competitions using the MicroRTS platform (<a href="https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FFarama-Foundation%2FMicroRTS&data=05%7C01%7Ceecs_mscs%40listserv.ohio.edu%7C26ac87641e4d4df3fc8f08dbe067d248%7Cf3308007477c4a70888934611817c55a%7C0%7C0%7C638350508754142508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Eb0TauZ5lIHNMi8Xj2SkKmI5cjn6WDp%2FreWuZlbX2c0%3D&reserved=0" originalsrc="https://github.com/Farama-Foundation/MicroRTS" shash="itq2TGCw1Prpvh3kfg+9TrkskHmIXEuGS6hKT/wkB6mIUu94EHsrrH0UIMA1D0JcQdOusTjnBlla2q3Y62aPobDhHLbHFIosxedNypPEPLMXuKYd+25b3r7kAVYbqfa0OCD/ra52BM0SidOldXnXvjmow5aVJlXRXqnjhDJ1Ujc=">https://github.com/Farama-Foundation/MicroRTS</a>)
or StarCraft II. Students will be encouraged to compete in the IEEE Conference on Games (CoG) competition of game AI (<a href="https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2F2024.ieee-cog.org%2Fcompetitions%2F&data=05%7C01%7Ceecs_mscs%40listserv.ohio.edu%7C26ac87641e4d4df3fc8f08dbe067d248%7Cf3308007477c4a70888934611817c55a%7C0%7C0%7C638350508754142508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D0%2BafFBSLgC3dtYU1NuwJKm7GjjXJ8Hz7NnJQ1kP2Rc%3D&reserved=0" originalsrc="https://2024.ieee-cog.org/competitions/" shash="ZE4mNM8JNwCJFl+IBh0CiKwup7hI87k25DrQHwXiyHzUn/XC72wnxSF7yOautPcWUQjkuJbQ/7jgIzMQlmB2O+gWWESiFozBwbFEkXCriACsQIEcSySTBfrjrH9PAngDkbb8BCQQtBk3NNOV7ggLWviXFu2Aqs99FC6QgOO1AtM=">https://2024.ieee-cog.org/competitions/</a>)
based on what they develop as part of their class activities.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Students will be required to program in Python, Java, or C++. It is not necessary to know all three programming languages, but students must be proficient in at least
one of these languages.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">This course helps student accomplish the following objectives:
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Understand current challenges in computer game AI;
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Learn classic and state-of-the-art AI algorithms for game agents;<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Analyze existing game AI algorithms;
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Run hands-on experiments on simulated computer game tournaments;
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Develop a report on the research and development of game AI in this class;
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">• Identify potential topics for a potential HTC/M.Sc./Ph.D. degree project, thesis, or dissertation.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Prerequisites for CS4900: CS 3560 or equivalent courses.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">Prerequisites for CS5900: None.
<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black">===========================<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Aptos",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
</div>
</body>
</html>