{"id":4568,"date":"2014-05-17T07:15:49","date_gmt":"2014-05-17T13:15:49","guid":{"rendered":"https:\/\/www.roughtype.com\/?p=4568"},"modified":"2014-05-17T09:16:02","modified_gmt":"2014-05-17T15:16:02","slug":"programming-the-moral-robot","status":"publish","type":"post","link":"https:\/\/www.roughtype.com\/?p=4568","title":{"rendered":"Programming the moral robot"},"content":{"rendered":"<p><a href=\"https:\/\/i0.wp.com\/www.roughtype.com\/wp\/wp-content\/uploads\/2014\/05\/frank.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-4572\" src=\"https:\/\/i0.wp.com\/www.roughtype.com\/wp\/wp-content\/uploads\/2014\/05\/frank.jpg?resize=500%2C158&#038;ssl=1\" alt=\"frank\" width=\"500\" height=\"158\" srcset=\"https:\/\/i0.wp.com\/www.roughtype.com\/wp\/wp-content\/uploads\/2014\/05\/frank.jpg?w=500&amp;ssl=1 500w, https:\/\/i0.wp.com\/www.roughtype.com\/wp\/wp-content\/uploads\/2014\/05\/frank.jpg?resize=300%2C94&amp;ssl=1 300w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/a><\/p>\n<p>The U.S. Navy&#8217;s Office of Naval Research is <a href=\"http:\/\/www.defenseone.com\/technology\/2014\/05\/now-military-going-build-robots-have-morals\/84325\/\">funding<\/a> an effort, by scientists\u00a0at Tufts, Brown, and RPI, to <a href=\"http:\/\/now.tufts.edu\/news-releases\/teaching-robots-right-wrong\">develop<\/a> military robots capable of moral reasoning:<\/p>\n<blockquote><p><span style=\"color: #2a2b2d;\">The ONR-funded project will first isolate essential elements of human moral competence through theoretical and empirical research. Based on the results, the team will develop formal frameworks for modeling human-level moral reasoning that can be verified. Next, it will implement corresponding mechanisms for moral competence in a computational architecture.<\/span><\/p><\/blockquote>\n<p>That sounds straightforward. But hidden in those three short sentences are, so far as I can make out, at least eight\u00a0philosophical challenges of extraordinary complexity:<\/p>\n<ul>\n<li>Defining\u00a0&#8220;human moral competence&#8221;<\/li>\n<li>Boiling that competence down to a set of isolated &#8220;essential elements&#8221;<\/li>\n<li>Designing\u00a0a program of &#8220;theoretical and empirical research&#8221; that would lead to the identification of those elements<\/li>\n<li>Developing mathematical\u00a0frameworks for explaining moral reasoning<\/li>\n<li>Translating those frameworks into formal models of moral\u00a0reasoning<\/li>\n<li>&#8220;Verifying&#8221; the outputs of those models as truthful<\/li>\n<li>Embedding moral reasoning into\u00a0computer algorithms<\/li>\n<li>Using\u00a0those algorithms to control\u00a0a robot operating\u00a0autonomously in the world<\/li>\n<\/ul>\n<p>Barring the negotiation of a worldwide ban, which seems unlikely for all sorts of reasons,\u00a0military robots that make life-or-death decisions about human beings <a href=\"https:\/\/www.roughtype.com\/?p=3371\">are coming<\/a> (if they&#8217;re not already here). So efforts to program morality into robots are themselves now morally necessary. It&#8217;s highly unlikely, though, that the\u00a0efforts will\u00a0be successful \u2014 unless, that is, we choose to cheat on the definition of success.<\/p>\n<blockquote><p><span style=\"color: #2a2b2d;\">Selmer Bringsjord, head of the Cognitive Science Department at RPI, and Naveen Govindarajulu, post-doctoral researcher working with him, are focused on how to engineer ethics into a robot so that moral logic is intrinsic to these artificial beings. Since the scientific community has yet to establish what constitutes morality in humans the challenge for Bringsjord and his team is severe.<\/span><\/p><\/blockquote>\n<p>We&#8217;re trying to reverse-engineer something that wasn&#8217;t engineered in the first place.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The U.S. Navy&#8217;s Office of Naval Research is funding an effort, by scientists\u00a0at Tufts, Brown, and RPI, to develop military robots capable of moral reasoning: The ONR-funded project will first isolate essential elements of human moral competence through theoretical and empirical research. Based on the results, the team will develop formal frameworks for modeling human-level [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[13],"tags":[],"class_list":["post-4568","post","type-post","status-publish","format-standard","hentry","category-the-glass-cage"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.roughtype.com\/index.php?rest_route=\/wp\/v2\/posts\/4568","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.roughtype.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.roughtype.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.roughtype.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.roughtype.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4568"}],"version-history":[{"count":8,"href":"https:\/\/www.roughtype.com\/index.php?rest_route=\/wp\/v2\/posts\/4568\/revisions"}],"predecessor-version":[{"id":4577,"href":"https:\/\/www.roughtype.com\/index.php?rest_route=\/wp\/v2\/posts\/4568\/revisions\/4577"}],"wp:attachment":[{"href":"https:\/\/www.roughtype.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4568"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.roughtype.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4568"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.roughtype.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4568"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}