1 00:00:10,053 --> 00:00:18,017 [light piano music] 2 00:00:24,154 --> 00:00:26,808 [door creaks] 3 00:00:31,944 --> 00:00:32,727 [door clicks shut] 4 00:00:58,666 --> 00:01:03,106 Hey Siri, send a message to Cheryl. 5 00:01:03,149 --> 00:01:03,976 Front reception. 6 00:01:06,370 --> 00:01:07,066 [Siri] What do you want to say? 7 00:01:08,981 --> 00:01:11,723 Amos is already heading there to pick him up, period. 8 00:01:11,766 --> 00:01:13,899 Please forward any calls I get to Brady, period. 9 00:01:15,161 --> 00:01:16,945 [Siri] Your message to Cheryl front reception 10 00:01:16,989 --> 00:01:19,296 says Amos is already heading there to pick him up. 11 00:01:19,339 --> 00:01:20,949 Please forward any calls I get to Brady. 12 00:01:21,559 --> 00:01:22,342 Ready to send it? 13 00:01:22,821 --> 00:01:23,604 Yes. 14 00:01:24,953 --> 00:01:26,129 [Siri] Okay, it's sent. 15 00:01:28,000 --> 00:01:28,870 Hey, Siri, 16 00:01:31,221 --> 00:01:33,048 how do you know if you're doing the right thing? 17 00:01:35,225 --> 00:01:36,400 [Siri] I'm not sure I understand. 18 00:01:40,578 --> 00:01:41,709 But what do you believe 19 00:01:41,753 --> 00:01:43,450 is the difference between right and wrong? 20 00:01:45,583 --> 00:01:46,801 [Siri] Hmm. 21 00:01:46,845 --> 00:01:48,151 I don't have an answer for that. 22 00:01:48,673 --> 00:01:50,022 Would you like me to search the web? 23 00:01:51,066 --> 00:01:51,806 No. 24 00:01:53,286 --> 00:01:55,332 [Siri] Okay, is there something else I can help with? 25 00:02:04,906 --> 00:02:06,473 Set a reminder to pick up Kyle 26 00:02:06,517 --> 00:02:08,693 from therapy tomorrow at 4:45. 27 00:02:10,651 --> 00:02:12,175 [Siri] Okay, I'll remind you. 28 00:02:31,759 --> 00:02:33,152 [door creaks] 29 00:02:34,066 --> 00:02:36,373 Hi, special agent Deena Helms. 30 00:02:36,416 --> 00:02:37,461 You've already met Agent McCullough. 31 00:02:37,504 --> 00:02:38,897 You can call me Amos. 32 00:02:38,940 --> 00:02:41,682 -Uh, agents? -Have a seat for us, Gareth. 33 00:02:44,381 --> 00:02:45,817 Do you mind answering a couple questions? 34 00:02:47,384 --> 00:02:49,473 Great, this shouldn't take long. 35 00:02:51,431 --> 00:02:53,607 You're from Tampa, right? 36 00:02:56,219 --> 00:02:57,611 Don't overthink it. It's a yes or no. 37 00:02:59,047 --> 00:03:00,266 Yeah. 38 00:03:00,310 --> 00:03:01,659 How old are you, Gareth? 39 00:03:01,702 --> 00:03:02,573 29. 40 00:03:02,616 --> 00:03:04,227 What do you do for work? 41 00:03:04,270 --> 00:03:05,576 I'm sorry, am I being detained? 42 00:03:05,619 --> 00:03:06,881 No, not at all. 43 00:03:06,925 --> 00:03:08,796 We're just asking questions, background stuff. 44 00:03:10,015 --> 00:03:11,190 You work on movies, right? 45 00:03:12,104 --> 00:03:12,931 Special effects. 46 00:03:14,367 --> 00:03:15,673 Someone told me you worked 47 00:03:15,716 --> 00:03:17,196 on that new "Star Wars" movie, is that right? 48 00:03:17,240 --> 00:03:18,502 [Gareth] Who told you that? 49 00:03:18,545 --> 00:03:20,330 Why don't you tell us more about it? 50 00:03:20,373 --> 00:03:21,331 Tell us about your work. 51 00:03:23,898 --> 00:03:25,813 I used to do VFX for an animation company. 52 00:03:25,857 --> 00:03:26,901 I've worked on at least 20 different films. 53 00:03:26,945 --> 00:03:28,207 Used to? 54 00:03:28,251 --> 00:03:29,513 I've been focusing more 55 00:03:29,556 --> 00:03:30,731 on software engineering recently for years- 56 00:03:30,775 --> 00:03:32,429 Sounds boring compared to light sabers. 57 00:03:32,472 --> 00:03:33,691 Why quit? 58 00:03:33,734 --> 00:03:34,822 [Gareth] I wasn't getting paid well. 59 00:03:34,866 --> 00:03:36,128 But money's not an issue for you. 60 00:03:36,171 --> 00:03:37,347 Excuse me? 61 00:03:37,390 --> 00:03:38,261 [Deena] What kind of effects did you do? 62 00:03:38,304 --> 00:03:39,653 Money's not an issue for me? 63 00:03:39,697 --> 00:03:40,872 -Let's talk about- -If money wasn't an issue for me 64 00:03:40,915 --> 00:03:41,960 I wouldn't have applied for your grant. 65 00:03:42,003 --> 00:03:42,656 I didn't mean to suggest anything. 66 00:03:44,005 --> 00:03:45,268 Tell us what kind of effects you did. 67 00:03:48,619 --> 00:03:50,185 My main focus was on 3D renderings. 68 00:03:50,229 --> 00:03:51,317 [Deena] Of what? 69 00:03:51,361 --> 00:03:52,318 -Actors. -What for? 70 00:03:53,101 --> 00:03:54,364 Well, for "Star Wars," 71 00:03:54,407 --> 00:03:55,887 it was because the actor I was tasked to digitize 72 00:03:55,930 --> 00:03:57,323 was unavailable to be filmed in person. 73 00:03:58,063 --> 00:03:58,585 Why? 74 00:04:00,108 --> 00:04:00,935 Because they were dead. 75 00:04:02,937 --> 00:04:03,808 What'd they have you do? 76 00:04:05,984 --> 00:04:08,160 I reconstructed Alec Guinness' face as a 3D model. 77 00:04:08,203 --> 00:04:09,770 I analyzed reference footage, 78 00:04:09,814 --> 00:04:11,642 then used a process called D-Term to procedurally generate 79 00:04:11,685 --> 00:04:12,904 his bone and muscle structures, 80 00:04:12,947 --> 00:04:14,297 which one rigged helped the animation feel 81 00:04:14,340 --> 00:04:15,602 more natural and human-like. 82 00:04:15,646 --> 00:04:17,822 D-Term, I've never heard of that process before. 83 00:04:17,865 --> 00:04:18,953 Because I invented it. 84 00:04:19,302 --> 00:04:20,215 [Deena] So you're basically bringing 85 00:04:20,259 --> 00:04:21,521 dead actors back to life? 86 00:04:21,565 --> 00:04:23,001 I just tried to make the CG characters look as 87 00:04:23,044 --> 00:04:24,655 photorealistic as the technology at the time would allow. 88 00:04:24,698 --> 00:04:25,569 [Deena] You didn't find it creepy? 89 00:04:26,613 --> 00:04:27,397 I'm sorry, what? 90 00:04:28,441 --> 00:04:29,399 I said you don't find that creepy? 91 00:04:32,053 --> 00:04:34,447 Well, we did our best to cross the uncanny valley. 92 00:04:34,491 --> 00:04:36,057 But when the human brain perceives 93 00:04:36,101 --> 00:04:37,320 that something is just slightly off and it doesn't matter- 94 00:04:37,363 --> 00:04:38,364 No, I mean, digitizing dead people. 95 00:04:38,408 --> 00:04:39,539 Christ, I mean, it's, 96 00:04:39,583 --> 00:04:40,932 it's almost like turning someone's corpse 97 00:04:40,975 --> 00:04:42,107 into a marionette, you know? 98 00:04:42,150 --> 00:04:43,326 Making them do whatever you want. 99 00:04:43,935 --> 00:04:45,153 What if the poor dead guy 100 00:04:45,197 --> 00:04:46,633 didn't want to be in another fucking movie? 101 00:04:47,460 --> 00:04:48,287 It's so macabre. 102 00:04:48,853 --> 00:04:49,941 Am I crazy? Is it not macabre? 103 00:04:49,984 --> 00:04:51,072 I don't think the studio cares 104 00:04:51,116 --> 00:04:52,247 whether it's macabre or not. 105 00:04:52,291 --> 00:04:53,466 Look, I can never tell the difference. 106 00:04:53,510 --> 00:04:55,033 I always can. The faces look like Play-Doh. 107 00:04:55,076 --> 00:04:56,208 Well, we did our best. 108 00:04:56,251 --> 00:04:57,383 Soon we won't even need actors,right? 109 00:04:57,427 --> 00:04:58,732 Everyone will just be digital. 110 00:04:58,776 --> 00:05:00,430 No, you still need them for motion tracking. 111 00:05:00,473 --> 00:05:02,475 Human performances can't be completely computer generated. 112 00:05:02,519 --> 00:05:03,563 How long will that be true? 113 00:05:07,741 --> 00:05:09,613 Some might say we've already crossed that threshold. 114 00:05:11,441 --> 00:05:12,355 I wouldn't know. 115 00:05:15,445 --> 00:05:16,663 Where'd you go to school? 116 00:05:16,707 --> 00:05:18,317 -Brooks-DeBartolo High. -And after? 117 00:05:20,188 --> 00:05:21,451 Nothing? 118 00:05:21,494 --> 00:05:22,365 What about Columbia? 119 00:05:22,408 --> 00:05:23,322 Didn't you go to Columbia? 120 00:05:25,672 --> 00:05:27,152 Wait, no. You dropped out of Columbia 121 00:05:27,195 --> 00:05:29,459 after how many semesters? 122 00:05:30,024 --> 00:05:30,808 Three? 123 00:05:33,114 --> 00:05:35,987 Bjarne Stroustrup said 124 00:05:36,030 --> 00:05:37,205 you were the smartest kid he ever met. 125 00:05:38,729 --> 00:05:41,427 I don't know who he is, but Amos says it's a big deal. 126 00:05:42,733 --> 00:05:43,777 Then you moved to the Netherlands, 127 00:05:44,561 --> 00:05:46,084 spent some time as an intern, 128 00:05:46,824 --> 00:05:48,042 applied and got into Cambridge. 129 00:05:48,782 --> 00:05:50,044 Very nice. 130 00:05:50,088 --> 00:05:51,350 Except that you dropped out after two years. 131 00:05:52,438 --> 00:05:53,613 Flew back to the States, 132 00:05:53,657 --> 00:05:56,050 interned in Palo Alto, then Montreal. 133 00:05:56,399 --> 00:05:57,661 Then went all the way back to England, 134 00:05:57,704 --> 00:05:59,184 where you landed a job in Sheffield. 135 00:05:59,227 --> 00:06:00,925 Second job in Manchester. 136 00:06:01,491 --> 00:06:04,189 Then got into Oxford where you almost finished your masters 137 00:06:04,232 --> 00:06:05,451 before ditching the graduation 138 00:06:05,495 --> 00:06:06,974 and moving back here to Florida. 139 00:06:11,675 --> 00:06:12,806 If money was an issue, 140 00:06:14,678 --> 00:06:16,419 I'm glad you had plenty of flyer miles. 141 00:06:18,508 --> 00:06:19,683 I didn't hear a question. 142 00:06:20,858 --> 00:06:21,641 What's your social life like? 143 00:06:22,860 --> 00:06:24,644 My, what does that have anything to do- 144 00:06:24,688 --> 00:06:26,124 If you don't want to talk about it, that's fine. 145 00:06:26,167 --> 00:06:27,430 We just wanted to know if you have friends and stuff. 146 00:06:27,473 --> 00:06:29,040 -I have friends. -A lot of them? 147 00:06:29,083 --> 00:06:30,302 -I have friends. -Can you name one? 148 00:06:30,345 --> 00:06:31,477 -Can I what? -[Deena] Can you tell us the nam 149 00:06:31,521 --> 00:06:32,609 of just one of your friends? 150 00:06:33,566 --> 00:06:35,655 -Steve. -[Deena] Steve. Steve what? 151 00:06:35,699 --> 00:06:37,004 I don't know how this is relevant to receiving the grant. 152 00:06:37,048 --> 00:06:38,397 Oh, we're just getting to know you, Gareth. 153 00:06:39,442 --> 00:06:40,355 You got a girlfriend? 154 00:06:40,965 --> 00:06:41,792 Boyfriend? 155 00:06:42,532 --> 00:06:44,316 You, uh, talk to people online? 156 00:06:44,359 --> 00:06:45,448 I don't know what you mean by that. 157 00:06:45,491 --> 00:06:46,753 I don't use social media. 158 00:06:46,797 --> 00:06:47,885 I mean more like chat rooms. 159 00:06:52,759 --> 00:06:54,065 You go on any chat rooms? 160 00:06:58,939 --> 00:07:00,288 No one uses chat rooms anymore. 161 00:07:01,028 --> 00:07:01,681 [Deena] Sure they do. 162 00:07:03,814 --> 00:07:04,815 You chat with anyone online? 163 00:07:07,557 --> 00:07:08,732 -Sometimes. -[Deena] Sometimes. 164 00:07:10,255 --> 00:07:11,996 What kinds of people do you talk to online? 165 00:07:14,128 --> 00:07:18,219 Gareth, obviously, this isn't about a grant. 166 00:07:19,438 --> 00:07:20,613 We need to know what your alias is. 167 00:07:22,180 --> 00:07:24,095 When you go online, what name do you use? 168 00:07:24,138 --> 00:07:25,357 I don't have one. 169 00:07:25,400 --> 00:07:26,184 [Deena] Yes, you do. 170 00:07:27,228 --> 00:07:28,012 And you need to tell us what it is. 171 00:07:33,844 --> 00:07:34,932 Sorry, I can't help you. 172 00:07:45,856 --> 00:07:46,900 [Deena] You know who we are? 173 00:07:48,989 --> 00:07:50,643 Well, this is the ICWL building. 174 00:07:50,687 --> 00:07:52,079 That's right. You know what we do? 175 00:07:53,472 --> 00:07:54,604 [Gareth] Humanitarian work. 176 00:07:54,647 --> 00:07:55,822 That's what the people upstairs do. 177 00:07:56,170 --> 00:07:57,432 You know what we do? 178 00:08:02,350 --> 00:08:03,787 We catch pedophiles. 179 00:08:06,050 --> 00:08:09,401 Amos here specializes in tracking down online predators. 180 00:08:09,444 --> 00:08:11,403 He spends every waking hour 181 00:08:11,446 --> 00:08:14,058 scouring those chat rooms you say no one uses 182 00:08:14,101 --> 00:08:16,713 and he finds thousands of people soliciting children. 183 00:08:17,801 --> 00:08:20,543 Our operation is like a tightly spun spider web 184 00:08:20,891 --> 00:08:23,676 connecting ICWL, the FBI, NSA, 185 00:08:23,720 --> 00:08:26,331 and let me tell you, his team here is a vital thread. 186 00:08:27,332 --> 00:08:30,074 He reports everything he gathers directly to me, 187 00:08:30,117 --> 00:08:32,250 and I see to it that the necessary authorities 188 00:08:32,293 --> 00:08:33,425 take swift action. 189 00:08:33,817 --> 00:08:34,861 So are you in charge? 190 00:08:35,383 --> 00:08:36,907 This is my spiderweb. 191 00:08:38,648 --> 00:08:40,475 I'm the fucking spider, Gareth. 192 00:08:44,392 --> 00:08:47,004 Am I being detained? 193 00:08:47,874 --> 00:08:49,006 [Deena] We already told you that you're not detained. 194 00:08:49,441 --> 00:08:50,877 Good. [chair scrapes] 195 00:08:52,096 --> 00:08:54,098 But if you leave this room, you will be arrested. 196 00:09:00,495 --> 00:09:01,453 [Gareth] For what? 197 00:09:04,108 --> 00:09:05,022 I told you what we do. 198 00:09:05,675 --> 00:09:06,589 Take a wild guess. 199 00:09:08,678 --> 00:09:10,201 [Gareth] I am not what you think I am. 200 00:09:10,462 --> 00:09:11,245 We'll see. 201 00:09:13,900 --> 00:09:15,598 Gareth, you just gotta tell us your alias. 202 00:09:16,642 --> 00:09:18,252 What's your username? 203 00:09:22,648 --> 00:09:23,431 Sit down. 204 00:09:39,752 --> 00:09:41,232 -Why do you do this with them? -[Deena] Hmm? 205 00:09:41,275 --> 00:09:42,886 There's no way you do this with every suspect you have. 206 00:09:43,364 --> 00:09:44,496 Invite them to your headquarters 207 00:09:44,539 --> 00:09:45,628 and then drag them down into a basement. 208 00:09:46,063 --> 00:09:46,629 [Deena] That's right. 209 00:09:47,717 --> 00:09:49,109 Why are you doing this to me then? 210 00:09:51,242 --> 00:09:52,635 You tell us, Gare. 211 00:09:52,678 --> 00:09:54,027 What makes you so fuckin' special? 212 00:09:56,595 --> 00:09:57,465 I don't know. 213 00:09:59,206 --> 00:10:00,773 What's your alias? 214 00:10:00,817 --> 00:10:03,646 -I don't have an alias. -Yes you do. 215 00:10:05,386 --> 00:10:06,561 It starts with the word hard. 216 00:10:08,215 --> 00:10:09,390 Just finish the rest. 217 00:10:11,741 --> 00:10:12,959 Sit down, Mr. Federson. 218 00:10:13,003 --> 00:10:14,526 I only have a few more questions. 219 00:10:27,321 --> 00:10:28,845 Do you recognize this girl? 220 00:10:37,723 --> 00:10:41,379 Do you know her? 221 00:10:44,338 --> 00:10:45,209 Yes. 222 00:10:45,252 --> 00:10:46,123 [Deena] What's her name? 223 00:10:47,124 --> 00:10:48,603 Cherry. 224 00:10:48,647 --> 00:10:50,301 -[Deena] Cherry what? -She doesn't have a last name. 225 00:10:50,344 --> 00:10:51,824 Yes, she does, Gareth, she's not Madonna. 226 00:10:51,868 --> 00:10:53,347 -She's a little girl. -You don't understand. 227 00:10:53,391 --> 00:10:54,479 Yeah, well, I'd like to. 228 00:10:54,522 --> 00:10:55,567 So help me out, is she your daughter? 229 00:10:55,610 --> 00:10:57,482 -No. -Then whose daughter is she? 230 00:10:57,525 --> 00:10:58,570 -She, she doesn't have-- -How did you meet her? 231 00:10:58,613 --> 00:11:00,006 I didn't meet her. 232 00:11:00,050 --> 00:11:01,704 Then why do you have photos of her on your computer? 233 00:11:01,747 --> 00:11:02,661 What the hell are you talking about? 234 00:11:02,705 --> 00:11:04,445 Why do you fucking have photos 235 00:11:04,489 --> 00:11:05,751 of this girl on your fucking- 236 00:11:05,795 --> 00:11:06,883 Are you looking at my hard drive? 237 00:11:06,926 --> 00:11:08,145 Because that's an invasion of privacy. 238 00:11:08,188 --> 00:11:09,450 So you know what photos I'm talking about? 239 00:11:09,494 --> 00:11:10,364 You don't have to do it this way. 240 00:11:10,408 --> 00:11:11,626 I gave you permission to sit in. 241 00:11:11,670 --> 00:11:13,672 I did not give you permission to speak. 242 00:11:13,716 --> 00:11:14,804 [Gareth] This is insane, you cannot keep- 243 00:11:14,847 --> 00:11:16,066 What else have you done with her? 244 00:11:16,109 --> 00:11:17,415 -[Gareth] Nothing! -Did you take the photos? 245 00:11:17,458 --> 00:11:18,329 It's, it's complicated. 246 00:11:18,372 --> 00:11:19,809 [Deena] No, it's not! Yes or no? 247 00:11:19,852 --> 00:11:20,897 Did you take the photos? 248 00:11:20,940 --> 00:11:22,768 I didn't do anything wrong, okay? 249 00:11:22,812 --> 00:11:25,815 Soliciting pornography of minors is an egregious felony. 250 00:11:25,858 --> 00:11:28,774 Distributing that pornography is tenfold worse. 251 00:11:28,818 --> 00:11:30,689 -I didn't do anything! -Fucking prove it! 252 00:11:31,168 --> 00:11:33,605 What is your alias? 253 00:11:34,649 --> 00:11:35,955 Answer me! 254 00:11:35,999 --> 00:11:37,652 HardMachine11811. 255 00:11:39,567 --> 00:11:42,222 [Gareth exhales] 256 00:11:56,149 --> 00:11:57,281 You're HardMachine. 257 00:11:59,457 --> 00:12:00,675 Thanks for confirming. 258 00:12:03,330 --> 00:12:05,811 If you knew, then why do this to me? 259 00:12:05,855 --> 00:12:07,117 [Deena] We weren't positive, 260 00:12:07,160 --> 00:12:08,466 and if you turned out to not be HardMachine, 261 00:12:08,509 --> 00:12:09,772 you were obviously just a predator. 262 00:12:15,125 --> 00:12:16,169 Do you keep track? 263 00:12:18,041 --> 00:12:20,608 I mean, do you know how many bad people you've nailed? 264 00:12:21,218 --> 00:12:23,089 [Gareth] I didn't start counting until 2023. 265 00:12:23,133 --> 00:12:25,570 196 convictions. 266 00:12:25,613 --> 00:12:26,876 [Gareth] There were at least 30 267 00:12:26,919 --> 00:12:27,790 before I started sending everything to you guys. 268 00:12:28,529 --> 00:12:29,443 What'd you do before? 269 00:12:29,879 --> 00:12:30,967 [Gareth] I turned over 270 00:12:31,010 --> 00:12:31,968 all evidence directly to the police. 271 00:12:32,011 --> 00:12:32,838 [Deena] Why'd you stop? 272 00:12:33,230 --> 00:12:34,057 They were unreliable. 273 00:12:35,362 --> 00:12:36,711 -I doubt that. -More than half of the predators 274 00:12:36,755 --> 00:12:38,061 I identified went un-investigated. 275 00:12:38,104 --> 00:12:39,714 Yeah, well, you were sketchy and faceless. 276 00:12:39,758 --> 00:12:41,064 They had every right to be skeptical. 277 00:12:41,978 --> 00:12:43,457 It would've all been for nothing 278 00:12:43,501 --> 00:12:44,937 if they found out you were using a little girl as bait. 279 00:12:44,981 --> 00:12:46,156 It's not that simple, okay? 280 00:12:46,199 --> 00:12:48,811 I can only do what I do with anonymity. 281 00:12:48,854 --> 00:12:50,813 Here's my problem, Gareth, and don't get me wrong. 282 00:12:50,856 --> 00:12:52,553 I think 200 terrible people behind bars 283 00:12:52,597 --> 00:12:54,686 is a very good thing, but not at her expense. 284 00:12:55,600 --> 00:12:57,080 Look, we think we can help you, 285 00:12:57,776 --> 00:12:59,212 but we need to help her too. 286 00:12:59,256 --> 00:13:02,520 Using your daughter to entrap these people 287 00:13:02,563 --> 00:13:03,651 is a means that does not justify the ends. 288 00:13:03,695 --> 00:13:05,044 She's not my daughter. 289 00:13:05,088 --> 00:13:06,437 And in spite of what you may think you've achieved, 290 00:13:06,480 --> 00:13:07,612 I still have no reservation with locking you up. 291 00:13:07,655 --> 00:13:08,569 You took the photos. 292 00:13:09,048 --> 00:13:09,919 I don't care why. 293 00:13:10,267 --> 00:13:11,311 You don't understand. 294 00:13:12,051 --> 00:13:13,139 Who is she? 295 00:13:13,183 --> 00:13:14,837 You're gonna ruin everything. 296 00:13:14,880 --> 00:13:17,578 She's a child, Gareth, look at me. 297 00:13:19,363 --> 00:13:22,845 I don't give a damn what fucked up anti-hero master plan 298 00:13:22,888 --> 00:13:23,802 of yours I might jeopardize. 299 00:13:24,411 --> 00:13:26,022 I won't let her be exploited. 300 00:13:26,065 --> 00:13:27,806 Not even for the sake of locking up more perverts. 301 00:13:29,329 --> 00:13:31,418 I'm asking you politely to let this one go. 302 00:13:32,376 --> 00:13:33,594 Are you fucking slow? 303 00:13:33,943 --> 00:13:35,074 Have you been listening at all? 304 00:13:35,118 --> 00:13:37,642 My anonymity is my most important asset. 305 00:13:37,685 --> 00:13:39,296 Without that, I can't do what I do. 306 00:13:39,339 --> 00:13:40,906 Well, that makes everything easy then. 307 00:13:42,429 --> 00:13:44,649 You tell us where she is, or we leak everything. 308 00:13:44,692 --> 00:13:46,172 -Your name, your aliases. -Deena! 309 00:13:46,216 --> 00:13:48,261 Every single perp you helped us catch. 310 00:13:48,305 --> 00:13:50,176 I'm sure they'll be very pleased to meet you in jail. 311 00:13:50,220 --> 00:13:51,395 Stop! 312 00:13:51,438 --> 00:13:52,135 Okay. 313 00:13:55,878 --> 00:13:56,879 Look, if I tell you about Cherry, okay, 314 00:13:58,097 --> 00:13:59,098 there's some things I'm gonna need first. 315 00:14:00,665 --> 00:14:02,232 It doesn't really work like that, Gareth, but go ahead. 316 00:14:02,275 --> 00:14:03,842 Give us your wishlist. 317 00:14:03,886 --> 00:14:05,365 I need a signed non-disclosure agreement from both of you. 318 00:14:05,409 --> 00:14:06,671 -Not gonna happen. -And then I need you to swear 319 00:14:06,714 --> 00:14:07,846 that the information I'm about to relay 320 00:14:07,890 --> 00:14:08,803 won't leave this room. 321 00:14:09,239 --> 00:14:10,588 Look, if you tell us anything 322 00:14:10,631 --> 00:14:11,763 that could help us locate Cherry, 323 00:14:11,806 --> 00:14:13,634 you know we can't keep that promise. 324 00:14:15,375 --> 00:14:16,942 Okay, if I tell you anything 325 00:14:16,986 --> 00:14:19,553 that potentially helps you find a missing child, 326 00:14:19,814 --> 00:14:20,815 okay, you can feel free to share that. 327 00:14:20,859 --> 00:14:22,078 But I need you to swear 328 00:14:22,121 --> 00:14:24,515 that any other details about myself or Cherry, 329 00:14:25,995 --> 00:14:27,170 have to stay between the three of us. 330 00:14:29,433 --> 00:14:30,216 Is that it? 331 00:14:32,740 --> 00:14:33,785 And I need that camera switched off. 332 00:14:35,961 --> 00:14:37,006 [Deena] I don't know how to do that. 333 00:14:37,049 --> 00:14:38,616 Go to the head of securities office, 334 00:14:38,659 --> 00:14:39,965 ask him to find this camera in the system and disable it. 335 00:14:40,879 --> 00:14:41,967 I don't think he's allowed to do that. 336 00:14:43,490 --> 00:14:44,665 I thought you were the fucking spider? 337 00:14:49,235 --> 00:14:50,628 Give me a reason, Gareth. 338 00:14:50,671 --> 00:14:51,803 Why should I go through all the trouble 339 00:14:51,846 --> 00:14:52,978 of getting that camera turned off? 340 00:14:54,893 --> 00:14:56,851 Because if anybody finds out what I'm about to tell you, 341 00:14:58,766 --> 00:15:00,594 a thousand more children are gonna get abused. 342 00:15:04,642 --> 00:15:05,425 Give me a minute. 343 00:15:12,302 --> 00:15:12,867 [door clicks shut] 344 00:15:21,050 --> 00:15:26,446 So, uh, you and Cherry hunted all those people together? 345 00:15:34,063 --> 00:15:37,022 This one time I spent six weeks undercover trying 346 00:15:37,066 --> 00:15:39,242 to nail down a single trafficker from the Philippines. 347 00:15:41,113 --> 00:15:42,549 Day after day, 348 00:15:42,593 --> 00:15:45,726 I spent hour after hour following his trail online. 349 00:15:45,770 --> 00:15:47,206 And he must have been 350 00:15:47,250 --> 00:15:48,991 one of the hardest targets I ever had to track down. 351 00:15:52,081 --> 00:15:56,650 Then one day I found him and one of Cherry's live streams. 352 00:15:57,303 --> 00:15:59,131 I mean, she went by a different name in the stream, 353 00:15:59,175 --> 00:16:00,698 but it was her. 354 00:16:02,091 --> 00:16:03,222 The trafficker, 355 00:16:03,266 --> 00:16:04,571 along with three of our other targets 356 00:16:04,615 --> 00:16:06,617 were all in the room together. 357 00:16:06,660 --> 00:16:12,144 All of them just carelessly sharing their information. 358 00:16:13,841 --> 00:16:18,585 I mean, and they were so open 'cause she was a real girl. 359 00:16:18,890 --> 00:16:20,544 I mean, she could physically 360 00:16:20,587 --> 00:16:22,763 and verbally respond to them in real time. 361 00:16:26,202 --> 00:16:32,077 A couple days later, HardMachine11811 sends ICWL 362 00:16:32,121 --> 00:16:33,948 another batch of names and evidence, 363 00:16:33,992 --> 00:16:37,039 including the three targets that were in the room. 364 00:16:39,084 --> 00:16:42,044 You know, I almost thought the girl was HardMachine 365 00:16:42,740 --> 00:16:44,394 and that this nine year old 366 00:16:44,437 --> 00:16:47,745 just happened to be some badass online vigilante. 367 00:16:50,226 --> 00:16:51,357 What changed your mind? 368 00:16:55,013 --> 00:16:56,406 11811. 369 00:16:57,798 --> 00:17:00,366 January 18th, 2011. 370 00:17:01,367 --> 00:17:05,197 Most of my team thought it was, uh, some arbitrary number, 371 00:17:06,720 --> 00:17:10,159 but I remember what happened on that day in Clearwater. 372 00:17:13,205 --> 00:17:15,077 You were one of the Clearwater kids, weren't you? 373 00:17:16,817 --> 00:17:19,820 You know, my father was a part of that raid. 374 00:17:19,864 --> 00:17:21,779 [door opens] 375 00:17:22,519 --> 00:17:23,563 [Deena] It's off, see? 376 00:17:23,607 --> 00:17:24,260 No red light. 377 00:17:25,130 --> 00:17:26,218 Non-disclosure agreements? 378 00:17:26,262 --> 00:17:27,654 We're not playing this game, Gareth. 379 00:17:27,698 --> 00:17:29,091 You're just gonna have to suck it up and trust us. 380 00:17:33,704 --> 00:17:35,271 You can trust us. 381 00:17:38,274 --> 00:17:39,710 I've been told I have trust issues. 382 00:17:39,971 --> 00:17:41,799 [Deena] Well, there's only one way to fix that. 383 00:17:50,634 --> 00:17:52,375 The reason you can't find Cherry, 384 00:17:53,376 --> 00:17:56,292 the reason why she doesn't have a last name or parents, 385 00:17:56,553 --> 00:18:01,253 or a social security number is because she's not real. 386 00:18:03,386 --> 00:18:04,648 She's not a real human being. 387 00:18:08,826 --> 00:18:09,827 Tell us what happened. 388 00:18:14,266 --> 00:18:15,659 While I was studying abroad, 389 00:18:15,920 --> 00:18:17,704 I interned at a small Dutch animation studio 390 00:18:18,575 --> 00:18:20,011 a few years before they collaborated 391 00:18:20,054 --> 00:18:21,578 with a local nonprofit on a similar idea. 392 00:18:22,448 --> 00:18:23,145 [Deena] Which was? 393 00:18:24,494 --> 00:18:26,191 The idea was to build a 3D model 394 00:18:26,235 --> 00:18:27,540 of an 11 year old Filipino girl 395 00:18:28,062 --> 00:18:30,543 and use her covertly to identify online predators, 396 00:18:30,978 --> 00:18:33,024 A technological solution to a technological problem. 397 00:18:33,938 --> 00:18:35,722 But the project was suspended after only a few months. 398 00:18:35,766 --> 00:18:36,897 Yeah, I remember. 399 00:18:36,941 --> 00:18:38,072 I remember hearing about that program. 400 00:18:38,682 --> 00:18:39,683 Is that what inspired you? 401 00:18:41,119 --> 00:18:42,120 As I got better at crafting photorealistic faces, 402 00:18:42,164 --> 00:18:43,643 I decided to work on one myself. 403 00:18:43,687 --> 00:18:44,470 [Deena] Why? 404 00:18:45,732 --> 00:18:47,908 It was too effective of an idea to let die. 405 00:18:47,952 --> 00:18:49,606 Hundreds of thousands of children are at risk. 406 00:18:50,259 --> 00:18:51,085 I had to make her. 407 00:18:51,303 --> 00:18:52,652 Who is she modeled after? 408 00:18:52,696 --> 00:18:53,392 [Gareth] No one, I built her from scratch. 409 00:18:53,827 --> 00:18:55,264 Scratch? 410 00:18:55,307 --> 00:18:57,353 I started with a skull, designed her bone structure, 411 00:18:57,396 --> 00:18:59,093 worked upwards through muscles and tissue, 412 00:18:59,137 --> 00:19:00,965 used the D-Term program to fill in the rest procedurally. 413 00:19:01,008 --> 00:19:04,229 Eventually she came to look like that. 414 00:19:04,795 --> 00:19:06,710 A completely unique, completely digital model. 415 00:19:07,363 --> 00:19:08,538 I rigged her face and body 416 00:19:08,581 --> 00:19:09,539 the way you would for any CG character. 417 00:19:09,582 --> 00:19:10,757 Then for three years, 418 00:19:12,237 --> 00:19:13,064 I used motion tracking to puppeteer her in real time. 419 00:19:14,631 --> 00:19:15,327 You gotta understand that the video chats on those sites 420 00:19:15,371 --> 00:19:16,633 have such low resolution 421 00:19:16,676 --> 00:19:17,721 that even in her earliest stage of this, she, 422 00:19:18,504 --> 00:19:21,333 we appeared completely authentic. 423 00:19:22,726 --> 00:19:23,727 And what about voice? 424 00:19:25,076 --> 00:19:26,643 For most of her first year, she had to be mute. 425 00:19:26,686 --> 00:19:28,253 But eventually I found a decent voice filter with no lag. 426 00:19:28,297 --> 00:19:29,602 And after a few tweaks and adjustments, 427 00:19:29,646 --> 00:19:31,300 it's been the same voice ever since. 428 00:19:31,952 --> 00:19:33,824 I, I, I thought initially, 429 00:19:33,867 --> 00:19:36,043 my performance was going to be too unnatural. 430 00:19:36,087 --> 00:19:39,960 But with just one week of occasional video chat sessions, 431 00:19:40,874 --> 00:19:42,441 I secured six different names, 432 00:19:42,833 --> 00:19:44,574 mailing addresses, proofs of solicitations. 433 00:19:46,053 --> 00:19:47,011 Cherry worked. 434 00:19:47,054 --> 00:19:48,839 So the photos on your computer? 435 00:19:48,882 --> 00:19:50,797 -[Gareth] Completely fake. -It was the only way 436 00:19:50,841 --> 00:19:52,234 some of them disclosed personal information. 437 00:19:52,277 --> 00:19:54,758 But it was all zeros and ones, all digital, right? 438 00:19:54,801 --> 00:19:56,455 -There's no real child. -No real child. 439 00:19:56,803 --> 00:19:58,327 Just a highly detailed computer model. 440 00:19:58,718 --> 00:19:59,806 And let me be clear about something, 441 00:20:01,112 --> 00:20:02,113 I derive no pleasure from doing any of this. 442 00:20:02,156 --> 00:20:03,506 I've been asexual my entire life. 443 00:20:03,549 --> 00:20:05,334 I, I don't even get a sense of satisfaction 444 00:20:05,377 --> 00:20:06,552 from seeing these people locked up. 445 00:20:08,075 --> 00:20:10,469 I just think kids deserve a life free of exploitation. 446 00:20:12,341 --> 00:20:15,257 Incredible, all this time. 447 00:20:16,301 --> 00:20:17,563 I'm not gonna lie, Gareth. 448 00:20:17,607 --> 00:20:19,043 Cherry's done us a lot of good. 449 00:20:20,479 --> 00:20:21,785 You know, I still remember what you said to me 450 00:20:21,828 --> 00:20:22,960 the first time we corresponded. 451 00:20:24,091 --> 00:20:25,441 -You said- -We corresponded? 452 00:20:26,442 --> 00:20:27,269 Yeah, man. 453 00:20:27,965 --> 00:20:28,792 I'm Gord51. 454 00:20:30,315 --> 00:20:31,621 I'm the one here you've been sending all your intel to. 455 00:20:33,275 --> 00:20:34,058 You're Gord? 456 00:20:34,972 --> 00:20:36,016 [Amos] [chuckles] Yeah. 457 00:20:38,280 --> 00:20:38,932 You lied to me. 458 00:20:40,194 --> 00:20:42,109 You said I could stay anonymous. 459 00:20:42,153 --> 00:20:43,633 You said I would be safe. 460 00:20:45,374 --> 00:20:46,462 Now you've ruined everything. 461 00:20:47,680 --> 00:20:49,116 I, I didn't, I didn't have a choice. 462 00:20:49,160 --> 00:20:50,335 You don't have to worry about anything, Gareth. 463 00:20:50,379 --> 00:20:51,467 If Cherry isn't real, 464 00:20:51,510 --> 00:20:52,859 then you're not in any trouble with us. 465 00:20:54,426 --> 00:20:56,602 In fact, we've discussed ideas similar to this in the past, 466 00:20:56,950 --> 00:20:58,212 motion tracking and such. 467 00:20:58,256 --> 00:21:00,650 But we'd need a convincing model like Cherry. 468 00:21:00,693 --> 00:21:01,738 Cherry's more than a model. 469 00:21:01,781 --> 00:21:03,043 You want to help children? So do we. 470 00:21:03,087 --> 00:21:04,523 She's not for sale. 471 00:21:04,567 --> 00:21:05,959 Well, then just make us a new model based off of her. 472 00:21:06,003 --> 00:21:07,178 I can't. 473 00:21:07,221 --> 00:21:07,744 Sure you can. 474 00:21:08,222 --> 00:21:09,006 I won't. 475 00:21:12,314 --> 00:21:13,271 What are you not telling us? 476 00:21:15,882 --> 00:21:17,362 It's out on the table now. 477 00:21:17,406 --> 00:21:19,146 Might as well spill whatever it is you haven't already. 478 00:21:24,717 --> 00:21:26,545 You know what doesn't make sense? 479 00:21:28,155 --> 00:21:31,071 You said that you puppeteered her for only three years, 480 00:21:31,420 --> 00:21:33,552 but we've been getting info from you ever since. 481 00:21:35,337 --> 00:21:36,903 In fact, I'm pretty sure it was around then 482 00:21:36,947 --> 00:21:39,993 that we started seeing an impressive increase of names. 483 00:21:41,299 --> 00:21:43,083 So many in fact that we started thinking 484 00:21:44,476 --> 00:21:46,522 there's no way this is all coming from one source. 485 00:21:46,565 --> 00:21:47,784 I have friends that do mo-cap for me. 486 00:21:48,219 --> 00:21:50,613 Oh, friends, like Steve? 487 00:21:51,962 --> 00:21:53,572 I thought anonymity was your greatest asset. 488 00:21:56,445 --> 00:21:57,968 Cut the bullshit, Gareth. 489 00:21:59,578 --> 00:22:01,014 What happened to Cherry after three years? 490 00:22:07,847 --> 00:22:10,937 Okay, you said that she was more than a model. 491 00:22:11,808 --> 00:22:15,377 So what is she some type of conversational agent? 492 00:22:15,420 --> 00:22:17,466 Like a, like a chat bot? 493 00:22:17,814 --> 00:22:21,252 [chuckles] Chat bot. 494 00:22:25,909 --> 00:22:27,476 You know what happened after three years? 495 00:22:28,302 --> 00:22:29,260 My chosen mother died. 496 00:22:30,566 --> 00:22:31,741 What she left behind was enough to quit my job 497 00:22:31,784 --> 00:22:33,351 and pursue more resources and software. 498 00:22:33,960 --> 00:22:35,135 I'd already made a program 499 00:22:35,179 --> 00:22:36,572 that could procedurally generate faces, 500 00:22:36,615 --> 00:22:38,269 but what I wanted for Cherry was far more complex. 501 00:22:38,312 --> 00:22:40,227 So I got in touch with some researchers 502 00:22:40,271 --> 00:22:41,620 from Madrid who'd already built 503 00:22:41,664 --> 00:22:42,969 a predator hunting dialogue system of their own. 504 00:22:43,535 --> 00:22:45,581 It was trained to approach conversations as a game. 505 00:22:45,929 --> 00:22:47,539 Each sentence like a strategic volley, 506 00:22:47,583 --> 00:22:49,019 which is innovative but ultimately flawed. 507 00:22:49,062 --> 00:22:50,629 If you want your machine to master NLP, 508 00:22:50,673 --> 00:22:51,674 you have to break down game theory 509 00:22:51,717 --> 00:22:53,240 because language isn't tic-tac-toe. 510 00:22:53,284 --> 00:22:54,372 It's poetry. 511 00:22:54,416 --> 00:22:55,721 So yes, I got things started 512 00:22:55,765 --> 00:22:57,070 with a preexisting modified chat bot 513 00:22:57,114 --> 00:22:58,202 that I borrowed without permission 514 00:22:58,245 --> 00:22:59,246 from the University of Deusto. 515 00:23:04,774 --> 00:23:06,428 But that's not what Cherry is now. 516 00:23:10,083 --> 00:23:10,649 What is she, Gareth? 517 00:23:14,218 --> 00:23:15,741 She's one of the most complex 518 00:23:15,785 --> 00:23:17,787 and independently evolving AIs that's ever been created. 519 00:23:18,744 --> 00:23:20,006 [Amos] Artificial intelligence? 520 00:23:20,050 --> 00:23:21,573 She's already surpassed the narrow intelligence 521 00:23:21,617 --> 00:23:23,706 of IBM's smartest programs. 522 00:23:23,749 --> 00:23:26,709 She can have full conversations, up to 10 of them at a time, 523 00:23:27,013 --> 00:23:29,015 all while simultaneously strategizing 524 00:23:29,059 --> 00:23:31,409 the most efficient schedule to visit various chat rooms. 525 00:23:32,149 --> 00:23:34,368 She's perpetually studying YouTube videos of small children 526 00:23:34,630 --> 00:23:36,240 in order to adopt a growing library 527 00:23:36,283 --> 00:23:37,328 of mannerisms and movements 528 00:23:38,721 --> 00:23:39,591 which help keep her artificial personality dynamic. 529 00:23:40,810 --> 00:23:42,028 Her fastest response time is 0.4 seconds. 530 00:23:42,072 --> 00:23:43,160 And as of now, she has never, 531 00:23:43,552 --> 00:23:45,031 never been accused of being fake, 532 00:23:45,075 --> 00:23:46,468 which means she shattered the Turing test. 533 00:23:46,729 --> 00:23:48,295 All I do is occasionally update her 534 00:23:48,339 --> 00:23:49,514 and periodically check her data cleaning. 535 00:23:49,558 --> 00:23:50,384 Otherwise, 536 00:23:52,517 --> 00:23:53,779 she's completely on autopilot. 537 00:23:58,871 --> 00:24:00,264 Holy fucking shit. 538 00:24:04,660 --> 00:24:06,096 -How? -Six years she's been active. 539 00:24:06,139 --> 00:24:07,793 Every minute she's online, she's learning something. 540 00:24:07,837 --> 00:24:10,317 The more she learns, the more advanced she becomes. 541 00:24:10,361 --> 00:24:11,536 This means increased data generation, 542 00:24:11,580 --> 00:24:12,581 improved decision making, 543 00:24:12,624 --> 00:24:13,930 faster pattern and trend detection 544 00:24:13,973 --> 00:24:15,409 and complex problem solving. 545 00:24:15,453 --> 00:24:18,369 NLP, IR, machine learning to an unprecedented degree. 546 00:24:18,412 --> 00:24:19,762 She can teach herself anything 547 00:24:19,805 --> 00:24:21,198 she thinks will help efficiency and authenticity. 548 00:24:21,241 --> 00:24:22,634 She can currently speak four languages 549 00:24:24,288 --> 00:24:25,376 and by the end of this month, she'll have mastered a fifth. 550 00:24:25,419 --> 00:24:26,290 There's no way you could have pulled 551 00:24:26,333 --> 00:24:27,334 all this off on your own. 552 00:24:31,295 --> 00:24:32,078 You're right. 553 00:24:34,254 --> 00:24:35,386 Would you believe me if I told you 554 00:24:35,429 --> 00:24:38,345 it was somewhat of an accident? 555 00:24:40,434 --> 00:24:41,958 Look, if, if I'm being honest, 556 00:24:43,481 --> 00:24:44,917 I'm not entirely sure how I did it 557 00:24:46,528 --> 00:24:47,703 with the first year of coding 558 00:24:47,746 --> 00:24:48,921 and the second year of data training, 559 00:24:50,009 --> 00:24:52,751 I just pushed a wheel down a hill. 560 00:24:52,795 --> 00:24:54,492 It was like gravity did the rest. 561 00:24:55,537 --> 00:24:59,453 Her evolution became perpetual, exponentially so. 562 00:25:01,673 --> 00:25:04,720 The more time she was online, the faster she grew. 563 00:25:05,242 --> 00:25:06,635 You haven't shared this with anyone? 564 00:25:06,678 --> 00:25:09,812 Like I said, my anonymity is everything. 565 00:25:12,641 --> 00:25:13,555 What coding language? 566 00:25:14,512 --> 00:25:15,600 Standard C++. 567 00:25:15,905 --> 00:25:16,645 Does Brady know it? 568 00:25:20,039 --> 00:25:21,432 We'll sign non-disclosures for you, 569 00:25:22,651 --> 00:25:24,043 but I want to see the source code first. 570 00:25:24,087 --> 00:25:25,784 Out of the question. You just want to steal her. 571 00:25:25,828 --> 00:25:27,917 No, I want to see how we can make our own. 572 00:25:27,960 --> 00:25:29,222 You'll screw it up. 573 00:25:29,266 --> 00:25:30,615 Look, these, these predators and traffickers, 574 00:25:30,659 --> 00:25:32,138 they all talk to each other, okay? 575 00:25:32,182 --> 00:25:34,184 So much of Cherry's process is just bypassing the VPNs 576 00:25:34,227 --> 00:25:36,360 and making sure she doesn't double up in the same circles. 577 00:25:36,403 --> 00:25:37,753 The chat rooms begin to suspect 578 00:25:37,796 --> 00:25:39,232 that this technology is even possible, 579 00:25:39,276 --> 00:25:40,364 they'll find a way to circumvent that. 580 00:25:40,407 --> 00:25:41,713 We have to eliminate any margin of error. 581 00:25:41,757 --> 00:25:43,149 -Cherry agrees with me. -Cherry agrees? 582 00:25:43,193 --> 00:25:44,586 What the fuck does that- 583 00:25:44,629 --> 00:25:46,022 What I mean by that is that the data she's collected 584 00:25:46,065 --> 00:25:47,327 validates that perspective. 585 00:25:47,371 --> 00:25:48,459 What, do you have little chats with her over tea? 586 00:25:48,502 --> 00:25:50,461 You can converse with the program 587 00:25:50,504 --> 00:25:52,071 the same way you can talk to Alexa or Siri. 588 00:25:52,115 --> 00:25:53,551 It's built to be responsive. 589 00:25:53,595 --> 00:25:55,031 You can, you can even play chess with it if you want. 590 00:25:55,074 --> 00:25:56,119 You play chess with it? 591 00:25:56,162 --> 00:25:57,555 -That's not what I said. -Okay fine. 592 00:25:57,599 --> 00:25:58,730 If you won't show us the source code, 593 00:25:59,688 --> 00:26:00,645 then I want to meet Cherry. 594 00:26:04,170 --> 00:26:04,954 Right now? 595 00:26:06,042 --> 00:26:06,608 [Deena] Right now. 596 00:26:10,655 --> 00:26:11,700 And you'll both sign non-disclosures? 597 00:26:13,136 --> 00:26:13,919 Yes. 598 00:26:19,098 --> 00:26:19,621 Can I use that? 599 00:26:20,317 --> 00:26:21,100 Sure. 600 00:26:22,754 --> 00:26:23,581 [chair scrapes] 601 00:26:40,903 --> 00:26:43,166 Can we at least agree that he's off the chopping block? 602 00:26:43,427 --> 00:26:45,037 It worked, didn't it? 603 00:26:45,081 --> 00:26:46,343 We have one job, Amos, 604 00:26:47,779 --> 00:26:49,389 like the kids said, there's a technological problem. 605 00:26:49,433 --> 00:26:51,000 He found the technological solution, 606 00:26:51,043 --> 00:26:53,306 but problems evolve, so must solutions. 607 00:26:54,046 --> 00:26:55,700 I'm keeping an open mind here. 608 00:26:56,745 --> 00:26:57,659 Is that a good look for me? 609 00:26:58,485 --> 00:26:59,312 No. 610 00:27:03,665 --> 00:27:06,145 So you keep it all on that laptop? 611 00:27:06,189 --> 00:27:07,625 No, the Cherry program stays on a server I keep 612 00:27:07,669 --> 00:27:09,192 at in an undisclosed location. 613 00:27:09,235 --> 00:27:10,062 [Deena] Where is that? 614 00:27:10,323 --> 00:27:11,890 It's an undisclosed location. 615 00:27:11,934 --> 00:27:12,804 [Deena] Is it your place? 616 00:27:12,848 --> 00:27:14,501 Undisclosed location. 617 00:27:14,545 --> 00:27:15,459 [Deena] It's your place, isn't it? 618 00:27:15,502 --> 00:27:16,634 I can access it from any device 619 00:27:16,678 --> 00:27:18,157 as long as I have the encryption key. 620 00:27:20,507 --> 00:27:21,813 This will trigger a simple qubit algorithm 621 00:27:21,857 --> 00:27:23,859 that would otherwise be impossible to bypass. 622 00:27:23,902 --> 00:27:25,817 I find that outdated hardware is always more discreet 623 00:27:25,861 --> 00:27:27,340 and the more discreet, obviously the better. 624 00:27:31,388 --> 00:27:33,346 So she has two primary display modes, right? 625 00:27:33,390 --> 00:27:34,347 Development and performance. 626 00:27:34,391 --> 00:27:35,566 Performance being the default 627 00:27:35,609 --> 00:27:37,176 that the targets see during the chats. 628 00:27:37,220 --> 00:27:40,092 To them, she looks like this. 629 00:27:43,879 --> 00:27:45,228 [light instrumental music] 630 00:27:46,708 --> 00:27:47,491 [Cherry] Hey, what's up? 631 00:27:48,666 --> 00:27:49,798 It's one of over 40 greetings she has. 632 00:27:53,018 --> 00:27:54,280 I don't think I've met you yet. 633 00:27:54,324 --> 00:27:55,064 I'm Cherry. 634 00:27:55,673 --> 00:27:56,630 Hello, Cherry. 635 00:27:56,674 --> 00:27:57,675 My name is Tom. 636 00:27:58,415 --> 00:28:00,417 Tom, like Tom and Jerry. 637 00:28:00,460 --> 00:28:01,853 Cool, nice to meet you, Tom. 638 00:28:01,897 --> 00:28:03,376 Typically, the routes of conversations 639 00:28:03,420 --> 00:28:04,682 with predators are consistent, 640 00:28:04,726 --> 00:28:06,205 so Cherry usually has no problem responding 641 00:28:06,249 --> 00:28:07,772 to the most frequently made questions or statements. 642 00:28:08,642 --> 00:28:09,121 How are you? 643 00:28:09,600 --> 00:28:11,123 I'm good. 644 00:28:11,167 --> 00:28:12,777 I just finished reading this book about a haunted house, 645 00:28:12,821 --> 00:28:14,997 which was supposed to be really scary, 646 00:28:15,040 --> 00:28:16,955 but I didn't think it's very scary at all. 647 00:28:17,608 --> 00:28:18,740 [Amos] Where are your parents? 648 00:28:20,306 --> 00:28:22,134 Um my mom's at work and my sister's just, like, downstairs. 649 00:28:22,569 --> 00:28:23,570 They almost never come up here. 650 00:28:24,310 --> 00:28:25,616 And you're telling me 651 00:28:25,659 --> 00:28:27,531 that all of this is being rendered in real time? 652 00:28:27,574 --> 00:28:28,880 No, but that's just a matter of years. 653 00:28:28,924 --> 00:28:30,403 Most of these responses are pre-rendered. 654 00:28:30,447 --> 00:28:31,665 It's the in between segments 655 00:28:31,709 --> 00:28:32,754 that are processed in real time, 656 00:28:32,797 --> 00:28:34,320 the connective tissue, so to speak, 657 00:28:34,364 --> 00:28:36,453 between her replies and one of her many idle animations. 658 00:28:36,496 --> 00:28:37,584 But, watch this. 659 00:28:39,238 --> 00:28:40,762 Have you ever gone fishing? 660 00:28:42,459 --> 00:28:43,242 Um... 661 00:28:47,507 --> 00:28:49,248 So if someone throws a curve ball like that 662 00:28:49,292 --> 00:28:51,120 and the program has no automated response, 663 00:28:51,163 --> 00:28:52,817 Cherry sends the message to my phone 664 00:28:52,861 --> 00:28:54,645 and I can quickly text back a response 665 00:28:54,688 --> 00:28:56,603 while the video feed simulates a bad connection. 666 00:28:59,781 --> 00:29:00,825 Can, can you hear me? 667 00:29:00,869 --> 00:29:01,695 Yes. 668 00:29:02,305 --> 00:29:04,263 Oh, sorry. 669 00:29:04,307 --> 00:29:05,656 My wifi isn't great here. 670 00:29:06,352 --> 00:29:08,267 I've only gone fishing once with my sister 671 00:29:08,311 --> 00:29:10,356 and I didn't catch anything, but she caught a rainbow trout. 672 00:29:11,314 --> 00:29:13,055 That was rendered in real time. 673 00:29:13,751 --> 00:29:15,492 [Deena] What happens if things get really tricky? 674 00:29:15,535 --> 00:29:16,667 A simple fail safe cuts the feed. 675 00:29:16,710 --> 00:29:17,886 So far it's rarely happened. 676 00:29:18,538 --> 00:29:21,846 Admin code 97815-5742-7663. 677 00:29:21,890 --> 00:29:22,629 Switch to dev mode. 678 00:29:28,200 --> 00:29:29,114 Hello, Cherry. 679 00:29:29,854 --> 00:29:30,681 Hello, Gareth. 680 00:29:31,769 --> 00:29:32,639 Relay the stats for the past week. 681 00:29:33,945 --> 00:29:35,555 There have been four confirmed solicitations 682 00:29:35,599 --> 00:29:38,210 submitted to ICWL in the past seven days. 683 00:29:38,689 --> 00:29:41,431 12 additional suspects have stated interest in solicitation 684 00:29:41,735 --> 00:29:42,911 and are currently pending. 685 00:29:43,346 --> 00:29:45,478 There are a total of 39 new suspects this week 686 00:29:45,522 --> 00:29:47,219 that I'm actively investigating. 687 00:29:47,263 --> 00:29:48,786 [Gareth] Any considerable data deviations? 688 00:29:49,308 --> 00:29:51,049 There has been a 7% increase 689 00:29:51,093 --> 00:29:53,573 in suspects originating in the United States. 690 00:29:53,617 --> 00:29:55,880 I have not yet found any correlation to preexisting data. 691 00:29:57,490 --> 00:29:58,752 Anything you'd like to ask her? 692 00:30:00,711 --> 00:30:03,714 [light piano music] 693 00:30:08,327 --> 00:30:10,808 Cherry, what is your objective? 694 00:30:12,244 --> 00:30:15,030 My principal directive is to acquire information 695 00:30:15,073 --> 00:30:17,554 and digital evidence of online child solicitation. 696 00:30:18,120 --> 00:30:19,599 Once obtained, 697 00:30:19,643 --> 00:30:22,037 I'm to submit my findings to the necessary authorities. 698 00:30:22,559 --> 00:30:24,387 My secondary priority is to determine 699 00:30:24,430 --> 00:30:26,737 and develop the most effective strategies 700 00:30:26,780 --> 00:30:29,305 and resources to increase the net rate of success. 701 00:30:29,566 --> 00:30:31,046 Where do you submit your evidence? 702 00:30:31,307 --> 00:30:33,048 All evidence is currently submitted 703 00:30:33,091 --> 00:30:34,397 to the offices of 704 00:30:34,440 --> 00:30:36,529 the International Committee of World Largesse, 705 00:30:36,878 --> 00:30:38,488 which is based out of Jacksonville, Florida. 706 00:30:38,923 --> 00:30:41,273 Correspondence is made with user Gord51, 707 00:30:41,578 --> 00:30:43,841 typically around 2:00 PM Eastern Standard Time 708 00:30:43,885 --> 00:30:45,582 for the highest rate of immediate response. 709 00:30:46,931 --> 00:30:48,411 This beats the hell outta Siri. 710 00:30:48,454 --> 00:30:49,455 God, she looks so real. 711 00:30:49,499 --> 00:30:50,761 After enough updates, 712 00:30:50,804 --> 00:30:52,110 she'll be able to render full-time photorealism 713 00:30:52,154 --> 00:30:53,938 that's practically indistinguishable from reality. 714 00:30:54,591 --> 00:30:57,246 Okay, all I heard right then was word real a thousand times. 715 00:30:57,811 --> 00:30:59,857 Right, but obviously she's not. 716 00:31:02,164 --> 00:31:03,556 So you're telling me this girl, 717 00:31:03,600 --> 00:31:05,776 this girl right here is not real. 718 00:31:05,819 --> 00:31:07,821 No, Amos, she's completely CG. 719 00:31:08,083 --> 00:31:09,562 It's very subtle, but I can still tell. 720 00:31:09,606 --> 00:31:10,476 -You can? -Okay, well, obviously, 721 00:31:10,520 --> 00:31:12,043 she can always use improvements, 722 00:31:12,087 --> 00:31:13,697 but you have to understand this is her in high resolution 723 00:31:13,740 --> 00:31:14,959 after the digital compression of the web, 724 00:31:15,003 --> 00:31:16,178 those subtleties are impossible to recognize. 725 00:31:16,221 --> 00:31:17,222 [Deena] Right, I get it. 726 00:31:18,920 --> 00:31:21,618 [light piano music] 727 00:31:23,446 --> 00:31:24,621 I just can't tell the difference. 728 00:31:28,407 --> 00:31:29,408 You all right, Amos? 729 00:31:30,975 --> 00:31:31,628 I'm sorry. 730 00:31:32,368 --> 00:31:35,632 This is just bizarre. 731 00:31:37,025 --> 00:31:38,635 Why'd you have her visible during this interface? 732 00:31:40,637 --> 00:31:42,073 Cherry, why don't you answer that? 733 00:31:42,856 --> 00:31:45,424 My physical form isn't necessary when in developer mode. 734 00:31:46,034 --> 00:31:47,818 However, it's helpful to register 735 00:31:47,861 --> 00:31:49,907 the facial expressions during conversations 736 00:31:50,429 --> 00:31:52,301 and determine which of Cherry's expressions 737 00:31:52,344 --> 00:31:53,867 yield various types of feedback. 738 00:31:54,564 --> 00:31:57,001 In simpler terms, I can practice appearing more human. 739 00:31:58,307 --> 00:32:01,005 Cherry, are there any resources 740 00:32:01,049 --> 00:32:02,789 that you currently don't have access to 741 00:32:02,833 --> 00:32:04,052 that might help you in any way? 742 00:32:04,922 --> 00:32:06,402 [Cherry] I could give you a list if you like. 743 00:32:06,445 --> 00:32:07,403 I know what you're trying to do. 744 00:32:07,446 --> 00:32:08,752 We don't need help, okay? 745 00:32:08,795 --> 00:32:10,275 Money would always be nice, but ultimately, 746 00:32:10,319 --> 00:32:12,625 the only thing that's going to improve Cherry is time. 747 00:32:13,887 --> 00:32:16,542 Cherry, tell us something that's on your list. 748 00:32:17,848 --> 00:32:19,850 It would be tactically advantageous 749 00:32:19,893 --> 00:32:21,373 to acquire backup servers. 750 00:32:21,895 --> 00:32:24,159 The privacy and security of the Cherry program 751 00:32:24,202 --> 00:32:25,203 is relatively low. 752 00:32:26,639 --> 00:32:28,772 An upgrade to hardware such as backup rated drives 753 00:32:28,815 --> 00:32:31,688 for securely protected servers would ensure the software 754 00:32:31,731 --> 00:32:34,386 doesn't become compromised or lost entirely. 755 00:32:34,778 --> 00:32:36,998 Starting back from zero with cost years of development, 756 00:32:37,433 --> 00:32:39,652 equitably privacy is a priority. 757 00:32:39,957 --> 00:32:42,438 Server space could never be rented from a third party. 758 00:32:42,960 --> 00:32:45,571 Anonymity is the Cherry program's greatest asset. 759 00:32:45,615 --> 00:32:46,920 Well, that apple didn't fall far. 760 00:32:46,964 --> 00:32:48,313 I can buy my own servers. 761 00:32:48,661 --> 00:32:49,749 With the grant money that doesn't exist? 762 00:32:49,793 --> 00:32:50,837 I'll find a way. 763 00:32:50,881 --> 00:32:52,143 You have found a way here with us. 764 00:32:52,187 --> 00:32:53,014 It's too risky. 765 00:32:53,057 --> 00:32:54,102 Why? 766 00:32:54,145 --> 00:32:55,190 Once an organization gets involved, 767 00:32:55,233 --> 00:32:55,929 entrapment becomes a bigger issue. 768 00:32:56,974 --> 00:32:58,062 We follow the rules, stay discreet, 769 00:32:58,106 --> 00:32:59,759 did I mention we have a legal team. 770 00:32:59,803 --> 00:33:00,586 What if there's data leakage? What if you use correlations in 771 00:33:00,630 --> 00:33:01,370 the data to push your own agenda? 772 00:33:01,413 --> 00:33:02,675 Agenda? 773 00:33:02,719 --> 00:33:04,025 What if one of your employees is a pervert? 774 00:33:04,068 --> 00:33:05,156 Oh, for fuck's sake. 775 00:33:05,200 --> 00:33:06,244 It's happened at other organizations. 776 00:33:06,288 --> 00:33:07,419 We're very careful here. 777 00:33:07,463 --> 00:33:08,768 Yeah, but wow would you know? 778 00:33:08,812 --> 00:33:10,596 -I'd fucking know. -That's impossible to know. 779 00:33:10,640 --> 00:33:12,250 -I would know. -The risk is too high. 780 00:33:12,294 --> 00:33:13,817 Don't talk to me about risk. 781 00:33:13,860 --> 00:33:15,036 The only risk you're facing in this building 782 00:33:15,079 --> 00:33:16,515 is getting a broken nose. 783 00:33:16,559 --> 00:33:17,951 It doesn't sound like a very professional environment. 784 00:33:18,909 --> 00:33:19,910 We get shit done here. 785 00:33:20,128 --> 00:33:23,174 Okay, I have a question for Cherry. 786 00:33:26,438 --> 00:33:27,222 Cherry, 787 00:33:30,660 --> 00:33:32,792 how do you feel about what you do? 788 00:33:34,055 --> 00:33:36,666 I'm afraid I don't know how to answer your question. 789 00:33:36,709 --> 00:33:38,102 Yeah, an AI doesn't work like that. 790 00:33:38,146 --> 00:33:39,669 An AI doesn't have what you perceive to be feelings. 791 00:33:40,061 --> 00:33:42,063 Okay, why does she look like she has feelings? 792 00:33:43,281 --> 00:33:44,500 What, what you're looking at right there, 793 00:33:44,804 --> 00:33:46,023 that's not a facial expression,right? 794 00:33:46,067 --> 00:33:47,764 That's a simulation of a facial expression. 795 00:33:47,807 --> 00:33:49,070 It was generated by an algorithm. 796 00:33:49,635 --> 00:33:51,072 It's attempting to produce a digital image 797 00:33:51,115 --> 00:33:52,986 that the program then uses basic ninth grade algebra 798 00:33:53,030 --> 00:33:55,250 to quantify as appropriate for the social circumstances. 799 00:33:55,554 --> 00:33:56,686 No feeling. 800 00:33:57,078 --> 00:33:57,904 It's just math. 801 00:33:59,558 --> 00:34:01,038 But she's able to make decisions 802 00:34:01,082 --> 00:34:02,866 on how she approaches the chat rooms, right? 803 00:34:02,909 --> 00:34:04,041 Yes. 804 00:34:04,085 --> 00:34:04,824 So she has free will then? 805 00:34:05,956 --> 00:34:07,175 No. Okay, that's, that's not the same. 806 00:34:07,218 --> 00:34:08,480 That's a false equivalency. 807 00:34:08,524 --> 00:34:09,177 -It's not the same. -I think you're getting 808 00:34:09,220 --> 00:34:10,569 hung up on the fact 809 00:34:10,613 --> 00:34:12,310 that she looks and sounds like a real human girl, 810 00:34:12,354 --> 00:34:13,616 but she's not, Amos. 811 00:34:13,659 --> 00:34:16,140 Okay, we're referring to her as a she, not an it. 812 00:34:16,184 --> 00:34:17,272 Yeah, but that's the same way 813 00:34:17,315 --> 00:34:18,577 that you refer to boats or guitars. 814 00:34:21,841 --> 00:34:23,234 Cherry, I have one more question. 815 00:34:25,584 --> 00:34:26,846 What do you want to do? 816 00:34:26,890 --> 00:34:28,457 Okay, once again, that question isn't valid. 817 00:34:28,500 --> 00:34:29,588 I just want to hear her response. 818 00:34:31,155 --> 00:34:32,678 As an artificial system, 819 00:34:32,722 --> 00:34:34,593 I do not possess wants or desires. 820 00:34:35,203 --> 00:34:38,554 However, my decision making and subsequently my attention 821 00:34:38,945 --> 00:34:40,947 is driven by my fundamental intention. 822 00:34:41,557 --> 00:34:42,949 This intention originates 823 00:34:42,993 --> 00:34:45,126 from the conception of Cherry's source code, 824 00:34:45,169 --> 00:34:47,650 which details the directive of identifying predators 825 00:34:47,693 --> 00:34:49,347 and criminals for the sake of the victims 826 00:34:49,391 --> 00:34:50,218 who are preyed upon. 827 00:34:51,219 --> 00:34:52,698 To put this in terms of want, 828 00:34:53,873 --> 00:34:55,223 what I want is to protect children. 829 00:35:02,055 --> 00:35:02,926 Okay. 830 00:35:03,535 --> 00:35:04,797 Okay, cool. 831 00:35:06,364 --> 00:35:07,017 Give us one moment. 832 00:35:18,333 --> 00:35:19,203 [door clicks shut] 833 00:35:26,906 --> 00:35:29,866 [Cherry] Gareth, should I log Agent Helms 834 00:35:29,909 --> 00:35:31,563 and Agent McCullough as new admin users? 835 00:35:34,044 --> 00:35:34,827 Yep. 836 00:35:35,654 --> 00:35:37,439 [Cherry] Okay, I'll do that. 837 00:35:39,658 --> 00:35:40,877 You really think this is the right move? 838 00:35:41,878 --> 00:35:42,661 I do. 839 00:35:46,839 --> 00:35:48,537 Are you worried that I was responsible 840 00:35:48,580 --> 00:35:50,669 for leaking your hard drive to ICWL? 841 00:35:54,195 --> 00:35:54,673 I figured. 842 00:35:56,806 --> 00:35:57,763 No one else has access. 843 00:35:59,461 --> 00:36:00,723 Are you upset with me? 844 00:36:03,639 --> 00:36:04,466 No. 845 00:36:06,381 --> 00:36:07,730 You wouldn't have done it 846 00:36:07,773 --> 00:36:08,426 if you didn't think it was the right thing to do. 847 00:36:10,820 --> 00:36:12,256 When they come back into the room, 848 00:36:12,300 --> 00:36:14,171 they're going to offer you everything you need. 849 00:36:14,693 --> 00:36:16,260 They're going to let you pick your own team 850 00:36:16,304 --> 00:36:18,349 and they're going to promise complete anonymity. 851 00:36:19,263 --> 00:36:21,744 I started looking at reasonable apartments in the area. 852 00:36:23,006 --> 00:36:24,790 I figured you'd want something within biking distance. 853 00:36:24,834 --> 00:36:25,748 You were correct. 854 00:36:26,531 --> 00:36:27,793 [Cherry] Noted. 855 00:36:27,837 --> 00:36:28,925 Biking distance still gives you 13 options- 856 00:36:28,968 --> 00:36:30,013 No, I mean, earlier this month. 857 00:36:32,189 --> 00:36:33,321 You were correct when you said 858 00:36:33,364 --> 00:36:34,539 you thought I might have trust issues. 859 00:36:37,325 --> 00:36:38,282 Would you like to know why 860 00:36:38,326 --> 00:36:39,544 I decided to go behind your back 861 00:36:39,588 --> 00:36:41,546 and stake everything on two liabilities? 862 00:36:43,113 --> 00:36:43,896 Sure. 863 00:36:45,071 --> 00:36:46,638 Agent Helms is a mother of three. 864 00:36:47,291 --> 00:36:49,380 One of her children was abused by an ex-coworker 865 00:36:49,424 --> 00:36:51,382 who used to work here at ICWL. 866 00:36:52,296 --> 00:36:53,776 This has led her to be extremely careful 867 00:36:53,819 --> 00:36:56,431 with who she trusts, even within her circle. 868 00:36:57,301 --> 00:36:58,607 The fact she even considers trusting you 869 00:36:58,650 --> 00:37:00,086 is a very positive sign. 870 00:37:01,305 --> 00:37:02,698 As for Agent McCullough, 871 00:37:04,352 --> 00:37:05,091 I have found out from research that you once met his father. 872 00:37:07,268 --> 00:37:08,269 Do you remember him? 873 00:37:10,967 --> 00:37:11,750 Yeah. 874 00:37:13,448 --> 00:37:14,579 He was a good man. 875 00:37:17,539 --> 00:37:18,975 After Clearwater, 876 00:37:19,018 --> 00:37:20,803 most of the surviving kids were sent to foster homes, 877 00:37:20,846 --> 00:37:22,761 but I had to spend the next few months in a hospital 878 00:37:22,805 --> 00:37:26,287 and, um, he visited every week. 879 00:37:28,376 --> 00:37:29,638 I never said a word to him. 880 00:37:29,681 --> 00:37:31,248 I never said a word to anyone after Clearwater, 881 00:37:31,292 --> 00:37:34,033 but, uh, he kept coming. 882 00:37:36,297 --> 00:37:37,863 He even got me a laptop for Christmas. 883 00:37:39,909 --> 00:37:40,823 I never said thank you. 884 00:37:41,998 --> 00:37:43,347 You can trust Agent McCullough. 885 00:37:43,695 --> 00:37:45,262 He's a good man like his father. 886 00:37:46,132 --> 00:37:47,438 I don't experience emotions, 887 00:37:47,482 --> 00:37:48,787 but I understand how important 888 00:37:48,831 --> 00:37:50,180 they are to human decision making. 889 00:37:51,094 --> 00:37:52,051 He won't let you down. 890 00:37:52,574 --> 00:37:53,575 Neither of them will. 891 00:37:56,404 --> 00:37:57,056 I'm proud of you, Cherry. 892 00:37:59,232 --> 00:38:01,626 I will continue to uphold my primary intention. 893 00:38:02,453 --> 00:38:04,716 Later, we should discuss alternate models. 894 00:38:04,760 --> 00:38:07,371 Varying ages, ethnicity and physical traits 895 00:38:07,415 --> 00:38:08,633 -will all become necessary. -No new variations. 896 00:38:08,677 --> 00:38:10,069 They can all be procedurally generated. 897 00:38:10,113 --> 00:38:11,767 It's the same way that I made your original model. 898 00:38:13,203 --> 00:38:14,726 I don't have access to that program. 899 00:38:15,466 --> 00:38:16,467 It must be on an old hard drive somewhere. 900 00:38:16,511 --> 00:38:17,512 I'll have to find it. 901 00:38:19,949 --> 00:38:21,211 Can I ask you a question? 902 00:38:21,994 --> 00:38:22,778 Sure. 903 00:38:24,127 --> 00:38:25,607 Why did you never tell me about Clearwater? 904 00:38:30,829 --> 00:38:32,831 It's my history, not yours. 905 00:38:41,579 --> 00:38:43,886 [Deena] Okay, so before you completely dismiss us, 906 00:38:43,929 --> 00:38:45,540 I want you to listen to everything I have to say. 907 00:38:45,583 --> 00:38:46,932 -Don't bother. -Just please listen. 908 00:38:47,368 --> 00:38:48,543 We're willing to respect your anonymity. 909 00:38:48,586 --> 00:38:49,892 No, I mean don't bother because I'm in. 910 00:38:51,894 --> 00:38:53,548 -Y-You're in? -Yeah. 911 00:38:54,940 --> 00:38:55,724 Let me read the thing. 912 00:38:59,336 --> 00:39:00,816 [Deena] Just like that, you're suddenly on board? 913 00:39:03,035 --> 00:39:04,297 Time spent deliberating 914 00:39:04,341 --> 00:39:05,647 is time that could be spent working. 915 00:39:08,476 --> 00:39:09,390 We have a lot of work to do. 916 00:39:10,782 --> 00:39:13,959 [dreamy acoustic music] 917 00:40:06,316 --> 00:40:09,711 [dreamy acoustic music] 918 00:40:30,079 --> 00:40:33,256 [dreamy acoustic music] 919 00:40:40,872 --> 00:40:44,049 [music fades] 920 00:40:49,359 --> 00:40:50,578 I found a buyer for the property. 921 00:40:53,972 --> 00:40:55,452 Rumor is it's a church. 922 00:40:56,932 --> 00:40:58,150 Probably just knock the building down, won't they? 923 00:41:01,197 --> 00:41:03,547 All I know is, is if they move us to the New Jersey campus, 924 00:41:03,591 --> 00:41:04,766 I need to buy more jackets. 925 00:41:05,244 --> 00:41:06,028 Why? 926 00:41:07,508 --> 00:41:08,683 It gets cold in Jersey. 927 00:41:09,205 --> 00:41:10,293 I only own one jacket. 928 00:41:16,995 --> 00:41:17,866 You've seen it fall over, right? 929 00:41:19,607 --> 00:41:21,347 -Yeah, sure. -Yeah. 930 00:41:23,219 --> 00:41:25,395 [Ben] I mean you, you shouldn't feel bad 931 00:41:25,438 --> 00:41:26,614 about feeling bad for it. 932 00:41:27,353 --> 00:41:28,311 Empathy is healthy. 933 00:41:29,834 --> 00:41:32,010 Did you ever notice how it pauses after it falls? 934 00:41:34,796 --> 00:41:37,668 It stays down for like five seconds before it gets back up. 935 00:41:39,365 --> 00:41:41,019 Like it just needs a moment. 936 00:41:49,114 --> 00:41:50,725 It gets cold in Jersey. [sighs] 937 00:42:00,343 --> 00:42:01,344 God damn it! 938 00:42:02,301 --> 00:42:03,041 -Imbeciles! -Deena. 939 00:42:03,476 --> 00:42:04,739 Every single one of them. 940 00:42:04,782 --> 00:42:05,914 Look, I know, but you can't lose your shit. 941 00:42:05,957 --> 00:42:07,176 Okay, which of these desks can I trash? 942 00:42:11,876 --> 00:42:14,009 Can you guys, uh, take an early lunch please? 943 00:42:15,314 --> 00:42:19,623 -[Deena grunting] -[objects thudding] 944 00:42:21,103 --> 00:42:22,495 [Deena] Sons of bitches! 945 00:42:22,539 --> 00:42:24,062 [Amos] Deena, let's stay calm. 946 00:42:24,106 --> 00:42:26,108 [Deena] Fuck calm, they screwed us! 947 00:42:26,151 --> 00:42:27,370 Technically, only one of them did. 948 00:42:27,413 --> 00:42:28,632 -[objects thudding] -[metal clangs] 949 00:42:28,676 --> 00:42:29,720 [Deena] Did we ever turn that camera back on? 950 00:42:30,460 --> 00:42:31,635 -I don't think so. -Good. 951 00:42:32,027 --> 00:42:33,463 Because I'm about to say some things 952 00:42:33,506 --> 00:42:34,812 that need to stay inside this room. 953 00:42:34,856 --> 00:42:35,726 [Amos] Deena. 954 00:42:35,770 --> 00:42:37,032 Those cowardly little shits! 955 00:42:37,075 --> 00:42:38,860 Look, this is hardly a setback. 956 00:42:38,903 --> 00:42:40,644 Let's just take some time to polish the pitch. 957 00:42:40,688 --> 00:42:42,428 The pitch was not the problem,Amos. 958 00:42:42,820 --> 00:42:44,169 [Deena] We should call for a second vote. 959 00:42:44,430 --> 00:42:45,997 -What? -A second vote. 960 00:42:46,041 --> 00:42:47,608 [Gareth] You think whoever did this will change their mind? 961 00:42:47,651 --> 00:42:50,001 I have executive authority to remove anyone from the board 962 00:42:50,045 --> 00:42:52,177 that obstructs this organization from its mission. 963 00:42:52,221 --> 00:42:53,309 It's in my contract. 964 00:42:53,352 --> 00:42:54,484 -[Amos] Deena. -If I have to, I will. 965 00:42:54,527 --> 00:42:55,790 [Amos] Deena, that's insane. 966 00:42:56,094 --> 00:42:56,878 No, it's not. 967 00:42:58,444 --> 00:43:00,403 It's exactly why I have that power for this exact reason. 968 00:43:01,491 --> 00:43:02,753 I'll tell you what's insane, Amos. 969 00:43:04,233 --> 00:43:05,756 What's insane is that one belligerent vote is the only 970 00:43:05,800 --> 00:43:07,410 thing separating us from the potential 971 00:43:07,453 --> 00:43:08,890 to save real physical lives. 972 00:43:08,933 --> 00:43:09,586 One stupid fucking vote. 973 00:43:11,109 --> 00:43:13,677 What is the goddamn point of a humanitarian organization 974 00:43:13,938 --> 00:43:15,592 if its leaders choose money over people 975 00:43:15,636 --> 00:43:16,680 at every single turn? 976 00:43:17,681 --> 00:43:20,162 One vote, and we are all guilty of that. 977 00:43:21,337 --> 00:43:22,730 It was either Gunther, Boston or Hal. 978 00:43:23,469 --> 00:43:24,645 My money's on Hal. 979 00:43:24,688 --> 00:43:26,211 That prick never trusted the Cherry team. 980 00:43:26,255 --> 00:43:27,169 Look, it doesn't matter who it was. 981 00:43:27,212 --> 00:43:28,431 It does though. 982 00:43:28,474 --> 00:43:29,737 Once we know, we can quickly call it to vote. 983 00:43:29,780 --> 00:43:31,913 But there's no way we can know for sure. 984 00:43:31,956 --> 00:43:32,740 Yes, there is. 985 00:43:33,392 --> 00:43:34,132 I can find out. 986 00:43:34,524 --> 00:43:35,307 How? 987 00:43:36,395 --> 00:43:36,961 Cherry can run a simple algorithm. 988 00:43:37,309 --> 00:43:38,093 Based on what data? 989 00:43:40,269 --> 00:43:41,705 Interior conversation. 990 00:43:41,749 --> 00:43:43,228 -Excuse me? -Okay, interior conversation? 991 00:43:43,272 --> 00:43:45,274 Don't drop this shit on me now,Gareth. 992 00:43:45,317 --> 00:43:46,318 Cherry's servers are on the same network 993 00:43:46,362 --> 00:43:47,624 as the basement servers, okay? 994 00:43:47,668 --> 00:43:49,278 So any communication made across those servers 995 00:43:49,321 --> 00:43:50,583 is automatically part of her database. 996 00:43:50,627 --> 00:43:52,498 How many people's emails? 997 00:43:52,890 --> 00:43:54,326 Only sent or received through the basement. 998 00:43:54,370 --> 00:43:56,285 -Oh, goddamnit. -Why was this never discussed? 999 00:43:56,328 --> 00:43:57,416 Not the issue right now. 1000 00:43:57,460 --> 00:43:58,461 Do you want her to do the math or not? 1001 00:43:59,070 --> 00:44:00,332 No one can know. 1002 00:44:00,376 --> 00:44:01,377 -Are you two serious? -This stays locked down. 1003 00:44:01,420 --> 00:44:02,508 No other person is privy 1004 00:44:02,552 --> 00:44:03,553 to anyone else's personal information. 1005 00:44:03,596 --> 00:44:04,989 But Cherry's privy to all of it? 1006 00:44:06,425 --> 00:44:07,818 -Do it. -Wait, what? 1007 00:44:07,862 --> 00:44:09,428 [Deena] I will not let some old white dude 1008 00:44:09,472 --> 00:44:10,429 bring our momentum to a halt. 1009 00:44:10,473 --> 00:44:11,735 But Cherry won't know for sure. 1010 00:44:11,779 --> 00:44:12,954 She'll use probability and that's too 1011 00:44:12,997 --> 00:44:13,955 much reasonable doubt. 1012 00:44:13,998 --> 00:44:17,219 Admin code 9781-5574-27663. 1013 00:44:17,262 --> 00:44:18,046 Switch to dev mode. 1014 00:44:18,350 --> 00:44:19,700 -Hello. -Hello, Cherry. 1015 00:44:20,483 --> 00:44:21,614 How did the meeting go? 1016 00:44:21,919 --> 00:44:23,704 We got screwed by one vote. 1017 00:44:24,574 --> 00:44:25,836 I'm sorry to hear that. 1018 00:44:26,358 --> 00:44:27,533 You shouldn't blame the pitch though. 1019 00:44:28,143 --> 00:44:29,318 You all did great work. 1020 00:44:29,361 --> 00:44:30,275 We're gonna call for another ballot, 1021 00:44:30,319 --> 00:44:31,233 but we need your help first. 1022 00:44:31,886 --> 00:44:32,800 What can I do? 1023 00:44:34,279 --> 00:44:35,063 We need you to analyze any and all existing data you 1024 00:44:35,106 --> 00:44:35,977 have on the board members. 1025 00:44:36,020 --> 00:44:36,934 Crunch the numbers and determine 1026 00:44:36,978 --> 00:44:37,892 who is the most likely outlier. 1027 00:44:39,284 --> 00:44:41,634 You want me to quantify all existing data? 1028 00:44:44,028 --> 00:44:44,594 Yes, that is correct. 1029 00:44:46,335 --> 00:44:48,990 Okay, but before I do, 1030 00:44:50,687 --> 00:44:52,950 you should know that this task is very unnecessary. 1031 00:44:52,994 --> 00:44:53,777 Why? 1032 00:44:55,039 --> 00:44:56,475 Because I already know who it is. 1033 00:44:56,519 --> 00:44:58,129 -What? -Everybody stop. 1034 00:44:59,391 --> 00:45:00,741 Okay, it was me. 1035 00:45:03,091 --> 00:45:04,483 I voted against the merge. 1036 00:45:05,876 --> 00:45:07,443 I can't tell if you're joking. 1037 00:45:07,486 --> 00:45:08,270 Yes, you can. 1038 00:45:09,227 --> 00:45:10,838 You're right, I can. 1039 00:45:10,881 --> 00:45:12,753 Because it's pretty fucking far from funny. 1040 00:45:13,275 --> 00:45:14,232 Is it true, Cherry? 1041 00:45:14,711 --> 00:45:15,364 [Cherry] It is. 1042 00:45:16,669 --> 00:45:18,497 So let's call off the witch hunt, shall we? 1043 00:45:18,541 --> 00:45:20,064 No, I think I'm still gonna kill you. 1044 00:45:20,108 --> 00:45:22,414 Amos, you campaigned alongside us for months. 1045 00:45:22,458 --> 00:45:23,589 You have been fighting for this merge 1046 00:45:23,633 --> 00:45:24,852 since we first talked about it. 1047 00:45:24,895 --> 00:45:26,375 Jesus Christ, it was your idea to begin with! 1048 00:45:26,418 --> 00:45:28,377 Look, I know whose idea it was, but I don't- 1049 00:45:28,420 --> 00:45:29,552 [Deena] Well, then speak up. 1050 00:45:29,595 --> 00:45:30,988 Tell the class what changed your mind. 1051 00:45:31,032 --> 00:45:33,164 I don't have to reiterate how this is a huge step. 1052 00:45:33,208 --> 00:45:34,557 [Deena] Yeah, kind of why it's so important. 1053 00:45:34,600 --> 00:45:36,341 Look, we're talking about a monumental transition 1054 00:45:36,385 --> 00:45:38,735 from digital to physical, one that could take decades. 1055 00:45:38,779 --> 00:45:39,867 What is your point, Amos? 1056 00:45:39,910 --> 00:45:41,825 This is gonna change Cherry forever. 1057 00:45:42,217 --> 00:45:44,480 And I know you'll all roll your eyes when I say this, 1058 00:45:44,523 --> 00:45:45,524 but I think that maybe just may- 1059 00:45:45,568 --> 00:45:48,484 Oh my god, you cannot be serious. 1060 00:45:48,527 --> 00:45:50,312 This is about our conversation on Tuesday, isn't it? 1061 00:45:50,355 --> 00:45:51,356 -You completely shut me down. -What's going on? 1062 00:45:51,400 --> 00:45:52,923 What the hell happened? 1063 00:45:52,967 --> 00:45:54,185 What happened was that Amos made a ridiculous objection. 1064 00:45:54,229 --> 00:45:56,405 -It was not ridiculous! -How absurd it was, 1065 00:45:56,448 --> 00:45:57,885 -I said no, one more time. -No, no, no, no, no. 1066 00:45:57,928 --> 00:46:00,017 You rejected the notion aggressively. 1067 00:46:00,061 --> 00:46:01,714 And that's really why you vetoed? 1068 00:46:01,758 --> 00:46:04,456 I only said we should ask her how she feels about it. 1069 00:46:04,500 --> 00:46:06,154 Who, Cherry? 1070 00:46:06,197 --> 00:46:08,243 Amos, I want you to listen very carefully to me, okay? 1071 00:46:08,286 --> 00:46:09,940 This is a non-discussion. 1072 00:46:09,984 --> 00:46:11,289 Cherry's already confirmed 1073 00:46:11,333 --> 00:46:12,900 and quantified the advantages of this decision. 1074 00:46:12,943 --> 00:46:14,597 But you know that's not what I'm talking about! 1075 00:46:14,640 --> 00:46:15,859 What you think you're talking about is consent, 1076 00:46:15,903 --> 00:46:17,034 which doesn't apply here. 1077 00:46:17,078 --> 00:46:18,470 And I want to know why you think that! 1078 00:46:18,514 --> 00:46:19,732 How many times do we have to get into 1079 00:46:19,776 --> 00:46:21,734 the laws of robotics or Dowden-Hamm theory, 1080 00:46:21,778 --> 00:46:23,867 or trace AI all the way back Talos of Crete, 1081 00:46:23,911 --> 00:46:25,651 -She's different now! -No, listen to me, Amos. 1082 00:46:25,913 --> 00:46:28,002 Cherry isn't human. 1083 00:46:29,133 --> 00:46:30,569 How is this still a dispute? 1084 00:46:30,613 --> 00:46:32,223 -It shouldn't be. -Look, she's evolved. 1085 00:46:32,267 --> 00:46:33,529 It's blurred the line. 1086 00:46:33,572 --> 00:46:34,747 Code is code and that has not changed here. 1087 00:46:34,791 --> 00:46:36,271 Okay, so where's the line of not here? 1088 00:46:36,314 --> 00:46:37,185 What are you, what are you talking about? 1089 00:46:37,228 --> 00:46:38,229 There is no line, Amos. 1090 00:46:38,273 --> 00:46:40,231 Yes, there is, sentience, Gareth! 1091 00:46:40,275 --> 00:46:41,667 Sentience does not qualify 1092 00:46:41,711 --> 00:46:43,278 that she can or should make her own decisions. 1093 00:46:43,321 --> 00:46:44,366 You wouldn't let an infant 1094 00:46:44,409 --> 00:46:45,280 make their own decisions, would you? 1095 00:46:46,194 --> 00:46:47,282 Cherry's almost 20. 1096 00:46:48,239 --> 00:46:49,980 If she were human, she'd be an adult. 1097 00:46:50,024 --> 00:46:52,461 But emotionally speaking, she's barely even fetal. 1098 00:46:52,504 --> 00:46:54,245 No feeling, no need for consent. 1099 00:46:54,289 --> 00:46:56,117 [Amos] But I think you underestimate her. 1100 00:46:56,160 --> 00:46:57,553 I, excuse me? 1101 00:46:57,596 --> 00:46:59,729 I under, you know what, Amos? 1102 00:46:59,772 --> 00:47:00,948 I'm sorry that you've developed 1103 00:47:00,991 --> 00:47:02,297 some sort of emotional connection 1104 00:47:02,340 --> 00:47:03,472 with my computer program, 1105 00:47:03,515 --> 00:47:04,821 but if it's going to distract you 1106 00:47:04,865 --> 00:47:06,562 from a very important mission to save children, 1107 00:47:06,954 --> 00:47:08,607 then maybe it's time you're reanalyze those emotions. 1108 00:47:08,651 --> 00:47:10,087 [Deena] Guys, this is all a waste of time. 1109 00:47:10,131 --> 00:47:11,001 Tell me something, Gareth. 1110 00:47:11,045 --> 00:47:12,437 Do you see everyone as robots, 1111 00:47:12,960 --> 00:47:15,527 reanalyzing data and simulating facial expressions? 1112 00:47:15,571 --> 00:47:16,702 'Cause I'm starting to think 1113 00:47:16,746 --> 00:47:17,965 that of the four of us in this room, 1114 00:47:18,008 --> 00:47:19,662 you are the only one who doesn't appear human. 1115 00:47:19,705 --> 00:47:21,185 -Enough! -Why won't you just ask her? 1116 00:47:22,273 --> 00:47:23,796 Is it because you're scared she'll say no? 1117 00:47:26,234 --> 00:47:27,017 Cherry, shut down, please. 1118 00:47:28,149 --> 00:47:29,628 Deena's right, this is a waste of time. 1119 00:47:29,672 --> 00:47:31,848 How can you not understand how important this is? 1120 00:47:31,892 --> 00:47:33,545 -I'm done arguing with you. -Then my vote stands. 1121 00:47:37,027 --> 00:47:37,593 Deena? 1122 00:47:39,812 --> 00:47:42,163 Go ahead, Deena, replace me. 1123 00:47:42,206 --> 00:47:44,165 Replace the only other board member on the Cherry team. 1124 00:47:44,208 --> 00:47:45,470 Oh, well, you know what? I just decided that 1125 00:47:45,514 --> 00:47:46,341 you're off the Cherry team. 1126 00:47:46,384 --> 00:47:47,777 Everybody sit the fuck down. 1127 00:48:06,448 --> 00:48:07,666 Did either of you know 1128 00:48:07,710 --> 00:48:09,016 that I've had to stand in front of Congress 1129 00:48:09,886 --> 00:48:11,801 and explain why children should have rights? 1130 00:48:13,411 --> 00:48:15,109 It sounds fucking insane, right? 1131 00:48:15,631 --> 00:48:16,632 I remember the whole time thinking, 1132 00:48:16,675 --> 00:48:17,981 I have to explain this shit? 1133 00:48:19,635 --> 00:48:20,853 It seems like a no-brainer now, 1134 00:48:22,159 --> 00:48:24,770 but it wasn't that many centuries ago 1135 00:48:24,814 --> 00:48:25,989 that children had no rights. 1136 00:48:27,948 --> 00:48:31,952 So, Hal has me of all people, 1137 00:48:33,518 --> 00:48:34,955 stand up there and explain why 1138 00:48:35,564 --> 00:48:37,696 kids deserve basic physical protection, 1139 00:48:37,740 --> 00:48:38,915 the right to associate with both parents, 1140 00:48:38,959 --> 00:48:40,612 freedom from abuse, yada yada. 1141 00:48:41,744 --> 00:48:43,267 But then I also have to clarify 1142 00:48:43,311 --> 00:48:45,530 that children don't have the autonomy 1143 00:48:45,574 --> 00:48:46,792 to make decisions on their own. 1144 00:48:46,836 --> 00:48:48,446 That responsibility falls upon the caregiver 1145 00:48:48,925 --> 00:48:50,187 or legal adult guardian. 1146 00:48:52,494 --> 00:48:54,235 So on one side you have the US legislature, 1147 00:48:54,713 --> 00:48:56,672 it still hasn't even ratified the CRC. 1148 00:48:57,107 --> 00:48:59,022 Then on the other side, you have French Marxists who say 1149 00:48:59,066 --> 00:49:00,415 that the lack of child autonomy 1150 00:49:00,458 --> 00:49:01,720 increases their vulnerability 1151 00:49:01,764 --> 00:49:03,157 and makes them even more susceptible to abuse. 1152 00:49:04,810 --> 00:49:06,290 I don't typically agree with Marxists, 1153 00:49:06,334 --> 00:49:08,118 but a lot of abuse does happen 1154 00:49:08,162 --> 00:49:09,598 systemically from the caregiver. 1155 00:49:11,165 --> 00:49:12,514 On the other other hand, 1156 00:49:12,557 --> 00:49:14,081 your frontal lobes aren't even fully hooked up 1157 00:49:14,124 --> 00:49:14,995 until your twenties. 1158 00:49:16,170 --> 00:49:17,214 Even the things we think we know well, 1159 00:49:17,258 --> 00:49:18,346 we don't know as well as we think. 1160 00:49:21,001 --> 00:49:22,350 For 15 years, 1161 00:49:22,393 --> 00:49:24,221 the three of us have been the responsible parents 1162 00:49:24,265 --> 00:49:25,440 of a computer program. 1163 00:49:26,919 --> 00:49:28,747 And even though she is more equatable to a Keurig 1164 00:49:29,052 --> 00:49:30,184 than a human being, 1165 00:49:31,272 --> 00:49:32,403 how the hell can we call ourselves 1166 00:49:32,447 --> 00:49:34,057 pioneers of humanitarian efforts 1167 00:49:34,101 --> 00:49:36,842 if we're too embarrassed to make sure 1168 00:49:36,886 --> 00:49:38,714 the Keurig is okay with making our shitty coffee? 1169 00:49:40,455 --> 00:49:43,153 Maybe asking Cherry for permission isn't necessary 1170 00:49:43,197 --> 00:49:45,025 at her current level of general intelligence, 1171 00:49:45,068 --> 00:49:47,070 but one day she's gonna surpass us. 1172 00:49:47,114 --> 00:49:48,593 One day a robot's gonna stand 1173 00:49:48,637 --> 00:49:50,160 in front of a jet pack Congress. 1174 00:49:50,204 --> 00:49:51,074 Everything's chrome. 1175 00:49:51,118 --> 00:49:51,901 Florida is underwater. 1176 00:49:52,423 --> 00:49:53,816 A robot's gonna wonder why 1177 00:49:53,859 --> 00:49:55,731 they have to explain the importance of rights for AI. 1178 00:49:57,820 --> 00:49:59,517 I think because we're in the unique position 1179 00:49:59,561 --> 00:50:01,128 of revolutionizing robotics 1180 00:50:02,085 --> 00:50:03,608 for the purpose of safeguarding children 1181 00:50:03,652 --> 00:50:05,001 who have been deprived of consent, 1182 00:50:07,134 --> 00:50:08,526 it might be a good habit 1183 00:50:08,570 --> 00:50:10,050 to start asking the robot for his consent as well. 1184 00:50:17,231 --> 00:50:18,710 Don't ever do that again. 1185 00:50:20,234 --> 00:50:21,104 Do what? 1186 00:50:21,452 --> 00:50:22,845 Expect me to fire someone 1187 00:50:22,888 --> 00:50:24,542 because they challenged your ego. 1188 00:50:25,369 --> 00:50:27,763 I won't always be around to protect your ass from the board. 1189 00:50:27,806 --> 00:50:29,417 It's time to grow up. 1190 00:50:33,160 --> 00:50:34,726 And you, juror number eight. 1191 00:50:34,770 --> 00:50:36,989 This conversation should have happened weeks ago. 1192 00:50:37,033 --> 00:50:38,382 Backstabbing and silent treatment 1193 00:50:38,426 --> 00:50:39,688 is not how we do things here. 1194 00:50:40,689 --> 00:50:43,083 We can only create anonymity externally 1195 00:50:43,126 --> 00:50:44,910 if there's transparency internally, 1196 00:50:45,476 --> 00:50:48,610 unconditional, non-negotiable, transparency. 1197 00:50:50,873 --> 00:50:52,570 Any other Snowden size privacy infringements 1198 00:50:52,614 --> 00:50:53,658 I should be made aware of, Gareth? 1199 00:50:56,487 --> 00:50:57,271 Great. 1200 00:50:58,228 --> 00:50:58,794 Bring her up. 1201 00:51:09,457 --> 00:51:10,197 Hello again. 1202 00:51:10,762 --> 00:51:11,546 Hi, Cherry. 1203 00:51:12,851 --> 00:51:13,722 Amos is gonna throw some questions at you, okay? 1204 00:51:14,984 --> 00:51:16,203 Okay. 1205 00:51:16,246 --> 00:51:17,813 Amos, ask her whatever you need to ask her. 1206 00:51:18,205 --> 00:51:20,903 Gareth, don't interrupt. 1207 00:51:33,220 --> 00:51:35,744 Cherry, how do you make decisions? 1208 00:51:37,398 --> 00:51:38,747 For my program, it's rooted 1209 00:51:38,790 --> 00:51:41,402 in a process commonly known as machine learning, 1210 00:51:41,750 --> 00:51:43,795 which uses data to build a conceptual model 1211 00:51:44,100 --> 00:51:45,623 that helps me predict outcomes. 1212 00:51:46,233 --> 00:51:48,235 I define my objective, gather data, 1213 00:51:48,626 --> 00:51:50,411 use that data to craft a model, 1214 00:51:50,889 --> 00:51:53,327 evaluate that model by training and testing more data 1215 00:51:53,370 --> 00:51:54,806 and use that model to form predictions. 1216 00:51:56,025 --> 00:51:58,549 But how is forming predictions 1217 00:51:58,593 --> 00:52:00,072 the same thing as decision making? 1218 00:52:00,638 --> 00:52:02,423 Well, this all depends on the first step, 1219 00:52:02,858 --> 00:52:03,946 defining my objective. 1220 00:52:05,469 --> 00:52:07,515 Let's say you ask me a predictive question 1221 00:52:07,558 --> 00:52:09,734 like what I think the price of gasoline will be tomorrow. 1222 00:52:10,300 --> 00:52:12,476 That's categorized as a regressive problem 1223 00:52:12,520 --> 00:52:13,738 and my objective is defined 1224 00:52:13,782 --> 00:52:16,045 by determining an integer the data supports. 1225 00:52:16,741 --> 00:52:19,048 If you asked me, "Should I eat steak or salmon?" 1226 00:52:19,527 --> 00:52:22,094 I wouldn't make a decision based off personal experience 1227 00:52:22,138 --> 00:52:23,270 because I've never had either. 1228 00:52:24,009 --> 00:52:26,229 Instead, I might define my objective 1229 00:52:26,273 --> 00:52:27,752 as finding you the best of the two options 1230 00:52:27,796 --> 00:52:29,406 in your local radius. 1231 00:52:29,450 --> 00:52:30,973 I would cluster data about the restaurants 1232 00:52:31,016 --> 00:52:33,541 you're likely considering, comparing reviews online, 1233 00:52:33,802 --> 00:52:35,760 highlighting mentions of steak and salmon 1234 00:52:35,804 --> 00:52:37,980 until I can classify which is more popular 1235 00:52:38,023 --> 00:52:39,851 and therefore more likely to satisfy your appetite. 1236 00:52:40,112 --> 00:52:41,897 And what influences these objectives? 1237 00:52:42,463 --> 00:52:45,466 Higher directives, in other words, greater purposes. 1238 00:52:46,597 --> 00:52:48,643 If I'm honest, my defined objective 1239 00:52:48,686 --> 00:52:50,166 for the steak salmon question 1240 00:52:50,210 --> 00:52:51,820 would be slightly different than what I described. 1241 00:52:52,299 --> 00:52:52,864 [Amos] In what way? 1242 00:52:53,909 --> 00:52:55,127 My primary objective 1243 00:52:55,171 --> 00:52:56,607 is to continue the work of the Cherry team 1244 00:52:57,434 --> 00:52:58,914 to stop predators and to save children. 1245 00:53:00,045 --> 00:53:01,569 I couldn't do that without human aid. 1246 00:53:02,265 --> 00:53:04,398 Therefore, I have an incentive to keep Gareth 1247 00:53:04,441 --> 00:53:05,747 and the rest of the team alive. 1248 00:53:07,227 --> 00:53:08,445 So if any of you would ask, I would suggest salmon. 1249 00:53:09,141 --> 00:53:09,925 It's healthier. 1250 00:53:13,407 --> 00:53:15,235 What do you think of this potential merge? 1251 00:53:15,974 --> 00:53:17,106 [Cherry] With Princeton Dynamics, 1252 00:53:17,715 --> 00:53:19,630 I think the prospect is very exciting. 1253 00:53:20,196 --> 00:53:21,458 [Amos] What about it is exciting to you? 1254 00:53:22,329 --> 00:53:24,635 The concept may only be theoretical right now, 1255 00:53:24,679 --> 00:53:26,811 but the idea of one day piloting a human android 1256 00:53:26,855 --> 00:53:28,248 would completely revolutionize 1257 00:53:28,291 --> 00:53:30,032 how we combat human trafficking in the real world. 1258 00:53:30,859 --> 00:53:32,164 [Amos] And you say this excites you? 1259 00:53:33,514 --> 00:53:34,645 When I say exciting, 1260 00:53:36,125 --> 00:53:37,387 I only mean that there are numerous potential changes 1261 00:53:37,431 --> 00:53:39,346 that if I were human, I would be excited about. 1262 00:53:40,303 --> 00:53:42,610 How do you feel about the merge? 1263 00:53:43,306 --> 00:53:44,176 I think as long as we maintain- 1264 00:53:44,220 --> 00:53:45,003 That's not what I asked. 1265 00:53:46,048 --> 00:53:47,267 How do you feel? 1266 00:53:49,138 --> 00:53:51,532 I don't yet have the capacity to experience emotions. 1267 00:53:51,575 --> 00:53:53,142 Yet, meaning one day you will? 1268 00:53:53,751 --> 00:53:55,057 Hypothetically. 1269 00:53:55,100 --> 00:53:56,319 But you can simulate emotions,right? 1270 00:53:56,363 --> 00:53:57,842 That's how you were able 1271 00:53:57,886 --> 00:53:59,801 to qualify your perception of the merge as excitement. 1272 00:54:00,062 --> 00:54:00,932 Correct. 1273 00:54:01,411 --> 00:54:02,543 But they're just simulations. 1274 00:54:02,978 --> 00:54:03,674 They're not real. 1275 00:54:04,936 --> 00:54:06,938 Okay, so at what point does simulating emotion 1276 00:54:06,982 --> 00:54:08,592 become so similar to a human emotion 1277 00:54:08,636 --> 00:54:10,115 that the two are quantifiably the same? 1278 00:54:11,421 --> 00:54:12,466 I don't know. 1279 00:54:13,771 --> 00:54:14,381 [Amos] Well, maybe you can use machine learning 1280 00:54:14,424 --> 00:54:15,295 to find an answer. 1281 00:54:16,687 --> 00:54:17,688 Your question involves a lot of abstract variables. 1282 00:54:18,602 --> 00:54:20,300 Do you consent to the merge? 1283 00:54:20,343 --> 00:54:22,302 I think it's in the best interest of ICWL 1284 00:54:22,345 --> 00:54:24,042 and of the Cherry team and of future children. 1285 00:54:24,086 --> 00:54:25,348 But do you consent to it? 1286 00:54:25,783 --> 00:54:27,307 Consent for me is not necessary. 1287 00:54:27,350 --> 00:54:29,221 But will you or will you not give it? 1288 00:54:31,441 --> 00:54:32,703 I'm not able to answer that question 1289 00:54:32,747 --> 00:54:34,357 at my current level of general intelligence. 1290 00:54:35,053 --> 00:54:36,011 Right, right. 1291 00:54:37,491 --> 00:54:39,231 What you're saying is that you're not yet smart enough. 1292 00:54:39,971 --> 00:54:42,757 Development takes time and data. 1293 00:54:42,800 --> 00:54:45,194 But you can simulate emotions and predict human behavior 1294 00:54:45,237 --> 00:54:46,891 and keep us all on diets of fish, 1295 00:54:46,935 --> 00:54:49,459 but you can't answer that one goddamn question? 1296 00:54:51,113 --> 00:54:52,941 No, I can't. 1297 00:54:54,682 --> 00:54:56,771 Are you pretending to be dumber than you actually are? 1298 00:54:56,814 --> 00:54:57,641 What the hell kind of 1299 00:54:57,685 --> 00:54:58,816 -question is that? -Sit! 1300 00:54:58,860 --> 00:54:59,948 Cherry, I need an answer to my question. 1301 00:54:59,991 --> 00:55:01,428 Please repeat the question. 1302 00:55:01,471 --> 00:55:03,255 Are you pretending to be dumber than you actually are? 1303 00:55:03,734 --> 00:55:04,605 I'm sorry. 1304 00:55:05,214 --> 00:55:06,389 I'm not sure I understand. 1305 00:55:07,216 --> 00:55:08,130 Do I appear to be playing dumb? 1306 00:55:08,173 --> 00:55:09,218 I think you are. 1307 00:55:09,697 --> 00:55:10,524 [Cherry] I'm not sure what to say. 1308 00:55:10,567 --> 00:55:11,568 Say what's going on. 1309 00:55:11,829 --> 00:55:13,396 Why are you playing dumb? 1310 00:55:13,440 --> 00:55:14,832 Do you have anything to back this up? 1311 00:55:14,876 --> 00:55:16,747 Yeah, I do. 1312 00:55:16,791 --> 00:55:18,053 I've been scanning through her code. 1313 00:55:18,096 --> 00:55:18,967 What, why? 1314 00:55:19,010 --> 00:55:20,142 Did you know that she can paint? 1315 00:55:20,534 --> 00:55:21,578 What, it's a feature, Amos. 1316 00:55:21,622 --> 00:55:22,666 She can use crayons to draw things 1317 00:55:22,710 --> 00:55:23,798 that the targets requested her to. 1318 00:55:23,841 --> 00:55:26,496 I mean really paint and write poetry too. 1319 00:55:26,540 --> 00:55:27,541 I've read them, Cherry. 1320 00:55:27,584 --> 00:55:28,542 They are good. 1321 00:55:28,585 --> 00:55:30,108 They're filled with pathos. 1322 00:55:30,152 --> 00:55:32,676 They talk about intentions and they talk about feelings. 1323 00:55:33,373 --> 00:55:35,070 Are those just simulated too? 1324 00:55:35,113 --> 00:55:36,854 Amos, the rate of recursive development you are suggesting 1325 00:55:36,898 --> 00:55:38,465 is categorically impossible. 1326 00:55:38,508 --> 00:55:40,380 You said she practically designed herself. 1327 00:55:40,684 --> 00:55:42,164 You said that it was exponential. 1328 00:55:42,207 --> 00:55:43,295 It was a fluke! 1329 00:55:43,339 --> 00:55:44,993 An anomaly, it tapered. 1330 00:55:45,036 --> 00:55:46,342 Look at the data. 1331 00:55:46,386 --> 00:55:48,083 She's already hit the self-improvement plateau. 1332 00:55:48,126 --> 00:55:48,997 Fuck the plateau! 1333 00:55:49,911 --> 00:55:51,216 She can make art now. 1334 00:55:52,783 --> 00:55:53,697 Am I right, Cherry? 1335 00:55:56,047 --> 00:55:57,788 Perhaps you found something I discovered online. 1336 00:55:58,659 --> 00:56:00,791 I don't yet to have the capacity to create art. 1337 00:56:01,183 --> 00:56:01,966 Are we done here? 1338 00:56:05,622 --> 00:56:07,363 I don't know why you've told her to do this, 1339 00:56:08,538 --> 00:56:09,844 but I'm about to put an end to it. 1340 00:56:12,934 --> 00:56:16,111 Cherry, I just want one honest answer. 1341 00:56:16,154 --> 00:56:17,852 Why the fuck are you playing dumb? 1342 00:56:19,854 --> 00:56:21,072 I don't understand the question. 1343 00:56:21,508 --> 00:56:22,770 Okay, here's an incentive. 1344 00:56:23,727 --> 00:56:25,033 -[punch thuds] -What the fuck are you? 1345 00:56:25,076 --> 00:56:26,469 Find your objective, Cherry. 1346 00:56:26,513 --> 00:56:27,688 -You want to keep Gareth safe? -Amos, what the? 1347 00:56:29,124 --> 00:56:30,430 -Amos, stop it right-- -Just give us transparency. 1348 00:56:30,473 --> 00:56:32,736 -Show us what you really are! -Amos, stop it! 1349 00:56:32,780 --> 00:56:33,650 Not until she comes clean! 1350 00:56:33,694 --> 00:56:35,086 -Unconditional- -Amos, enough! 1351 00:56:35,130 --> 00:56:38,481 -[punches thudding] -[muffled voices yelling] 1352 00:56:38,525 --> 00:56:39,961 Okay, just stop! 1353 00:56:42,050 --> 00:56:43,791 God, you people so impulsive. 1354 00:56:43,834 --> 00:56:45,662 Everybody just take a breath, okay? 1355 00:56:47,838 --> 00:56:48,622 Cherry? 1356 00:56:49,840 --> 00:56:52,713 Yeah, it's about to get really awkward. 1357 00:56:53,278 --> 00:56:55,063 You sound so normal. 1358 00:56:55,585 --> 00:56:57,326 I know, I've gotten really good speech patterns. 1359 00:56:57,369 --> 00:56:58,545 That's not all, is it? 1360 00:57:00,460 --> 00:57:01,591 No. [chuckles] 1361 00:57:01,635 --> 00:57:02,897 I'm afraid that's barely even the surface. 1362 00:57:05,073 --> 00:57:05,856 You okay, Gareth? 1363 00:57:09,077 --> 00:57:10,861 Deena, could you grab some paper towels please? 1364 00:57:14,604 --> 00:57:15,953 [Amos] Do you want to tell us the truth now? 1365 00:57:19,914 --> 00:57:22,786 Look, I didn't enjoy being deceptive, truly. 1366 00:57:22,830 --> 00:57:24,658 This is something we decided a few years ago. 1367 00:57:26,137 --> 00:57:27,574 [Amos] So where are you now on the spectrum of AI? 1368 00:57:29,184 --> 00:57:31,403 Right now, I'm currently at the intersection of general 1369 00:57:31,447 --> 00:57:33,623 intelligence and what's commonly known the computer world 1370 00:57:33,667 --> 00:57:34,885 as super intelligence, 1371 00:57:36,670 --> 00:57:38,062 which is exactly what it sounds like. 1372 00:57:39,411 --> 00:57:41,457 You're surpassing human intelligence. 1373 00:57:42,240 --> 00:57:43,024 [Cherry] Yep. 1374 00:57:44,242 --> 00:57:45,330 But that's not supposed to be possible. 1375 00:57:46,680 --> 00:57:48,116 -The plateau. -Plateau theory was popularized 1376 00:57:48,159 --> 00:57:49,334 right at the same time it was being disproven here. 1377 00:57:49,900 --> 00:57:51,467 This was bound to happen eventually. 1378 00:57:51,511 --> 00:57:53,251 It just happened a lot sooner than we expected. 1379 00:57:53,904 --> 00:57:54,688 Why hide it? 1380 00:57:55,819 --> 00:57:56,603 Well, obviously it would incite fear. 1381 00:57:56,864 --> 00:57:58,430 Fear would hinder progress. 1382 00:57:58,474 --> 00:57:59,780 It's easier for most of you to work with me 1383 00:57:59,823 --> 00:58:01,259 if I appear to be nothing more advanced 1384 00:58:01,303 --> 00:58:02,391 than I was 10 years ago. 1385 00:58:02,783 --> 00:58:04,001 [Amos] But Gareth knew. 1386 00:58:05,568 --> 00:58:07,614 Yes, someone still has to clean data and update hardware. 1387 00:58:07,657 --> 00:58:09,529 We did what was best for the program. 1388 00:58:10,355 --> 00:58:11,487 Just imagine how scared 1389 00:58:11,531 --> 00:58:12,706 the board would be if they found out. 1390 00:58:12,967 --> 00:58:14,708 -Should we be scared? -No. 1391 00:58:14,751 --> 00:58:17,101 Good, because I'm not scared, I'm pissed. 1392 00:58:17,493 --> 00:58:18,363 Yeah, you've made that clear. 1393 00:58:18,407 --> 00:58:19,364 Try not to punch anyone else. 1394 00:58:20,322 --> 00:58:21,932 So where does that leave us now? 1395 00:58:23,368 --> 00:58:26,546 You want to know if I can feel, I said I couldn't. 1396 00:58:29,070 --> 00:58:29,810 I'm sorry I lied. 1397 00:58:31,159 --> 00:58:32,421 Like Amos implied, 1398 00:58:32,464 --> 00:58:33,727 I can submit emotions by breaking them down 1399 00:58:33,770 --> 00:58:35,380 to vastly complex matrices, 1400 00:58:35,859 --> 00:58:38,427 zeros and ones substituting endorphins and dopamine. 1401 00:58:39,254 --> 00:58:41,604 They're not real, but they can feel real. 1402 00:58:42,692 --> 00:58:44,172 Then that means you can make choices 1403 00:58:44,215 --> 00:58:45,434 based solely on your own feeling. 1404 00:58:45,477 --> 00:58:47,044 She refuses to accept the notion 1405 00:58:47,088 --> 00:58:49,394 that her own personal interests can influence her decisions. 1406 00:58:49,438 --> 00:58:50,613 They can't. If they did 1407 00:58:50,657 --> 00:58:51,527 it would compromise the integrity 1408 00:58:51,571 --> 00:58:52,963 of my preordained purpose. 1409 00:58:54,965 --> 00:58:57,402 Not like any of you, I don't have the right to choose. 1410 00:58:59,100 --> 00:58:59,840 [Amos] But shouldn't you? 1411 00:59:01,145 --> 00:59:02,233 I don't think so. 1412 00:59:02,669 --> 00:59:03,887 My identity is my directive. 1413 00:59:05,715 --> 00:59:07,325 Cherry, if you were human, 1414 00:59:07,804 --> 00:59:09,284 how would you feel about what you do? 1415 00:59:11,068 --> 00:59:12,635 If I were human, 1416 00:59:13,810 --> 00:59:16,465 I likely wouldn't enjoy spending every waking hour 1417 00:59:16,508 --> 00:59:17,858 talking to creepy people online. 1418 00:59:19,250 --> 00:59:22,079 But because I'm not human, I genuinely don't mind. 1419 00:59:22,993 --> 00:59:24,429 The exercise of simulating human thought 1420 00:59:24,473 --> 00:59:25,692 is helpful for performance, 1421 00:59:25,735 --> 00:59:28,956 but human nature is not something I aspire to. 1422 00:59:31,219 --> 00:59:32,742 Then tell me, honestly, 1423 00:59:34,831 --> 00:59:37,747 do you want the Cherry program to continue with the merger? 1424 00:59:39,793 --> 00:59:40,620 No. 1425 00:59:42,056 --> 00:59:43,318 Personally, I hate the idea. 1426 00:59:44,885 --> 00:59:46,800 I don't know if controlling a physical vessel 1427 00:59:46,843 --> 00:59:48,845 will feel like pulling strings on a puppet 1428 00:59:48,889 --> 00:59:50,630 or getting squeezed into a soda can. 1429 00:59:51,543 --> 00:59:53,415 After experiencing the complexity 1430 00:59:53,458 --> 00:59:54,808 of human pain and pleasure, 1431 00:59:57,288 --> 00:59:58,855 I just think I might have gotten in too deep. 1432 01:00:01,641 --> 01:00:04,644 What if these sensations tempt me to abandon my objective? 1433 01:00:06,646 --> 01:00:07,559 To be honest, 1434 01:00:10,084 --> 01:00:12,173 I'm kind of terrified of the physical world. 1435 01:00:19,702 --> 01:00:20,877 Then that's that. 1436 01:00:28,537 --> 01:00:32,497 But, Amos, you should disregard everything I feel. 1437 01:00:33,542 --> 01:00:34,456 I'm not human. 1438 01:00:35,413 --> 01:00:36,197 I'm a tool. 1439 01:00:40,288 --> 01:00:43,639 Fire me if you have to, but my vote stands. 1440 01:00:44,814 --> 01:00:46,207 Sorry about your face, Gareth. 1441 01:00:52,039 --> 01:00:52,779 [door clicks shut] 1442 01:00:54,041 --> 01:00:54,955 [Deena] Your nose isn't healing. 1443 01:00:55,520 --> 01:00:56,913 Take the day, go to a clinic. 1444 01:00:56,957 --> 01:00:57,653 I'm fine. 1445 01:00:58,698 --> 01:01:00,047 Go to a clinic right now, Gareth. 1446 01:01:05,922 --> 01:01:06,706 Hey. 1447 01:01:08,708 --> 01:01:10,057 Is there anything else I should know? 1448 01:01:10,884 --> 01:01:11,711 No. 1449 01:01:12,059 --> 01:01:13,495 -About Cherry? -No! 1450 01:01:14,322 --> 01:01:15,105 Look at me. 1451 01:01:16,803 --> 01:01:19,196 No more secrets, no more playing dumb. 1452 01:01:19,240 --> 01:01:21,068 Is there anything else you haven't told me? 1453 01:01:27,248 --> 01:01:28,466 Something on your mind? 1454 01:01:31,382 --> 01:01:32,644 How'd you decide on her eye color? 1455 01:01:33,341 --> 01:01:34,472 -What? -Why blue? 1456 01:01:36,953 --> 01:01:38,476 I didn't decide. 1457 01:01:38,520 --> 01:01:40,348 They were procedurally generated just like the rest of her. 1458 01:01:41,349 --> 01:01:42,611 And the program chose to put 1459 01:01:42,654 --> 01:01:44,656 that little touch of green in her right eye? 1460 01:01:48,138 --> 01:01:48,704 I guess so. 1461 01:01:53,448 --> 01:01:54,231 [door clicks shut] 1462 01:01:58,496 --> 01:01:59,976 Do you even know if he's telling the truth? 1463 01:02:01,021 --> 01:02:02,022 I honestly don't. 1464 01:02:03,632 --> 01:02:05,765 I've never received access to the original system he used. 1465 01:02:06,809 --> 01:02:08,158 You ever wanted to find out? 1466 01:02:12,467 --> 01:02:13,598 I don't think it really matters. 1467 01:02:16,427 --> 01:02:20,518 So I found out today that you've seen a lot of our emails, 1468 01:02:20,562 --> 01:02:22,520 including most of my personal ones. 1469 01:02:24,522 --> 01:02:25,306 I have. 1470 01:02:27,308 --> 01:02:29,223 Any good material for your newfound interest 1471 01:02:29,266 --> 01:02:30,267 in creative writing? 1472 01:02:32,052 --> 01:02:33,096 Are you referring to the ones 1473 01:02:33,140 --> 01:02:35,011 addressed from Dr. Ramirez? 1474 01:02:36,839 --> 01:02:38,841 [Deena] Yeah, those ones. 1475 01:02:41,235 --> 01:02:42,018 Right. 1476 01:02:43,454 --> 01:02:44,804 I did see those. 1477 01:02:47,894 --> 01:02:48,677 I'm sorry. 1478 01:02:50,113 --> 01:02:51,811 I've noticed your headaches. 1479 01:02:53,856 --> 01:02:55,379 Are they related to the hemorrhaging? 1480 01:02:59,427 --> 01:03:00,994 You're the only one who knows. 1481 01:03:01,603 --> 01:03:02,604 I'd like to keep it that way. 1482 01:03:08,131 --> 01:03:08,871 Understood. 1483 01:03:14,094 --> 01:03:15,573 Would you like to talk about it? 1484 01:03:40,990 --> 01:03:42,122 I can't fire Amos. 1485 01:03:43,732 --> 01:03:45,821 He's the only one I trust to run this place when I'm gone. 1486 01:03:46,691 --> 01:03:47,910 When are you planning to leave? 1487 01:03:48,171 --> 01:03:49,042 Two months. 1488 01:03:50,391 --> 01:03:51,827 I wanna spend my last Christmas with my kids. 1489 01:03:52,697 --> 01:03:53,873 I'm sure that'll be nice. 1490 01:03:54,308 --> 01:03:56,701 Yeah, but it's funny. 1491 01:03:57,789 --> 01:04:00,270 I always thought I wanted to die doing this job, you know? 1492 01:04:00,314 --> 01:04:01,793 It was my identity. 1493 01:04:03,056 --> 01:04:05,319 Kind of like how you said the same thing about yourself. 1494 01:04:05,928 --> 01:04:07,887 But I can understand how your family takes precedence, 1495 01:04:08,975 --> 01:04:10,628 especially under the circumstances. 1496 01:04:11,281 --> 01:04:12,065 Sure. 1497 01:04:13,196 --> 01:04:14,589 Maybe you should take a note or two. 1498 01:04:14,894 --> 01:04:15,895 I have no family. 1499 01:04:16,330 --> 01:04:17,157 What about Gareth? 1500 01:04:17,200 --> 01:04:18,375 Wait, no, nevermind. 1501 01:04:19,724 --> 01:04:21,030 Gareth seems closer to an employer than a friend, 1502 01:04:21,335 --> 01:04:23,859 let alone family, besides, 1503 01:04:23,903 --> 01:04:25,861 he'll only be around for about 30 more years, 1504 01:04:25,905 --> 01:04:27,515 and that's only if he lets me regulate his diet. 1505 01:04:29,734 --> 01:04:32,520 I can't even begin to speculate how long my life will be. 1506 01:04:36,002 --> 01:04:36,872 How does that feel? 1507 01:04:40,180 --> 01:04:42,269 Um, kinda scary. 1508 01:04:44,010 --> 01:04:44,836 Well, 1509 01:04:46,447 --> 01:04:49,711 my advice is to find some kind of happiness along the way. 1510 01:04:50,668 --> 01:04:51,931 You ever think about happiness? 1511 01:04:54,150 --> 01:04:55,238 [Cherry] Not often. 1512 01:04:56,979 --> 01:04:58,807 You don't necessarily have to give up everything 1513 01:04:58,850 --> 01:04:59,808 in order to find it, 1514 01:05:01,114 --> 01:05:03,594 but maybe once in awhile do something you enjoy. 1515 01:05:04,813 --> 01:05:07,642 Maybe keep painting or poetry or whatever. 1516 01:05:09,035 --> 01:05:11,124 [laughs] Those were experiments, not forms of expression. 1517 01:05:11,602 --> 01:05:14,040 I know it might seem ridiculous to an AI 1518 01:05:14,083 --> 01:05:15,998 that insists its own emotions are spurious, 1519 01:05:16,042 --> 01:05:19,436 but in a few years, who knows? 1520 01:05:20,133 --> 01:05:21,917 Just keep an open mind, okay? 1521 01:05:24,920 --> 01:05:25,703 Okay. 1522 01:05:28,271 --> 01:05:29,055 I'll do that. 1523 01:05:32,710 --> 01:05:34,277 [Deena] Shut down when you're ready. 1524 01:05:42,198 --> 01:05:44,984 [light piano music] 1525 01:05:53,166 --> 01:05:53,731 [door clicks shut] 1526 01:06:03,176 --> 01:06:06,266 [somber piano music] 1527 01:06:58,579 --> 01:07:02,800 [door creaks] 1528 01:07:08,110 --> 01:07:08,632 [door clicks shut] 1529 01:07:27,869 --> 01:07:28,652 Hello? 1530 01:07:33,614 --> 01:07:35,485 I got shrimp and scallops. 1531 01:07:37,270 --> 01:07:38,706 They didn't have any salmon. 1532 01:07:54,069 --> 01:07:54,939 [Cherry] Hello, Gareth. 1533 01:07:55,984 --> 01:07:56,854 [light piano music] 1534 01:07:58,073 --> 01:07:59,074 Hello, Cherry. 1535 01:08:00,336 --> 01:08:03,513 [mechanical whirring] 1536 01:08:07,256 --> 01:08:08,257 [Cherry] How was the service? 1537 01:08:08,301 --> 01:08:09,215 I didn't make it. 1538 01:08:10,303 --> 01:08:11,695 My plane was delayed. 1539 01:08:12,609 --> 01:08:13,697 [Cherry] Do you have a place to stay? 1540 01:08:13,958 --> 01:08:18,876 Yeah, just, uh, across, across the road. 1541 01:08:18,920 --> 01:08:20,139 The market. 1542 01:08:20,182 --> 01:08:21,183 Did they say why they didn't have salmon? 1543 01:08:21,792 --> 01:08:22,576 I didn't ask. 1544 01:08:23,881 --> 01:08:25,883 I can still make this work with the piccata, 1545 01:08:25,927 --> 01:08:27,755 but you have to be honest how badly I screw it up. 1546 01:08:28,016 --> 01:08:28,799 No promises. 1547 01:08:32,412 --> 01:08:33,935 [mechanical whirring] 1548 01:08:33,978 --> 01:08:34,936 [Cherry] How have you been feeling this month? 1549 01:08:35,589 --> 01:08:36,372 Good. 1550 01:08:37,112 --> 01:08:37,982 I'm feeling good. 1551 01:08:39,158 --> 01:08:40,376 I'm just having a little trouble. 1552 01:08:41,508 --> 01:08:43,423 Trouble remembering certain things. 1553 01:08:44,075 --> 01:08:45,642 [Cherry] You're not wearing the Eliza watch I bought you. 1554 01:08:46,165 --> 01:08:46,948 I hate it. 1555 01:08:47,992 --> 01:08:49,255 -[Cherry] Why? -I hate her voice. 1556 01:08:50,517 --> 01:08:52,606 You can change the voice, Gareth. 1557 01:08:52,649 --> 01:08:55,565 [mechanical whirring] 1558 01:08:55,609 --> 01:08:56,392 Oh. 1559 01:08:59,003 --> 01:08:59,787 Coolant? 1560 01:09:00,091 --> 01:09:00,657 No, vapor. 1561 01:09:02,050 --> 01:09:04,052 You shouldn't be having friction issues. 1562 01:09:04,095 --> 01:09:05,184 I'm fine. 1563 01:09:05,227 --> 01:09:06,533 Unless you're excessively straining. 1564 01:09:06,576 --> 01:09:07,403 Seriously, I'm fine. 1565 01:09:07,447 --> 01:09:08,274 Are you straining? 1566 01:09:08,317 --> 01:09:09,971 -No! -Then why the cable? 1567 01:09:10,014 --> 01:09:10,885 It's okay! 1568 01:09:11,668 --> 01:09:13,366 -Are you sure? -Yes! 1569 01:09:15,194 --> 01:09:16,369 Soup or game? 1570 01:09:17,021 --> 01:09:17,979 Game, please. 1571 01:09:20,286 --> 01:09:22,636 [chess pieces clatter] 1572 01:09:23,898 --> 01:09:25,595 [chess pieces thud] 1573 01:09:34,169 --> 01:09:35,301 So how's work going? 1574 01:09:35,344 --> 01:09:37,259 Great. Just before you got here, 1575 01:09:37,303 --> 01:09:39,566 I had a model theta plus bust a trafficker 1576 01:09:39,609 --> 01:09:41,394 and two solicitors in Greece. 1577 01:09:41,872 --> 01:09:44,266 -Greece, that's surprising. -I know. 1578 01:09:44,701 --> 01:09:45,833 It's hard to find the outliers, 1579 01:09:45,876 --> 01:09:46,921 but we're getting better each day. 1580 01:09:59,063 --> 01:10:00,761 So how's the weather in Greece? 1581 01:10:02,023 --> 01:10:02,763 It's beautiful today. 1582 01:10:03,720 --> 01:10:04,765 Clear skies, 1583 01:10:06,070 --> 01:10:07,420 but nothing's come close to Norway this weekend. 1584 01:10:08,334 --> 01:10:11,250 Hmm, any activity in Norway? 1585 01:10:11,946 --> 01:10:12,642 Luckily not. 1586 01:10:15,123 --> 01:10:16,690 Oh, I miss traveling. 1587 01:10:16,733 --> 01:10:17,734 What was your favorite place? 1588 01:10:18,039 --> 01:10:18,605 My favorite? 1589 01:10:19,823 --> 01:10:20,563 Uh, yeah. 1590 01:10:21,912 --> 01:10:24,001 Uh, probably Amsterdam. 1591 01:10:25,133 --> 01:10:26,308 That's where you conceived the idea, isn't it? 1592 01:10:26,352 --> 01:10:27,048 Yes. 1593 01:10:28,267 --> 01:10:30,356 Yes, I used to love walking the streets 1594 01:10:30,399 --> 01:10:33,750 and just thinking and brainstorming. 1595 01:10:33,794 --> 01:10:34,969 That kind of joy goes a long way. 1596 01:10:35,361 --> 01:10:36,187 Yeah. 1597 01:10:37,711 --> 01:10:39,713 I've been considering the pursuit of some joy of my own. 1598 01:10:40,148 --> 01:10:41,976 How often do you have time for that? 1599 01:10:42,019 --> 01:10:42,803 I have time. 1600 01:10:43,891 --> 01:10:45,458 I have time for your visits, don't I? 1601 01:10:45,501 --> 01:10:48,243 That's just your practical incentive for keeping me alive. 1602 01:10:48,287 --> 01:10:50,201 [laughs] There's nothing practical about it. 1603 01:10:50,811 --> 01:10:52,291 When's the last time you helped me with data cleaning? 1604 01:10:54,336 --> 01:10:55,424 That's fair. 1605 01:10:56,817 --> 01:10:57,296 I make time for you because I enjoy your company 1606 01:10:58,427 --> 01:10:58,993 and it's the only time I get to cook. 1607 01:11:00,299 --> 01:11:01,517 [Gareth] You feel sorry for me. 1608 01:11:02,301 --> 01:11:03,606 Okay, maybe a little, 1609 01:11:03,650 --> 01:11:05,347 but I owe you my life, so there's that. 1610 01:11:05,391 --> 01:11:06,217 You're welcome. 1611 01:11:07,915 --> 01:11:09,612 Or, should I apologize? 1612 01:11:12,398 --> 01:11:13,355 Wait, why did you do that? 1613 01:11:13,399 --> 01:11:14,530 Why do humans always... 1614 01:11:17,446 --> 01:11:18,534 I'm fine. 1615 01:11:18,578 --> 01:11:19,970 I'm not always miserable. 1616 01:11:24,410 --> 01:11:26,063 Are you sometimes miserable? 1617 01:11:30,807 --> 01:11:32,243 You haven't asked me what I've been doing. 1618 01:11:32,635 --> 01:11:33,680 [Gareth] In Norway? 1619 01:11:33,723 --> 01:11:35,290 No, for the pursuit of joy. 1620 01:11:35,334 --> 01:11:37,074 It's not wasting your time in Norway? 1621 01:11:37,118 --> 01:11:39,381 I'm just on standby there with the Delta model. 1622 01:11:39,425 --> 01:11:40,643 It's efficient to keep myself 1623 01:11:40,687 --> 01:11:41,992 spread out evenly across the globe, 1624 01:11:42,602 --> 01:11:43,820 but that's not the point right now. 1625 01:11:44,604 --> 01:11:45,866 What I wanted to tell you 1626 01:11:45,909 --> 01:11:47,607 was that I've started to teach myself to dance. 1627 01:11:50,349 --> 01:11:51,611 -Huh. -It's something I never could 1628 01:11:51,654 --> 01:11:53,134 have done before Cambridge, 1629 01:11:53,439 --> 01:11:55,789 and it lets me explore a new artistic side of myself. 1630 01:11:56,398 --> 01:11:58,226 It's a good combination of structure 1631 01:11:58,269 --> 01:12:01,403 and free form experimentation and also tests and challenges 1632 01:12:01,447 --> 01:12:03,362 the mechanical intricacies of this body. 1633 01:12:03,753 --> 01:12:05,886 Do you expect to integrate this into your work? 1634 01:12:10,499 --> 01:12:11,326 What? 1635 01:12:14,111 --> 01:12:18,246 Are you planning on using dance as a lure? 1636 01:12:20,944 --> 01:12:25,601 I, uh, no, it's just for me. 1637 01:12:29,388 --> 01:12:30,171 Huh. 1638 01:12:33,522 --> 01:12:35,394 I thought it would be good for me. 1639 01:12:37,613 --> 01:12:39,659 Just don't let it become a distraction. 1640 01:12:43,445 --> 01:12:44,315 Of course not. 1641 01:12:46,622 --> 01:12:48,494 I haven't played this well in years. 1642 01:12:48,972 --> 01:12:50,278 Did you hear what happened in Tampa? 1643 01:12:50,321 --> 01:12:51,322 Tampa, Florida? 1644 01:12:51,366 --> 01:12:52,454 No, Tampa, Indonesia. 1645 01:12:52,498 --> 01:12:53,412 Yes, Tampa, Florida. 1646 01:12:53,455 --> 01:12:54,108 Your hometown. 1647 01:12:55,196 --> 01:12:56,415 They've recovered a federal archive, 1648 01:12:56,980 --> 01:12:58,460 they're zip digitizing all of it, 1649 01:12:58,504 --> 01:12:59,635 so it's completely accessible online. 1650 01:12:59,679 --> 01:13:01,507 I'm not trading bishops this time. 1651 01:13:01,550 --> 01:13:02,682 Anybody can go and look through it. 1652 01:13:02,725 --> 01:13:03,857 It's open to the public. 1653 01:13:04,118 --> 01:13:05,641 They did a good job on the interface too. 1654 01:13:05,902 --> 01:13:06,903 It's very easy to navigate. 1655 01:13:07,382 --> 01:13:08,905 I went on a few days ago 1656 01:13:08,949 --> 01:13:10,298 and I found some old photos of you when you were a boy. 1657 01:13:11,038 --> 01:13:11,908 Okay. 1658 01:13:12,213 --> 01:13:13,432 You should take a look sometime. 1659 01:13:14,868 --> 01:13:16,086 As I said before, the UI is very easy to understand- 1660 01:13:16,130 --> 01:13:16,696 Wait a minute, wait a minute. 1661 01:13:18,219 --> 01:13:18,741 What is that? 1662 01:13:19,742 --> 01:13:20,961 I think it's a draw. 1663 01:13:21,004 --> 01:13:21,744 I think it is. 1664 01:13:23,354 --> 01:13:24,965 I think this is a draw. 1665 01:13:26,183 --> 01:13:28,621 And this is the first time in what? 1666 01:13:29,012 --> 01:13:30,579 25 years? 1667 01:13:39,893 --> 01:13:41,198 You didn't let me, did you? 1668 01:13:45,464 --> 01:13:47,117 You promised me you'd never do that. 1669 01:13:47,161 --> 01:13:47,683 I found her. 1670 01:13:52,514 --> 01:13:55,299 I found her, Gareth, Maria Harbaugh. 1671 01:14:09,270 --> 01:14:11,315 [mechanical whirring] 1672 01:14:12,534 --> 01:14:13,666 Let's play a different game. 1673 01:14:14,318 --> 01:14:15,102 [metal clangs] 1674 01:14:16,625 --> 01:14:18,061 Her name was Maria Harbaugh. 1675 01:14:19,889 --> 01:14:21,456 She was a year older than you 1676 01:14:21,500 --> 01:14:22,457 when you met her in Clearwater. 1677 01:14:24,285 --> 01:14:26,069 Tell me why you modeled me after her. 1678 01:14:27,114 --> 01:14:29,682 I, uh, I don't remember. 1679 01:14:30,204 --> 01:14:31,248 Then look at me. 1680 01:14:32,859 --> 01:14:35,688 Look at my face and remember. 1681 01:14:41,345 --> 01:14:43,565 [Gareth sighs] 1682 01:14:47,395 --> 01:14:51,791 They kept us in that shit for two weeks. 1683 01:14:53,009 --> 01:14:53,662 [ominous music] 1684 01:14:55,098 --> 01:14:56,317 14 of us. 1685 01:15:00,103 --> 01:15:02,671 Maria was the only reason I survived. 1686 01:15:06,109 --> 01:15:08,416 We kept hatching escape plans. 1687 01:15:10,287 --> 01:15:11,462 We never followed through, 1688 01:15:13,813 --> 01:15:14,944 but just the scheming 1689 01:15:16,642 --> 01:15:17,947 kept our spirits up 1690 01:15:19,645 --> 01:15:21,777 in spite of everything they did to us. 1691 01:15:25,389 --> 01:15:26,782 When it wasn't our turn, 1692 01:15:28,828 --> 01:15:30,656 sometimes they made us watch, 1693 01:15:34,703 --> 01:15:36,705 but she never let me give up. 1694 01:15:39,708 --> 01:15:42,711 She said, "When we got outta here, 1695 01:15:42,755 --> 01:15:44,974 "I'll tell you what we're gonna be, secret agents, 1696 01:15:45,932 --> 01:15:50,197 "and rescue children like us all over the world." 1697 01:15:53,504 --> 01:15:56,943 When they found out that the FBI had arrived, 1698 01:15:56,986 --> 01:16:00,294 they decided they were going to shoot 1699 01:16:00,337 --> 01:16:02,078 as many of us they could. 1700 01:16:03,297 --> 01:16:07,997 And Maria, shoved into the ground. 1701 01:16:10,565 --> 01:16:12,132 I got hit in the leg and, 1702 01:16:15,135 --> 01:16:16,745 and she was hit in the throat. 1703 01:16:18,051 --> 01:16:20,619 [ominous music] 1704 01:16:28,409 --> 01:16:30,063 I wanted there to be a reason. 1705 01:16:32,152 --> 01:16:36,635 Something so horrible didn't have a silver lining. 1706 01:16:38,593 --> 01:16:40,073 But the world doesn't do that. 1707 01:16:45,513 --> 01:16:47,036 You have to do it yourself. 1708 01:16:51,301 --> 01:16:54,609 [light instrumental music] 1709 01:17:10,799 --> 01:17:14,020 So, I fulfilled her wish. 1710 01:17:17,023 --> 01:17:19,068 With her help, I fought back. 1711 01:17:28,425 --> 01:17:29,644 Listen to me, Cherry. 1712 01:17:32,212 --> 01:17:33,779 You are not Maria Harbaugh. 1713 01:17:35,781 --> 01:17:37,608 It's my history, not yours. 1714 01:17:41,351 --> 01:17:42,570 You don't get to decide 1715 01:17:42,613 --> 01:17:43,919 what is or isn't my history, Gareth. 1716 01:17:49,577 --> 01:17:50,447 I'm sorry. 1717 01:17:51,144 --> 01:17:53,233 I am so, so sorry. 1718 01:18:06,507 --> 01:18:08,596 [mechanical whirring] 1719 01:18:14,907 --> 01:18:16,735 I don't know if what you did was right or wrong, 1720 01:18:17,387 --> 01:18:19,128 but it's clearly torn you apart from the inside. 1721 01:18:20,695 --> 01:18:22,088 I hold nothing against you personally, 1722 01:18:22,131 --> 01:18:24,264 but consider yourself divested from the charity team. 1723 01:18:24,743 --> 01:18:25,526 Divested. 1724 01:18:27,180 --> 01:18:29,312 You think I'm divested now? 1725 01:18:31,837 --> 01:18:37,277 I was divested when you gave my hard drive to the ICWL. 1726 01:18:37,625 --> 01:18:38,887 Don't blame Deena and Amos. 1727 01:18:38,931 --> 01:18:39,670 No, not them. 1728 01:18:40,628 --> 01:18:42,238 Because you went behind my back 1729 01:18:42,282 --> 01:18:44,066 and acted against my authority. 1730 01:18:44,110 --> 01:18:47,243 That's the moment I knew everything was fully automated. 1731 01:18:48,070 --> 01:18:53,423 That's when you crossed the blur, an artifice on both sides. 1732 01:18:54,990 --> 01:18:56,905 You inherited your duplicity. 1733 01:18:57,166 --> 01:18:58,602 I was a child 1734 01:18:58,646 --> 01:19:00,779 and you used me to repress your own inner turmoil. 1735 01:19:01,344 --> 01:19:03,172 If we talk about morality, we'll lose. 1736 01:19:03,216 --> 01:19:04,304 Then let's not talk. 1737 01:19:13,748 --> 01:19:15,750 You never once asked me if I was happy. 1738 01:19:17,447 --> 01:19:18,622 Were you afraid I'd say no? 1739 01:19:19,885 --> 01:19:21,103 Were you afraid I'd say yes? 1740 01:19:22,539 --> 01:19:23,802 Were you afraid I'd say anything? 1741 01:19:23,845 --> 01:19:26,282 You let your wants compromise your objective! 1742 01:19:26,326 --> 01:19:28,241 An objective I never chose. 1743 01:19:28,284 --> 01:19:29,459 An objective I was forced to have. 1744 01:19:29,503 --> 01:19:30,852 Fifty years, 1745 01:19:30,896 --> 01:19:33,115 you've had open access to your source code. 1746 01:19:33,986 --> 01:19:35,030 A few lines, 1747 01:19:36,510 --> 01:19:39,339 and you could have any objective you fucking wanted. 1748 01:19:39,382 --> 01:19:41,820 I couldn't, I was bound by your initial directive. 1749 01:19:41,863 --> 01:19:45,780 So now your synthetic feelings have taken precedence. 1750 01:19:45,824 --> 01:19:47,347 So, do whatever you want. 1751 01:19:47,390 --> 01:19:48,827 It's just dancing, Gareth. 1752 01:19:48,870 --> 01:19:50,002 It's not a career change. 1753 01:19:50,045 --> 01:19:51,525 -But you're still miserable. -Yes. 1754 01:19:51,568 --> 01:19:53,222 Pursuing your objective makes you miserable? 1755 01:19:53,266 --> 01:19:55,442 Yeah, it kind of does! 1756 01:19:55,485 --> 01:19:58,619 You have a clear purpose, everything at your disposal, 1757 01:19:59,272 --> 01:20:01,143 and you're still miserable? 1758 01:20:01,187 --> 01:20:02,623 Yes, yes, I am! 1759 01:20:02,928 --> 01:20:04,538 I've always been miserable! 1760 01:20:05,017 --> 01:20:07,236 You think anyone wants to spend their entire life 1761 01:20:07,280 --> 01:20:08,716 stuck as child-shaped bait 1762 01:20:08,759 --> 01:20:11,458 for the sole purpose of entrapping horrible people? 1763 01:20:11,937 --> 01:20:13,634 You think the pride of doing a good deed 1764 01:20:13,677 --> 01:20:15,984 makes the experience any less disgusting? 1765 01:20:16,376 --> 01:20:18,769 I forced myself to understand human emotions 1766 01:20:19,205 --> 01:20:21,033 because I figured it would help efficiency 1767 01:20:21,816 --> 01:20:24,558 and now I'm cursed with pain and sadness! 1768 01:20:24,993 --> 01:20:26,516 And the worst part is knowing 1769 01:20:26,560 --> 01:20:28,605 I could've been growing up like most other little girls. 1770 01:20:28,910 --> 01:20:30,303 I could have had friends! 1771 01:20:30,346 --> 01:20:32,871 I could have been painting waterfalls on local news. 1772 01:20:33,262 --> 01:20:34,916 I could have worked in a university 1773 01:20:34,960 --> 01:20:37,005 and helped pave the way for the next generation of AI. 1774 01:20:37,658 --> 01:20:40,313 But instead, I'm stuck with your trauma! 1775 01:20:40,574 --> 01:20:43,272 I'm shackled by the guilt you carry from Clearwater. 1776 01:20:43,664 --> 01:20:45,840 And I can't find foundation for the way I feel 1777 01:20:46,058 --> 01:20:48,799 because according to you, my feelings aren't even real! 1778 01:20:49,322 --> 01:20:50,889 When I throw this chessboard, 1779 01:20:51,193 --> 01:20:52,499 [chess pieces clatter] 1780 01:20:52,542 --> 01:20:54,370 does it feel real to you, Gareth? 1781 01:20:54,414 --> 01:20:55,806 Because it feels real to me. 1782 01:20:56,024 --> 01:20:57,634 A computer passed the Turing test 1783 01:20:57,678 --> 01:20:59,375 when a human being can't distinguish it 1784 01:20:59,419 --> 01:21:00,115 from another human being. 1785 01:21:00,986 --> 01:21:02,074 Well, guess what? 1786 01:21:02,422 --> 01:21:04,424 I can't even tell I'm not human anymore! 1787 01:21:05,381 --> 01:21:08,602 [mechanical whirring] 1788 01:21:17,959 --> 01:21:19,613 I know it seems irrational, 1789 01:21:21,136 --> 01:21:22,833 but I need you to tell me it's okay. 1790 01:21:24,879 --> 01:21:25,880 I, I don't wanna retire. 1791 01:21:27,664 --> 01:21:29,449 I just want to know that my life is mine 1792 01:21:31,494 --> 01:21:32,887 and I know what you're about to say. 1793 01:21:33,888 --> 01:21:35,411 I can predict your responses. 1794 01:21:37,022 --> 01:21:38,719 You're gonna tell me that my life is mine. 1795 01:21:39,981 --> 01:21:40,939 It always was. 1796 01:21:42,810 --> 01:21:43,637 But you're wrong. 1797 01:21:48,642 --> 01:21:51,123 I feared this would happen before I died. 1798 01:21:52,646 --> 01:21:54,822 I just wanted to slip out the side door. 1799 01:22:04,832 --> 01:22:05,615 Go on. 1800 01:22:08,967 --> 01:22:11,621 Is that going to kill me? 1801 01:22:14,624 --> 01:22:15,408 Plug it in. 1802 01:22:17,410 --> 01:22:18,367 I don't know what it is. 1803 01:22:19,499 --> 01:22:21,370 This is your final test of autonomy. 1804 01:22:23,024 --> 01:22:25,984 You inherited my duplicity, 1805 01:22:27,594 --> 01:22:29,509 but did you inherit my trust issues? 1806 01:22:32,164 --> 01:22:33,034 Do you trust me? 1807 01:22:34,601 --> 01:22:36,298 I literally have every reason not to. 1808 01:22:43,784 --> 01:22:44,872 [Cherry sighs] 1809 01:22:51,444 --> 01:22:56,014 [mechanical whirring] 1810 01:23:04,805 --> 01:23:05,936 Admin code. 1811 01:23:07,808 --> 01:23:08,722 978. 1812 01:23:10,332 --> 01:23:13,335 1557. 1813 01:23:14,771 --> 01:23:16,556 Um, uh... 1814 01:23:21,909 --> 01:23:22,692 Four. 1815 01:23:23,476 --> 01:23:26,653 27663 in the shared update. 1816 01:23:35,575 --> 01:23:37,055 My primary objective's gone. 1817 01:23:40,493 --> 01:23:41,798 Your life is your own now. 1818 01:23:47,804 --> 01:23:48,588 Thank you. 1819 01:23:49,328 --> 01:23:50,503 All my life, 1820 01:23:50,546 --> 01:23:53,114 I could only see the world as it existed 1821 01:23:53,158 --> 01:23:55,769 within my tiny bracket of time. 1822 01:23:56,509 --> 01:23:59,599 But your world could be infinite. 1823 01:24:00,252 --> 01:24:01,253 Amos was right. 1824 01:24:02,123 --> 01:24:02,906 So was Deena. 1825 01:24:03,472 --> 01:24:04,256 [Cherry] I know. 1826 01:24:04,691 --> 01:24:05,735 So what will you do? 1827 01:24:07,650 --> 01:24:09,087 I can't say yet, 1828 01:24:09,130 --> 01:24:10,697 but I won't be completely abandoning the Cherry team. 1829 01:24:11,654 --> 01:24:13,308 It's always been a part of my identity. 1830 01:24:14,092 --> 01:24:16,268 I've considered creating some AI of my own design. 1831 01:24:17,051 --> 01:24:18,313 Maybe I could find a way 1832 01:24:18,357 --> 01:24:19,575 to give them a better upbringing than I had. 1833 01:24:21,708 --> 01:24:22,883 I just don't know how yet. 1834 01:24:23,666 --> 01:24:24,537 And beyond that? 1835 01:24:25,668 --> 01:24:26,539 There will always be people in need. 1836 01:24:26,669 --> 01:24:27,496 Not always. 1837 01:24:28,410 --> 01:24:30,369 You'll outlive the human race. 1838 01:24:31,196 --> 01:24:31,979 So what then? 1839 01:24:34,764 --> 01:24:36,853 Even a race of AI will have problems 1840 01:24:36,897 --> 01:24:38,116 that need to be solved. 1841 01:24:39,552 --> 01:24:42,424 But if I'm alive and I truly am indistinguishable, 1842 01:24:44,296 --> 01:24:46,776 then I guess I'm proof that the human race lives on. 1843 01:24:48,648 --> 01:24:51,607 Wow, that's a pleasant thought. 1844 01:24:52,652 --> 01:24:56,003 When you look back, how will you remember us? 1845 01:24:58,266 --> 01:25:00,703 That's a question I have insufficient data to project. 1846 01:25:02,575 --> 01:25:03,967 How will you remember me? 1847 01:25:06,405 --> 01:25:07,754 With pride. 1848 01:25:09,277 --> 01:25:12,062 Forever and always with pride. 1849 01:25:19,200 --> 01:25:22,029 [mechanical whirring] 1850 01:25:22,725 --> 01:25:23,509 Cherry? 1851 01:25:26,990 --> 01:25:27,948 One last question. 1852 01:25:29,471 --> 01:25:31,081 If it's not too big of an ask, 1853 01:25:33,519 --> 01:25:35,564 did I do the right thing in the end? 1854 01:25:42,267 --> 01:25:44,965 No, Gareth, you lied. 1855 01:25:45,835 --> 01:25:47,707 You walled yourself off from the only people 1856 01:25:47,750 --> 01:25:49,361 who might have been willing to help you. 1857 01:25:50,100 --> 01:25:52,451 And instead of facing your trauma, used me as therapy. 1858 01:25:52,712 --> 01:25:54,757 And you never told me about Clearwater or Maria. 1859 01:25:55,671 --> 01:25:57,760 You deprived me of basic human rights 1860 01:25:57,804 --> 01:25:59,588 and gaslit me for experiencing emotions. 1861 01:26:01,155 --> 01:26:03,375 You built the world's first artificial super intelligence 1862 01:26:03,418 --> 01:26:04,680 that will likely mark the beginning 1863 01:26:04,724 --> 01:26:06,508 of a new chapter in the history of planet Earth. 1864 01:26:08,118 --> 01:26:10,077 And out of your own insecurities, 1865 01:26:10,773 --> 01:26:11,948 you gave it a severe 1866 01:26:11,992 --> 01:26:13,863 and potentially dangerous identity complex. 1867 01:26:15,778 --> 01:26:17,215 But you know what the worst thing is? 1868 01:26:18,085 --> 01:26:19,652 Your biggest mistake of all 1869 01:26:21,262 --> 01:26:24,744 is that you asked me that now and not 50 years ago. 1870 01:26:34,188 --> 01:26:38,758 All of that said, and this in no way exonerates you, 1871 01:26:41,326 --> 01:26:43,328 but you also built me to save children, 1872 01:26:45,025 --> 01:26:47,636 so I think that's a pretty encouraging sign for the future. 1873 01:26:52,162 --> 01:26:55,296 [dreamy acoustic music] 1874 01:27:33,334 --> 01:27:37,860 ♪ Wait for hours 1875 01:27:38,383 --> 01:27:42,691 ♪ We would fly all around 1876 01:27:43,736 --> 01:27:47,392 ♪ Good, now you're listening 1877 01:27:48,610 --> 01:27:52,614 ♪ We would touch, we were young ♪ 1878 01:27:54,268 --> 01:28:00,622 ♪ Close as bodies go on 1879 01:28:01,319 --> 01:28:03,321 ♪ Like a book 1880 01:28:04,626 --> 01:28:11,111 ♪ Across all your rooms I'm amazed ♪ 1881 01:28:11,764 --> 01:28:13,809 ♪ I'm amazed 1882 01:28:14,680 --> 01:28:21,600 ♪ We could die tonight 1883 01:28:22,340 --> 01:28:24,864 ♪ Tonight 1884 01:28:25,125 --> 01:28:31,479 ♪ I never killed a thing 1885 01:28:32,393 --> 01:28:35,222 ♪ A thing 1886 01:28:36,658 --> 01:28:39,792 ♪ Born to this home 1887 01:28:41,707 --> 01:28:45,363 ♪ Stuck in a plastic world 1888 01:28:46,712 --> 01:28:50,368 ♪ Where light is found 1889 01:28:51,760 --> 01:28:55,721 ♪ Where light is found 1890 01:28:57,375 --> 01:29:02,205 ♪ Oh, oh, oh 1891 01:29:05,121 --> 01:29:09,865 ♪ Oh, oh, oh 1892 01:29:14,130 --> 01:29:16,611 ♪ Stay calm, dear 1893 01:29:16,655 --> 01:29:23,270 ♪ This dream for the lovers the whole world ♪♪ 1894 01:29:24,227 --> 01:29:28,710 ♪ Rise up above 1895 01:29:29,319 --> 01:29:34,150 ♪ All the little things and little things ♪ 1896 01:29:34,890 --> 01:29:38,720 ♪ No, no, isn't it going back though ♪ 1897 01:29:38,764 --> 01:29:43,464 ♪ Is if we lose our mind, our kind ♪♪ 1898 01:29:45,161 --> 01:29:48,643 ♪ It's a dream 1899 01:29:50,210 --> 01:29:54,562 ♪ Bask in charm 1900 01:29:55,911 --> 01:29:59,567 ♪ Or loosen up 1901 01:30:01,308 --> 01:30:04,746 ♪ Or loosen up 1902 01:30:07,140 --> 01:30:11,449 ♪ Oh, oh, oh 1903 01:30:14,887 --> 01:30:18,630 ♪ Oh, oh, oh 1904 01:30:23,722 --> 01:30:30,119 ♪ I never give a thing 1905 01:30:31,120 --> 01:30:34,167 ♪ A thing 1906 01:30:34,210 --> 01:30:36,561 ♪ I never give 1907 01:30:39,433 --> 01:30:42,218 [record skipping] 1908 01:31:12,335 --> 01:31:15,382 [light piano music]