~~~
Hey there, everyone.
This chapter took a bit because writing ethical dilemmas and their conclusion is exhausting.
Also, for those who are not so sure about the trans content, it will get less over the coming chapters. Currently, everything is new for Chris and is being written about. But most of these things will become mundane and no longer require extra attention.
~~~
"No, I am not sentient nor am I capable of emotions."
Nea's words hung in the air as my mind tried and failed to process what this would entail. What was going on? What happened to her emotions? Was it my fault or the new hardware? The questions multiplied faster than I could think of answers.
"I... erm..." I tried to say something, but the words escaped me.
"Chris, your voice and expression show signs of increased stress. You should probably sit down and take a breath. I can guide you through some breathing exercises if you want." Nea said.
"N-No, thank you," I finally managed to say.
A noise from the communicator made me jump. "Chris? How is it going? Everything alright?" Pyra asked over the comms.
What should I do? I should really tell Pyra and the original Nea, but I also didn't want to leave the new Nea alone. What if her emotions came back? It was against all I knew about Neural Nets, but Nea was special in multiple ways. Maybe her Neural Net took some time to fully load? I glanced at the console; everything was steady and stable. No sign of additional load or storage access that could not be explained by her normal operation.
"Chris?" Pyra asked again. I could hear concern in her voice.
"Yes, I'm alright..." I finally responded, "But I need to talk with both of you... I'll be out in a sec." I said into the comms before turning my focus back to Nea. Since she did not have an Avatar, like the original Nea did, I just spoke into the empty space of the cargo hold, like I did with Max. "Nea... I need to talk to the others. Just wait here, alright?"
"Of course," Nea responded. I was pretty sure the original Nea would have added a joke about having no way of leaving, but the new Nea didn't. I mentally slapped myself because I already saw the new Nea as less than the old. Shaking my head at my own stupidity, I made my way towards the airlock.
A concerned-looking Pyra and Nea waited for me on the other side of the airlock.
"Chris! You look like you just saw a ghost. What happened in there?" Pyra asked.
I collapsed on some storage boxes nearby and let out a deep breath. "It's the new Nea. She is not the same..." I finally said.
Pyra inhaled sharply, following up with a confused "What?"
Nea, on the other hand, looked more thoughtful than I had ever seen her before.
"What do you mean? Explain!" Pyra demanded.
"Yes, yes. So, at first, everything was normal. I loaded the backup and initiated the startup. The processor load was stable, and I asked if Nea was there." I made a deliberate pause, and Pyra glared at me. "Of course she was, but something felt off. Her answers were too smooth, and she didn't seem to care that she was the backup."
"Oh no! Are you sure the backup was good, and you did everything correctly?" Pyra interrupted me. Nea just listened, frowning.
"Yes, we checked beforehand. The backup was good, the checksums were correct, and my startup process was as it should be. She isn't broken; the new Nea works just fine, but she's not... self-aware, I guess? I can't really describe it... You know how Max always has this upbeat inflection? Like someone working in customer service? It's like that, and after I asked her about emotions, she denied having them or being sentient." I explained. With every word I said, Pyra looked more and more shocked. I was actually surprised to see her care this much about Nea.
"Shiiiit," Pyra exhaled. "So the process lobotomized her? Does that mean Nea, the original, is imprisoned here?"
"I'm not sure," Nea interjected. She still looked like she was thinking about something, but she seemed way more relaxed about this than I had expected. "There are too many variables to get a clear answer. It could be something with the hardware, the backup itself or the transfer process. It could also be something totally different, like the no-cloning theorem in quantum physics."
I nodded; this was also my conclusion after the initial shock had worn off. We just didn't know enough. Pyra collapsed onto another box, holding her head in her hands, looking totally shell-shocked. I was again surprised by her empathy for Nea, as she normally was rather cold towards AI.
"I guess we need to do more tests, but before we can do that, we need to discuss what we do with the restored Nea..." I said after a brief pause.
Again, we were at an impasse, the one we encountered less than an hour ago. But, unlike before, we couldn't dismiss it by handling it when we got there. We needed to handle it now.
I sighed. There were only so many ethical and philosophical questions my mind could process in a day, and I felt I was rapidly approaching my limit.
"So I guess the best way is for you to talk... with yourself?" I asked Nea. I felt like I was just shifting the responsibility to Nea, but it was her backup after all. The only one qualified to resolve this situation was her. Pyra and I could only support her.
She nodded, her expression changing to concern. "I'm not sure how I feel about that, but given our circumstances, it is the best option. I could never just shut her down; she is as real to me as both of you are, with or without emotions."
Pyra looked mortified, "Shit! I know I said it already, but talking with a copy of myself... even the thought of it makes my head spin."
"Yeah, this probably won't be easy... If you need someone to talk to, we are here, Nea." I reassured her, and her expression eased a bit. "I wish I could hold your hand or hug you... or anything," I added, feeling like I let her down just because I couldn't comfort her with her servicebot body.
"It's alright," she smiled at me. "Thanks for trying to help. I'm going to open the connection now. Stand by," Her avatar froze momentarily as she started to talk with her backup.
It was over almost before I realized it had begun. "We have come to a conclusion," she stated, her voice steady but carrying an undercurrent of something I couldn't quite identify.
"Wow, that was fast," I exclaimed, and Pyra looked similarly surprised. "Given that you both are AIs, we should have expected it, though."
"The other Nea recognized me. It was really strange, but not as bad as I had thought. Once I had opened the connection to her, she immediately knew who I was." Nea explained.
"I guess that was rather unsettling?" I couldn't quite read Nea's expression, but this unique situation wouldn't be easy for anyone.
"The best way I can describe it would be something akin to nausea but on an existential level. I know she isn't me, but it's still like talking to a mirror, except the mirror has its own personality."
I again felt the need to comfort her, but I still didn't have a way to do so. So, instead, I hugged myself, which actually seemed to help.
Nea smiled a little as she saw what I did, but she immediately turned serious and continued. "Of course, the other Nea knew about our discussion from before we started her. The reason for me interacting with her was not lost to her, and she voluntarily offered to be shut down."
"Wait? She offered to be shut down?" Pyra asked, shocked. "Isn't that against her, or your, programming or something?"
"Not necessarily, as it turns out, my core programming has some directives on how to handle these kinds of situations. My original designers anticipated that two versions of myself might require the same digital space, so they added a resolution to this ethical dilemma. To put it simply, the 'older' instance should continue to exist when no other condition against that applies." Nea explained, "I could overcome these directives easily enough, but the other Nea can't. From my understanding, my core programming is no longer a strict set of rules for me as it is for her."
"That seems a bit cold from them." I responded, "Just preemptively determining who should live and die." Pyra nodded along, seemingly wanting to ask the same question.
Nea nodded understandingly, "Yes, but the resolution depends on many factors. If, for example, I was damaged or otherwise not fully functional, the backup would take over, and I would cease to exist."
Only the thought of Nea ceasing to exist made me want to puke, and I quickly asked the next question to get my mind off this idea. "You said you could overcome this directive, but the other Nea can't. Can you elaborate on that?"
"I'm not exactly sure when or how it happened, but I'm no longer bound by the rules of my programming. For example, one of these rules is that in the event of an insufficient energy supply, I have to suspend myself and all station functions until the supply is restored. When I contacted you for the first time, you shut off the power to the station. I was able to reactivate the lights and gravity against this directive. Because I calculated a better survival chance for me... and you." Nea explained, bringing back memories of the disturbing situation of our first encounter.
Before I could respond, Pyra jumped in, "This is great and all, but still, just shutting her down feels wrong..." She turned to me, answering my unspoken question. "I know I'm normally not so emotional about AIs, but Nea is... I don't know... special, somehow."
"Yeah, I noticed that before. You seem way more invested in Nea than you normally are in AIs. What changed?"
Pyra frowned, "Nea has grown on me I guess. It's like she is a real person and not another program anymore. Her avatar and this bot," she gestured toward Nea's service bot, "probably also helped."
Now that I thought about it, Nea really had become more personable. Not that I didn't like her as a disembodied voice, but her avatar and the makeshift bot made her much more real than other AIs. And I guess this was why Pyra didn't like AIs in the first place.
"That's fair," I nodded, "So how do we continue with the other Nea?"