The Passenger Ch 03

In my line of work you get to learn a lot about the universe.

I don't mean the sort of stuff that cosmologists go on about. Don't get me wrong, it's all mighty interesting to think about how the universe finite in size, yet its boundaries are endless at the same time; and how it is curved, so that you end up right where you started if you fly in a straight line long enough and far enough. Not that I can imagine how a three-dimensional space can be curved back upon itself in the fourth dimension without getting a headache, of course.

No, one of the most important things I've learned about the universe while bouncing around in it is this: while the universe may not be infinitely large, it does have an infinite number of ways in which to surprise you.

Take Kr'wolth, for example. It's a small rim world that you probably have never heard of. I once dropped off a shipment of lab equipment there that I never could make heads or tails of. The cargo manifest was no help: I still don't know what a non-linear protein splicer is supposed to be used for, and that was about the simplest description on the documents. So I was expecting the Kr'wolti (or whatever they call themselves) to have at least some sort of high-tech elements to their society, but when I landed there was no trace of any of that.

What I found instead was a bunch of primitive, hairy bipeds who communicated in grunts and groans. I ended up doing most of my business through the airfield computer, which had been a very decent model about thirty years ago. It wasn't long before I realized my chances of finding a new cargo there were slim to none, but it took me another day to find out why: the bipeds were not the dominant life form on Kr'wolth at all. It was the parasites that lived inside them: highly intelligent parasites who controlled their hosts telepathically. Less than twenty minutes later I was in orbit, limping out of there on my ultimate-last-resort emergency fuel and taking my losses like a man. That's how badly those things frightened me.

So you'd think that after that sort of experience (and several others like it) I would be ready when the universe threw me another one of those weird curve balls.

You would be wrong.

* * *

For a moment I stood there, stunned. The shock of what I was seeing and hearing was simply too much. Then things started to click into place, and every click was a blow that hit me square in the stomach.

Back on Radix, Deke had offered to fix me up with something young and tight. What was it again that he said?

"How about a droid?" he suggested.

"Hell, no," I said. "A plastic animated fuck toy doesn't do it for me."

"Obviously, you haven't tried the latest," he replied. "Plastic was replaced with synthflesh ages ago. Impossible to tell apart from the real thing. Their behavior is completely life-like, too. Especially with the, ehm, new software extensions."

"You mean AI extensions? Those are illegal."

He'd just shrugged. "Maybe. Lots of things are. But in the privacy of your own ship, between systems..."

"Are you kidding? It'll wake up and then I've got an emerging AI on my hands! And even so, how good is it really going to be? I'll tell you; it'll still be a plastic fuck toy."

"I'm still willing to bet that you won't be able to tell a state-of-the-art pleasure droid from the real thing," he said.

What a sucker I had been. Even the names had been part of it.

Deke Ryder.

Anne Ryder.

Anne.

Droid.

Android.

The oldest and lamest wordplay ever. Any idiot could have seen it coming from lightyears away. But I hadn't. Which meant I was an even bigger fool than I thought possible.

"Deke, you filthy piece of..." I began.

"Are you referring to your cargo broker on Radix?" Business Suit inquired politely. "Yes, he was quite proficient."

He looked at Anne, who stood there like a statue.

"The unit you shipped here was built on the chassis of the latest model pleasure droid," he continued. "Its synthflesh is virtually impossible to tell apart from the real thing, even for a trained expert. It's organic in nature, of course. Vat-grown. And its various bodily functions are not just emulated. Not for the most part, anyway. It even has a fully functional digestive system as a part of its power source. It breathes, eats and eliminates in ways that are almost completely natural."

All I could do was stare. I had trusted Deke. I could not believe how easily I had been suckered, and how hard I'd fallen for the whole charade. And how much it hurt.

"Anne..." I whispered.

I was numb with the cruelty of the enormous joke that had been played on me.

"No... No. No."

Business Suit raised his eyebrows.

"You seem rather upset, captain Ross."

He peered at me closely.

"Ah, I think I understand. You thought of this unit as human, didn't you? Could it be that you actually have developed an affection for it? Romantic feelings, perhaps? Well, in that case I can certainly understand your disappointment."

I told Business Suit what he could do with himself.

"An interesting suggestion," he said. "And who knows, if it were anatomically possible it might even be quite enjoyable. Unfortunately, I am not quite that limber. Instead I prefer other forms of gratification."

He glanced at Anne, who still stood there, motionless as a statue.

"Which reminds me. You did, ehm, shall we say, enjoy, miss Ryder's various features on the way here, I assume? After all, her chassis is quite attractive, and we left the sexual subroutines of the original software fully intact, so the unit does possess the necessary skills. Did it perform to your complete satisfaction?"

I just glared at him.

Business Suit shrugged.

"It doesn't matter, " he said. "We'll get all the necessary details from the unit's log files. But you shouldn't blame yourself. We designed this droid to fool even the trained eye."

The thin smile flashed on and off.

"You see, the unit itself is completely unaware of its artificial nature. The new AI extensions we are pioneering here are really quite revolutionary. I won't bore you with the technical details, but at the basis of its behavioral algorithms lie actual human memories, drawn from real humans and implanted into the droid. Heavily edited, of course, but enough to produce a behavior so natural that even the unit itself can't deduce its true nature."

The thin smile came and went, not leaving a single trace.

"It's not a new idea, of course," he continued. "It has been tried many times in the past, but the completeness of the implanted identity always fell somewhat short of what was required for a full personality development. Until now."

He looked at me thoughtfully.

"Unfortunately, the completeness of our own success now presents us with a small problem."

"And what's that?" I said, trying to pull myself together.

Business Suit seemed to like hearing himself talk. That might be a good thing, although right now I had no idea yet how it might help me.

"The question of what to do with you, of course," he said. "The planned course of events was for you to unload your ship and then leave, blissfully unaware of the nature of your cargo and not emotionally attached to it. Instead we are now faced with your fixation with this droid and your intention to keep it with you. This is... inconvenient."

"So?"

He nodded.

"Yes. Exactly so."

Almost casually he reached into his suit pocket, took a tiny gun, aimed it and fired. A blue bold shot out and hit me full in the chest. It felt like slamming into a polycrete wall at full tilt, including the stars that exploded before my eyes and the blackness that followed.

* * *

The first thing I realized was that I felt terrible.

Over the years there have been a few times when I've woken up in pretty bad shape. It comes with the job: you drink the local hooch, maybe you get mugged, you catch a weird bug, or the local food turns out to have something funny in it. It's happens, and it had left me with a certain amount of experience in this area. Mostly bad experiences, but that's one of the hazards of the job.

Yet this time was particularly bad. My pounding head felt like it was cast in a block of polycrete, but that was the least it. I could breathe, and it felt like I could open my eyes if I tried, but that was about it. I couldn't even feel my arms and legs, let alone move them.

I seemed to be sitting in some kind of high-backed chair. Other than that, I couldn't make out much, so I tried to open my eyes. That worked. I blinked a few times to clear my blurry vision, then looked around as well as I could. My head wouldn't move.

The room I found myself in was mostly white. It was brightly lit, and various tables and pieces of electronic equipment and computer systems took up most of the floor. A row of standard shipping containers stood against one of the walls. They were normal three by four by five foot containers, but they looked awfully familiar. I was willing to bet that they had come from the Slowboat's cargo hold.

One of the containers had been opened and some of the contents had been taken out and put onto a nearby table. Whatever was in the plastyne bags looked like no environmental control unit I'd ever seen: silvery, hemispherical shapes with bundles of thin, gleaming, metallic wires attached to their flat sides... I had no idea what those things were. For a moment I sat there wondering what they reminded me of, until I realized: they looked a lot like human brains, complete with spinal cords and bundles of nerves attached to them.

That made me angry. Business Suit had mentioned AI extensions in Anne's software, and these units obviously represented more of that sort of thing. All forms of AI, potentially self-aware or not, are highly illegal almost everywhere. If I'd been caught, no amount of explanation would have kept me out of a penal colony for the rest of my life.

"Nice mess you've gotten yourself into here, Harvey," I said to myself.

Myself nodded sagely.

"Yes," he said. "Well done. Now will you please stop bellyaching and focus on how to get out of it?"

I sighed. Myself was right, as usual. I hate it when that happens, but I had to agree with him.

The man who stood bent over one of the tables was dressed in a standard lab coat. He was tall, his hair was black and very short, and his shoulders were stooped as if he had been bending over that table for far too many years. A sheet covered a familiar-looking shape, and when he moved, I saw Anne's blond curls spilled across the table. She was breathing again, but her face was an emotionless, expressionless mask.

"Hey," I tried to shout. It came out half as a croak, half as a cough.

The man by the table looked up, then pushed a button.

"He's awake, sir," he said.

"Good," said Business Suit's voice from a speaker somewhere. "I'll be there shortly."

The lab tech turned, then wheeled some kind of equipment to the end of the table where Anne's head lay. It looked like a bulky console with a disc mounted on an articulated arm on top of it. Perhaps it was some kind of inducer. He adjusted the arm until the disc was suspended near Anne's motionless head. So it was an inducer.

"Transferring logfiles," he said.

From the way he spoke, I assumed his words were intended for some kind of recording device. I watched while he tapped his console, then stared at the display for a few moments. A door in the corner of the room slid open, and Business Suit walked in. He glanced at me, then walked on to the table where Anne lay.

"So what have we got?" he asked.

"I'm just going through the logfiles now, Mr. Brax," the lab tech said.

So that was Business Suit's name, apparently.

Brax watched as the lab tech keyed his way through several pages of data. He raised his eyebrows, smiled. Then he turned and looked my way.

"Well, well," he said, sounding amused. "I see you enjoyed yourself thoroughly with our droid. Quite the stud, aren't you?"

"Brax, huh?" I said, just to see if I had my voice back.

"My name doesn't matter," he said. "What does matter is how the unit preformed. And from what I see here, it did quite well."

I tried to get up and punch him in the face, but it didn't work. It was as if my arms and legs just weren't there.

"Relax, Ross," Brax said. "We have fitted you with a temporary neural block. Don't worry, it's quite harmless. But it will keep you where we want you."

I spoke a few well-chosen words on the subject of his ancestry.

"Cute," was all he said.

He turned back to the lab technician, who was watching the display with a concerned expression on his face.

"What's wrong?" he asked.

The technician hesitated.

"I'm not quite sure yet, sir," he said, his eyes on the display.

"Then make sure," Brax said, irritated. "I'm paying you to be sure. What is it?"

"We've got some anomalies here, sir," the technician said. "I'm reading two full system crashes."

"Cause?" Brax asked.

"Still unknown, sir."

"So find out," Brax snapped. "Quickly."

He turned and walked over to me.

"Tell me what happened," he said.

I smiled. This was the first time I'd seen him express any kind of emotion. I took it as a good sign that not all was well in his world.

"What you're doing is illegal on too many levels to count," I told him. "It's only a matter of time before you'll be exposed. Then what?"

Brax shrugged.

"The law on AI will soon be changed," he said. "If necessary, we'll make sure that it gets changed."

He flashed his pencil-stripe smile again, his eyes suddenly very cold.

"You don't seem to understand, Ross. Our company represents a sizable part of the universal economy. That allows us a certain... flexibility. And we can always create more flexibility when we need it. So, tell me what happened. We'll find out anyway, and you might as well make it easier on yourself."

I was about to tell him exactly what I thought of him, but the look in his eyes told me I was on thin ice here. Brax seemed quite controlled, but something about him left me with no doubt that he was capable of committing murder as casually as I might squash an insect.

"Fine," I said. "She just collapsed. Twice. Not moving, not breathing. The medpack said she was dead. But after a while she woke up again."

I thought I'd managed to keep my feelings out of my voice, but apparently I hadn't.

"That must have been unsettling," Brax said. "Your medpack was quite right, of course. The unit never was alive, strictly speaking. Although its organic components blur the line somewhat, but that's of course another matter."

He turned back to the lab technician.

"Anything yet?" he asked.

The technician nodded slowly.

"Yes, sir. It appears that the implanted memories created a conflict with the original software that came with the chassis. As you know, we used the basic pleasure droid routines as our development framework. This model is a high end one, of course, but the basic operating system is essentially similar for all of them. The more expensive units just have more detailed and sophisticated response routines, that's all. So we left those intact, and we interfaced them with the experimental AI extensions."

"Yes, I know that," Brax said impatiently. "So?"

The technician hesitated.

"Sir, the implanted memories seem to have caused the AI to interact with the sexual response systems in, ehm, in a way that we did not anticipate."

"What kind of way?"

"Well... It appears that the interaction has caused the AI to become emergent."

Brax stared at him.

"Nonsense," he said. "Impossible."

The technician looked decidedly unhappy.

"I'm afraid not, sir. As you know, the AI algorithms are highly adaptive. They may change in response to the unit's past and present experiences. It's one of the principles on which the AI extensions are based." He took a deep breath. "It appears that, as a result of this adaptability, the memory implants and the sexual response routines have begun to interact in entirely new ways. They have generated massive amounts of new decision gates. The artificial intelligence quotient of the unit has increased by a factor of more than a thousand already, and it's still rising. But..."

"Well?" Brax snapped. "Speak up!"

"Well, sir... The critical factor seems to have been the nature of some of the implanted memories. Specifically, the ones associated with the Excalibur sequence. They appear to have been not only intensely sexual, but also intensely emotional. Evidently, the emotional impact associated with the sexual aspect of these memories was underestimated during the editing stage, which has caused the unit to develop a genuine emotional response."

Brax frowned.

"How so?"

"In short, sir, the basic firmware that came with the chassis has sexual response patterns as its primary focus. But the implanted memories included significant amounts of formative sexual experiences, which appear to have had an unexpectedly high emotional content. As a result, the AI's main focus switched from simple sexual response patterns to obtaining further experience of these emotions, which in turn appears to have triggered its emergence."

"What sort of emotions?"

The technician took a deep breath. Then he glanced at me.

"Love," he said.

Brax stared at him for a long second.

"Are you floridly insane?" he burst out.

The technician took a step back and held up his hands as in defense.

"Sir, I know what it sounds like. But the log files clearly show that both system crashes occurred while the unit was expressing intense feelings of love."

Again, he glanced at me.

"As you know, this is still one of the problems with AI, sir," he continued. "It's incompletely understood at best. We do not fully know the nature of our own intelligence, much less that of consciousness and self-awareness. Sir, this is experimental technology. Unexpected things may happen."

"Unexpected. Unexpected, you say?"

Brax seemed stunned, then suddenly became enraged.

"Unexpected!!! You moron! Are you saying that this damn droid is in love? With... WITH HIM? What the hell am I paying you for?"

For a moment he looked like he was about to hit the technician. Then he controlled himself with visible effort. He glanced at me, then at Anne. The technician had taken another step back, looking as if he was about to make a dash for the exit.

"Fine," Brax said, obviously forcing himself to be calm. "Fine. Assuming that you're right, which I don't believe for a second, what do you suggest we do about it?"

The technician turned to the display.

"Well, sir," he said, his voice wavering a little. "The first thing would be to stabilize the unit. The two system crashes occurred when the AI's emotions allocated more decision gates than the number of junctions its neural matrix had available at the time, which in turn created an overload. The short-term fix would be to delete some or all of the memories that triggered the overload, including all memories of sexual activity. That should serve to dissociate the sexual components of its behavioral routines from the conflicting emotional responses to a point where its neural matrix can cope with it, which will prevent further instabilities."

"Would there be side effects?"

The technician shrugged.

"Its personality would change a little, on the basis of the edited set of experiences, but not all that much. Its overall functioning shouldn't be significantly affected."

"And the emergence?"

"Sir, the only way to counteract an emergent AI's development of self-awareness is to remove all its experiences, memories, learned patterns and reflexes that caused the emergence. We would essentially have to erase all of it and start from scratch."