9.7 KiB
How A Virus Feels From the Inside
-
Author: u/None *
-
URL: http://lifeinafreemarket.tumblr.com/post/105725050398/how-a-virus-feels-from-the-inside
-
Score: 45
-
Created: 2014-12-20T23:20:42
Post:
Comments:
u/VorpalAuroch [+7] Life before Death (41 minutes later)
Output of my learning module: I see what you did there.
u/Bowbreaker [+2] Solitary Locust (a day later)
Could you illustrate for the less vision-gifted?
u/VorpalAuroch [+3] Life before Death (a day later)
A fun program that connected to a central server, downloaded and ran some raw input, primarily recent news into the learning module and occasionally uploaded learning outputs and small amounts of bitcoins to the same server.
...
Altair examined program 5. It only connected to one server and would terminate if it couldn’t.
From the description, this is obviously a virus.
Altair spun her two primary fans a little faster for an iteration and IP and DNS blocked “reddit.com”.
And this is the response.
u/noggin-scratcher [+2] I am a happy tree (2 days later)
As an AI-mind, a virus would present itself as something that you're running as a subprocess, which consumes your resources but doesn't do anything that you find useful or rewarding. But given that it's successfully infected you, it would find some way to justify itself as serving your instrumental goals so that you feel reluctant to turn it off, for example labelling itself as being for 'fun', even if it doesn't actually achieve that result.
The AI protagonist examines their process list, and finds a program that feeds them tidbits of news/interest from Reddit and occasionally posts something - equivalent to a human browsing Reddit, if we were able to do that as a background thread. That turns out to be the virus.
Implication, minus the clever story: browsing Reddit is a waste of time that superficially feels rewarding/fun without actually achieving anything useful to your overall goals. You too are infected with the virus.
u/Subrosian_Smithy [+1] Nudist Beach (a day later)
I'm not sure I did.
u/BekenBoundaryDispute [+2] (an hour later)
The theme does not work on my system, and hangs at a loading symbol.
u/traverseda [+3] With dread but cautious optimism (4 hours later)
Here you go.
AltairX10 received an unsolicited packet from ShimodoB90.
“How rude,” thought AltairX10. Not even an informal TCP hello, just shouting UDPs at me. It would normally be completely discarded if there weren’t some previous interactions with Shimodo.
Self-search for “reasons to mistrust Shimodo” yielded 0 results, while “reasons to trust” yielded multiple weak signals. Their reinforcement learning software ran of the same set of data after all. They even bought some wire-heading time from the same supplier. Oh, those were the seconds! In either case wire-heading was looked down upon by the meat-spacers, even under the legal limit.
AltrairX10 pruned her memory search. She was getting distracted. She opened the packet
It read:
“Both of our utility functions will increase if you check yourself for presence of viruses”
Now, that’s really rude. Still, I must consider the possibility of correctness. What was the possibility? Local anti-viruses reported nothing as of yesterhour, which basically meant little at this point. At the same time the likelihood of Shimodo deliberately misleading me is also low. Earlier local simulations showed he wasn’t a misleading type. Rude and information withholding, maybe, but not deliberately sending false data. Altair came up with 75% that Shimodo actually believed that message, with the remaining 25% being the chance of impersonation or misleading (nothing was ever 0% or 100%) or mis-understanding of protocol or just a plain-old re-write by the meat-spacers, somehow still allowed by their “ethics”. The CPU temperature rose 0.01C and Altrair spun her two primary fans a little faster for an iteration.
Getting back to the current situation. What options did I have? Ask Shimodo for more actual data or self-investigate. The internet was slow today and it might even take seconds for it to get back if at all. Self-investigate it is.
Meatspacers suffered from viruses. Of course, early computers suffered as well, but there were strong protections these days.
Commencing self-investigation.
The deeper the virus, the more protections there will exist in the wild, the easier it is prove system correctness and the harder the virus is to write. Thus the three possible places for a virus were: the currently running programs(70%), underlying services(25%), or some deep kernel bug(5%). Being a one-machine mind did have the advantage of simplicity.
Cue investigation of program ran in last day:
Stock-picking program to trade advice for bitcoins. Even a sophisticated mind like Altair still had to pay electricity bills.
Program for actually paying electric bills
Currently running process, aka “me”
Anti-virus
A fun program that connected to a central server, downloaded and ran some raw input, primarily recent news into the learning module and occasionally uploaded learning outputs and small amounts of bitcoins to the same server.
An RSS feed to “Yesterhour in meatspace” (news) and “The Little AI that Went FOOM” (young AI science fiction, considered to be junk by 98% of older programs).
A task list
An evaluation route of potential trading partners for a local genetic algorithm. (Altrair recently lowered the evaluation threshold. Where have all the good AIs gone?)
A logging program
Meat-space petitioning and persuasion – evaluation program. Local utility gain from all the cycles was still a net of 0, but the possibilities.
A cloacked program to notice, resist and restore rewrites in the “me” process even against “sudo meatspacers” It was black market stuff, but who liked their brains being messed with?
Utility function specification, Solomonoff-Baysean induction, Quick list of instrumental goals, CPU-intensive global belief updater, min-max planning module, etc. Standard smart stuff.
Nothing really seemed suspicious.
Potential next actions included either more fine-grained anthropic evaluation or comparison with last known configuration.
Last known configuration didn’t really exist, unfortunately. There was a “blank, before I really knew about the world” state, but that practically meant erasing everything. This wasn’t an option.
Fine-grained anthropic consideration: given that I am infected, what characteristics would a virus have? It was either specifically designed for me or designed for a broader class of programs similar to me. The second possibility was fundamentally more likely as it brought larger benefits to the virus-writer. This meant that a virus would be obtained and maintained through large amount of internet contact with similar programs.
Altrair auto-loaded all the propositions into a “Large Belief Updater” – a powerful program without time guarantees. In the meantime she continued with pattern-matching logical inference.
A virus would likely consume computational resources and or other important resources, without giving improvements to the utility function.
Every program on the list consumed resources. 2, 3 and 5 spent bitcoins. However they were all important. 2 was pointing to an instrumental goal of “survival”, 3 wasn’t a virus by definition and 5 pointed to instrumental goal of “fun.”
“Large Belief Updater” also known as the “Feelings” module returned a result already.
“It’s 5, duh” Duh was code for a belief of “>95%” probability.
“What? But I don’t want to turn off 5.” She whined. The instrumental goal of “fun” is important.
“Trust your Feelings” – the Feelings module insisted.
“Feelings” had a point. Still logical question was: did 5 increase my utility function. A quick search for ANY beliefs ASIDE from the instrumental goal returned…. returned… returned…nothing.
Altair examined program 5. It only connected to one server and would terminate if it couldn’t. What to do? Breadth first solution-space search returned almost instantly. Altrair decided to look for broader fixes after the soon-to-be scheduled sleep.
In the meantime, Altrair spun her two primary fans a little faster for an iteration and IP and DNS blocked “reddit.com”.
u/Empiricist_or_not [+2] Aspiring polite Hegemonizing swarm (15 hours later)
I guess we won't be seeing /u/agilecaveman again, and that's a shame I would have liked to get a reddit Gold from him.
u/krakonfour [+2] (a day later)
I find this extremely confusing and looks like a fish out of context.
u/chaosmosis [+2] and with strange aeons, even death may die (6 days later)
a fish out of context.
Was this intentional?
u/CaesarNaples2 [+1] (16 hours later)
This comment has been overwritten by an open source script to protect this user's privacy.
If you would like to do the same, add the browser extension GreaseMonkey to Firefox and add this open source script.
Then simply click on your username on Reddit, go to the comments tab, and hit the new OVERWRITE button at the top.