Here's the first 1200 words of a short story about death, taxes, counterfeiting, the Pointers Problem (the most vexing aspect of alignment IMO), outcome pumps, and (a misunderstanding of) the Yoneda Lemma. Apologies to Scott Alexander. I plan to continue working on & editing this story, but wanted to submit something by Sep 1.
https://docs.google.com/document/d/1c_HgOS1UfiYCnEtc7Ujdw7-uAzv73d5IZjefN4OqVtY/edit?usp=sharing
While I'm at it, might as well submit my other sort-of-AI-related, (very) short story. It's about a world where eliminativism is true, but a (rather cartoonish) rogue AI doesn't believe it.
https://unoriginal.blog/cremate-yourself-immediately/