On my way to work this morning I listened to an interview with Wendy Liu on the Dreaming Against the Machine podcast. Wendy’s path from a wide-eyed programmer to a successful software engineer with technology disillusionment resonated with me. Our paths had so much in common.
But there’s a big difference between Wendy and myself. She had the wisdom (and courage) to express what she felt by writing a book (Abolish Silicon Valley) and leaving the tech industry.
The first time I felt guilty about what I did for a living, I simply changed jobs and moved on. I was still in my 20s and completely failed to grasp how I fit into the world. I also let my love of technology blind me to the larger impact of my work. It’s a short story so I’ll elaborate.
In the late 1990s I worked at a major credit card company as a C++ programmer. This was my first actual job with the word “programmer” in the title. I had turned my hobby into a profession (without recognizing the classic mistake). On top of that, my team was working on intellectually interesting problems and the code I wrote actually ran on the company’s super computer every night! I was having the time of my life.
If you know me you probably wouldn’t believe that the system I worked on was for advertising. The project was essentially a way for business customers to request a list of credit card holders that were more likely to buy their products. The software I worked on turned those requests into queries to run against the massive amount of data available on the super computer. It surprises me now but I don’t recall being bothered by the ethics of this. That would change.
One afternoon all employees were summoned to an all-hands meeting in the company theater. (Yes, theater, it was a really big company.) I sat next to my teammates listening to the normal corporate drivel from an executive (the CEO if I remember correctly), when he said something I will never forget. Laying out the goals for the next year he stated he wanted to double consumer debt. I felt sick. I knew I couldn’t work there anymore. Within a few weeks I went back to working as a Unix System Administrator at a much smaller company.
Unfortunately, I failed to learn a lesson about technology and how my work impacts society. What Wendy realized (and I failed to) was the obsession programmers have with interesting technology without any regard to how that technology affects others. It’s really easy to think “I just work on a search engine for financial data” instead of seeing the bigger picture. It wasn’t until my early 40s that I started to question this.
By that time social media had tipped into a toxic disaster of enshittification. It was clear that corporate technology was making the world a worse place for a lot of people, and eventually for democracy too. Yet programmers whom I held in high regard were flocking to work at companies like Facebook because they had interesting problems to work on.
I remember wondering if an ethical framework for software development would help. Perhaps if there were a union for software developers that promoted a do-no-harm code of conduct then programmers would feel more comfortable pushing back on their employers. Unfortunately I did nothing with this thought experiment. I regret and want to change that. So, let me start by asking you a few questions.
Imagine that you are a programmer who belongs to a union like the one I described. Or maybe in order to work as a software developer you must be licensed by a national trade organization where you pledge to do no harm. Now ask yourself if you would be able to continue performing your current job under those conditions. Are you violating union ethical rules or risking your programming license?
Does the software you write harm people? Can people use your software to harm others? How does your software and its development process impact democracy, the climate, censorship, surveillance, employment, public safety, etc.
The modern world runs on software. We can no longer ignore the impact of our work. If you write software because you enjoy the intellectual challenge and want to ignore everything else then I implore you to reconsider.
And yes, using LLMs does cause harm, and therefore is unethical.