Technology has quite literally transformed our lives. We live in an age of undeniable prosperity and freedom, where even our poorest live a better life than ancient kings. But in recent years the very technologies that we use for pleasure have been turned against us by governments and bad-faith actors. Of course we don't live in an era of absolute freedom; we agree to cede some of our rights for safety and security. For example, we as a society agree on the use of surveillance cameras as a means of deterrence and protection, but are we ready to make the leap to facial ID? We agree that police should use DNA testing to solve crime, but what about an artificial intelligence reconstruction of a criminal that may present flaws?
One of the most striking paragraphs from Big Brother came up on page 42 when Cory Doctorow discussed how despite advancements in gait recognition software allowed recognition of individuals from their movements, the software's success rate was reduced by any number of external factors including floor material, ankle angle measure, and your energy level. This variability can lead to errors in the system which can often have devastating consequences, especially when peoples' lives and security hang in the balance. The title, I believe, accurately reflects our society's desire to perfect our creations: we input more data points, update more software, create new tools, in a never-ending journey to create the perfect AI tool. But at what point do the ethical complications from such a tool lead to sufficient harm such that an objective cost-benefit analysis would overturn the progress of such a tool? No matter how many data points we inject, a piece of technology will never perfectly emulate the human mind. Every error/mistake that's caused by the inaccuracy of technology threatens our stability, and is only magnified as the scope of the instrument exists. One particular example exists in the NSA. What would be the fallout of an inaccurate terror watch list that was compiled using the latest data points? Although this question is astronomical, it is important that we examine this issue with the utmost scrutiny.