Part 2: The Ethical Dilemma in Intelligent IoT System Design — And How to Address It
The rapid integration of connected IoT devices into our daily lives has transformed mundane objects into smart devices, revolutionising automation and personalisation. We are witnessing everyday objects transform into intelligent entities, which while offering unparalleled comforts and innovations, also pose many risks.
In Part 1 of this blog series, we explored the ethical dimensions of hyper-connected IoT systems, delving beyond security and privacy concerns. We spotlighted dilemmas across industries and everyday scenarios, illustrating the broader landscape of ethical considerations in IoT design.
In case you missed it, click below to read Part 1 of this blog post series:
For designers and developers of IoT Systems and Solutions, the growing convergence of technology and society via connected devices prompts a reevaluation of our responsibilities. Equally, for consumers in this digital era, it is important that they understand their rights and are able to advocate for their safety.
In this post, we will discuss how we can work towards solving the ethical dilemma in IoT design, and examples of the leading initiatives in this space.
Crafting a Comprehensive Solution Framework
Navigating the complex ethical landscape of IoT demands a multi-faceted approach. Let’s delve into key strategies that can collectively contribute to a more responsible and ethical IoT ecosystem.
Programming Ethical Behaviour
- Rule-Based Ethics: Embedding explicit rules into IoT systems ensures transparency and ethical conduct. For instance, a healthcare assistance device could follow a rule prioritising actions that save lives, even if it means overriding patient demands, and in the case of autonomous vehicles, saving a human life may be always considered as the priority. The challenge, however, lies in determining the governing entities in making these rules. Furthermore, it may not always be the right idea to hard code strict rules, such as in the case of autonomous vehicles, as not all possible scenarios can be predicted.
- Ethics Settings: Empowering users to contribute to ethical decision-making can be achieved through user-configurable settings. However, striking a balance is crucial, as individual choices may sometimes conflict with societal interests.
Whitebox Algorithms
Transparent algorithms play a pivotal role in fostering trust and accountability. Making algorithmic decisions understandable and traceable is critical to enhance accountability of the system. This is especially important in cases where decisions about an individual are being made programmatically. For example, in a criminal proceeding, determining whether a person is lying or not using a facial expression recognition device.
However, concerns about intellectual property and commercial interests may hinder the adoption of transparent algorithms. In such cases, it may suffice to expose the logs of the system in a human-understandable manner, aiding in understanding the ‘why,’ ‘how,’ and ‘when’ of the decisions made by the system.
Blackbox Testing
In cases where transparency of a system may not be possible, due to commercial interests or safety concerns, an alternate could be thorough testing of ‘blackbox’ systems by legal authorities, independent audit organisations or even individuals.
Rigorous testing, including simulation scenarios covering every possible (thinkable) situation, can provide insights into a system’s behaviour. To enable this, open source testing frameworks covering legal and ethical requirements should be made available to developers and designers, to ensure standardisation.
Algorithmic Social Contracts
Establishing algorithmic social contracts involves fostering a deeper connection between technology and society, enabling stakeholders to actively participate in shaping system behavior. This approach not only holds developers accountable but also embraces collective decision-making.
- Stakeholder Accountability: By forming social contracts, stakeholders, including developers and users, collectively contribute to defining acceptable behavior. This accountability ensures that the system aligns with societal values and preferences. This inclusivity acknowledges diverse perspectives and prevents unilateral decision-making, creating a system that is reflective of societal norms.
- Crowdsourcing Ethics: Tools like MIT’s “Moral Machine” demonstrate the potential of combining machine-learned representations and human perspectives. “Crowdsourcing” viewpoints from an international community while designing systems can be a way to fight potential bias and ensure cultural differences are accounted for. The ‘Moral Machine’ project does this by asking users to vote on how they would react, or what they would do in certain situations while driving
Code of Ethics for Developers
Developers and product designers of IoT systems arguably have the greatest influence on how it might behave. However, ethical considerations are rarely at the forefront of design decisions. It is crucial to not only raise awareness, but also to establish ethical frameworks and guidelines for businesses to adhere to while developing connected systems.
A few regulatory bodies, educational institutions and governments, like Germany’s code of ethics for automated driving or the CTIA Cybersecurity Certification Test Plan, are leading the way. However, most existing frameworks are still more focussed on the aspects of ‘security’ and ‘privacy’ rather than ‘ethics’. There’s a need for more comprehensive global frameworks, that also address broader ethical challenges.
Spreading Awareness and User Education
In an era where technology pervades every facet of our lives, ensuring that every citizen is well-informed about autonomous systems becomes paramount. By fostering a culture of understanding and awareness, we pave the way for a society that engages with technology with both confidence and consciousness. Achieving this goal requires a joint effort from both technology providers and educational entities.
- Manufacturer Responsibility: Technology manufacturers bear the responsibility of designing products that are not only advanced but also user-friendly and transparent. Simplifying the complexity of technology for end-users is crucial. Manufacturers should prioritise creating intuitive interfaces that expose the end-to-end functionality of their products. This transparency ensures users have a clear understanding of how their data is collected, processed, and utilised.
- Complete Information Exposure: Beyond simplicity, providing comprehensive information on data collection and usage practices becomes imperative. Users should have access to clear and concise documentation that outlines the intricacies of the technology they interact with.
- The Role of Educational Institutions: Integrating technology education into curriculum ensures that students are not only users but informed participants in the digital landscape. Courses that cover the ethical implications of technology, IoT systems, and data privacy contribute to creating a generation with a nuanced understanding of the technology they encounter daily.
- Media Channels as Information Disseminators: Media channels, as disseminators of information, should actively contribute to tech literacy. Regular features, articles, and discussions on the ethical dimensions of technology in easily understandable formats cater to a broad audience.
- Accessibility to Basic Information: Ensuring that everyone has access to fundamental information about technology is crucial. This involves breaking down complex concepts into digestible pieces, making tech-related knowledge accessible to diverse demographics. Language, format, and delivery channels become essential considerations to bridge the knowledge gap.
Empowering Change: The Ethical Imperative in IoT Design
In Part 1 of this blog post series, we unveiled diverse challenges spanning algorithmic bias, user autonomy, and the imperative for transparency. For architects of the digital future, their responsibility is two fold: to embrace ethical design principles and to champion user awareness.
By fostering a landscape where transparency, fairness, and accountability prevail, businesses can engender user trust, increase adoption and create a more equitable future powered by technology.
