Reflecting on responsibility in AI with Daniel Dennett

One of the most influential contemporary philosophers is Daniel Dennett. Based on Darwin’s theory of evolution, he has developed a new notion of free will, responsibility and consciousness. These new perspectives can help us navigate the debate on responsibility in AI, especially since some designs are inspired by the workings of the human brain. Questions and concerns we have regarding AI and responsibility appear to show great similarities with those regarding humans, and Dennett offers us tools to think them through.

Observations

  • Responsibility is traditionally associated with free will, for it seems evident that only when someone is able to choose between A and B, it is reasonable to hold him accountable for his choice. Free will furthermore implies we are capable of making decisions that are not the necessary result of any cause (e.g. enforcement, compulsion), for if that were the case, the decision would not be a matter of choice after all.
  • Causal determinism, the idea that every event is the necessary result of a concurrence of preceding other events, gained credibility from scientific discoveries in for example biology (e.g. Darwin’s theory of evolution), physics (e.g. Newton’s laws of physics) and neuroscience (e.g. Erik Kandel’s work on the neurological workings of memory). Though first applied mainly to events that concern the outer world (e.g. the movements of the stars or the way sunlight causes plants to grow), the theory later gained relevance in the study of more intrinsic phenomena such as anger or the ability to show compassion. And so, our decisions are increasingly linked to mechanical, neurological processes in the brain, which seems incompatible with the traditional idea of free will and responsibility.
  • With the emergence of artificial intelligence, we created the possibility of outsourcing many of our tasks and decisions. These tasks come with considerable responsibility, such as those concerning self-driving cars or recruiting tools. The technology (e.g. deep learning) that underlies these applications often becomes a black box for its makers and users, since its algorithmic paths are too complex to trace back. This makes it hard to determine who is responsible for its actions. We commonly consider these technologies incapable of free will since their actions are determined by the algorithms they follow. However, although as yet we still turn to their makers for accountability, this might not be feasible in the long-term, since they often have neither control over, nor insight into the way these algorithms evolve.
  • The difficulties that arise in the matter of responsibility in humans and AI show great similarities. In both debates (1) the idea that an agent can only be accountable for his actions when they are the result of free will is problematic since (2) both the actions of humans and AI seem to result from unconscious processes that obey the mechanic rules of cause and effect (if A, then B). Daniel Dennett has offered a model of responsibility that deals with these difficulties.

Analysis

Daniel Dennett’s model of free will and responsibility is rooted in an unconscious process of biology and laws of physics that are determined by the mechanic rules of cause and effect. He claims that the system that underlies everything that exists and happens combines countless cases of causes with necessary effects that together cause numerous other necessary effects, and so on. This system is so extensive that we will only be able to comprehend little bits and pieces of its ingenuity at best. We and everything we do are necessary effects of this system too. Free will in the traditional sense is therefore an illusion, since ultimately, our actions are always the necessary effect of a combination of the countless events that happened before. He compares this illusion with stage magic, which is in fact a combination of greatly performed tricks. In our case, Dennett argues that it is our brain that tricks us into believing all sorts of things, among which the existence of free will.

Although the workings of the brain and the workings of AI show great similarities, it is our extensive evolutional history that sets us apart.

For Dennett, this does not mean we can’t have responsibility. Although free will in the more traditional sense is indeed impossible, free will in the sense of superior evolutional biology is possible. In the course of billions of years, greater competences have evolved and the cognitive human competences exceed those of other lifeforms. This not only makes it possible to respond in a superior manner to situations, it also gives us the opportunity to experience a sense of reason or meaning to our (re)actions. Whether these reasons are ultimately accurate or not is irrelevant here. Their function is to guide us, not to give insight in the true workings of our brain. Our highly developed cognitive competences and sense of meaning have resulted in culture, science, art, and so on.

If we accept Dennett’s emphasis on the importance of the extensive and dazzling path of cause and effect that brought us to this point of sophistication, an agent can be responsible when two conditions are fulfilled: it has developed highly cognitive abilities and it holds a set of beliefs that generate a sense of meaning (e.g. reasons why we act and live). The belief in a higher power, for example, has served an important purpose in our evolution, according to Dennett. Fragile as we humans are, it is vital for us to work together. With the emergence of human intelligence, however, we became capable of “cheating” in the game of survival by lying to one another. To illustrate: I can say that I went out hunting with no success, while in fact, I have secretly been enjoying a lazy day. This could jeopardize the survival chances of my tribe. However, my belief in a higher power causes me to feel that my misbehavior will be noticed and punished one way or another, which directs me to more responsible behavior.

How does this idea translate to AI and responsibility? Is AI able to fulfil the two conditions of responsibility according to Dennett’s philosophy? Deep learning has proven to be able to quickly evolve its impressive calculation abilities, which could result in a set of highly developed “cognitive” competences. Impressive competences are already emerging: in many specialized domains, they outperform human experts (e.g. detecting cancer). The second condition, implementing a set of beliefs that add a sense of meaning, also seems to be possible. This was already imagined in science fiction when AI was still in its infancy. In Steven Spielberg’s movie A.I., for example, a robot child who is programmed to love the woman who turns on the switch of eternal motherlove, which determines all of his actions from then on. Experiments with the implementation of human-like convictions have already been done with, for example, self-driving cars to make them better drivers.

This would mean that AI, at least in principle, is a good candidate for accountability according to Dennett’s perspective. However, Dennett’s philosophy also implies that the way our responsibility came about is impossible to duplicate because of its origin in a unique process of cause and effect. Human responsibility emerged from billions of years of evolution and from animated bodies. The way our brains came about therefore differs profoundly from the way AI programs are made. Even if AI could exercise responsibility, its particular variant might never turn out as we want it to. He argues that the biggest danger in AI is that we are so impressed with its calculating powers, we forget that the workings of our own brain are infinitely more ingenious. So, although the workings of the brain and the workings of AI show great similarities, it is our extensive evolutional history that sets us apart. Dennett concludes that in the foreseeable future, AI may offer intelligent tools which can be highly optimized, but we shouldn’t hold our breath to see them become our new colleagues.

Implications

  • If we could agree on another definition of responsibility, and many will, the answer to the question whether AI can be responsible would turn out differently. However, whether we agree or not with philosophical models like Dennett’s, they and their opponents provide guidance in complex debates like these and help us navigate our expectations and concerns. In this case, Dennett’s model shows us how a mechanic process of necessary cause and effect can still result in accountable agents, whether human or artificial, while keeping a certain distinction between humans and AI.
  • Famous inventor Ray Kurzweil argued that, even though the capabilities of our brain are still superior to those of AI, this could change more rapidly than we might think. The exponential growth of complexity in AI combined with our increasing insights in the workings of our brain can lead to so-called ‘whole brain emulation’ or mind uploading. AI could then meet the two conditions of Dennett’s responsibility model, and Dennett’s reservations on AI’s capabilities would dissolve.
  • The idea that AI will develop the same mechanism as humans to cope with certain situations is already hinted on. A DeepMind program of Google, for example, was only assigned to go from A to B without any further information or example of how this could be done. The program came up with a body that looks like a human body that can walk, jump and keep balance while being pushed. This not only implies that our intelligence and behavior can be duplicated, it also implies that it can origin in mechanic rules of cause and effect.

The implementation of 5G is important for the upgrade of Alibaba & Tencent’s services

5G is the next generation of ultra-fast wireless technology, offering faster data rates, reduced latency, energy savings, cost reductions, higher system capacity, and massive device connectivity. It is expected to power industrial applications such as smarty city infrastructure and the industrial internet, but can also impact consumer services. For example, 5G will enable Tencent’s gamers to seamlessly stream PC and console-quality games on their smartphones without sacrificing processing power or battery life. For Alibaba’s short-video platform Youku, a 5G connection would mean that users can send high-resolution 4K video within a few seconds.

In fear of dependency on Western hardware, Alibaba has set up a semiconductor division

Resembling the States’concern, both Ma’s have outspoken their fear of western depencency when it comes to core technologies:

Alibaba’s Ma:

If we do not master the core technologies, we will be building roofs on other people’s walls and planting vegetables in other people’s yards.

Tencent’s Ma:

[China]’s digital economy will be a high-rise built on sand and hard to sustain if we don’t continue to work hard on basic research and key knowledge, not to mention the transformation from old to new forms of drivers or high-quality development.

In reaction, Alibaba’s R&D arm DAMO (Academy for Discovery, Adventure, Momentum, and Outlook) has set up its own semiconductor manufacturing business and unveiled its chip in July 2019. The chip is designed to process AI tasks such as image, video and voice analysis and will be used for tasks such as autonomous driving, smart cities and smart logistics.

 

Listen to this podcast for more information about 5G in China:

The implementation of 5G is important for the upgrade of Alibaba & Tencent’s services

5G is the next generation of ultra-fast wireless technology, offering faster data rates, reduced latency, energy savings, cost reductions, higher system capacity, and massive device connectivity. It is expected to power industrial applications such as smart city infrastructure and the industrial internet, but it can also impact consumer services. For example, 5G will enable Tencent’s gamers to seamlessly stream PC and console-quality games on their smartphones without sacrificing processing power or battery life. For Alibaba’s short-video platform Youku, a 5G connection would mean that users can send high-resolution 4K video within a few seconds.

In fear of dependency on Western hardware, Alibaba has set up a semiconductor division

Similar to the state’s concerns, Tencent’s and Alibaba’s Ma’s have expressed their fear of western dependency when it comes to core technologies.

“If we do not master the core technologies, we will be building roofs on other people’s walls and planting vegetables in other people’s yards.”
– Jack Ma (CEO Alibaba)

“China’s digital economy will be a high-rise built on sand and hard to sustain if we don’t continue to work hard on basic research and key knowledge, not to mention the transformation from old to new forms of drivers or high-quality development.”
– Pony Ma (CEO Tencent)

In reaction, Alibaba’s R&D arm DAMO (Academy for Discovery, Adventure, Momentum, and Outlook) has set up its own semiconductor manufacturing business and unveiled its chip in July 2019. The chip is designed to process AI tasks such as image, video and voice analysis and will be used for tasks such as autonomous driving, smart cities and smart logistics.

Alibaba and Tencent and Censorship

Within their services and products, Tencent and Alibaba help the government by censoring keywords deemed politically sensitive, while in-house censors also delete posts and accounts. Tencent is quite active in censoring, as the company scored a zero out of 100 for WeChat’s lack of freedom of speech protection and lack of end-to-end encryption in a 2016 Amnesty International report on user privacy.

Alibaba and Tencent have high hopes for the cloud

For Tencent and Alibaba, the cloud started as a crucial component of their internal economy. Over the past few years they have branched out, offering their in-house products to businesses.
Today, Alibaba dominates cloud computing in China with a 43% market share. Under Jack Ma, Alibaba made cloud computing a key priority, and CEO Daniel Zhang plans to make cloud computing technologies an even bigger part of Alibaba’s corporate focus over the next couple of years (for more information see Alibaba’s company profile).
Tencent’s cloud business is the second largest in China, with an 11% market share, according to industry researcher IDC. The company entered the ‘cloud-game’ relatively late, and recently announced to spur its push in cloud computing by investing billions of dollars. This move can be seen as part of its overall strategy to shift focus from its consumer-faced business to the industrial internet. Its cloud-computing business should cater to industries such as retail, mobility, healthcare, and education.

Alibaba and Tencent are members of the National AI Team

Starting in 2017, the Chinese government recruited Alibaba, Tencent, Baidu and iFlyTek to lead key projects in the development of next-generation AI technologies. Alibaba’s cloud computing division was tasked with a smart city project to improve urban life (see Smart Habitat layer for more details), while Tencent has been designated to become a leader in AI-assisted medical diagnosis.
Government endorsement helped Tencent to launch its AI Medical Innovation System, an AI-powered diagnostic medical imaging service. The technology currently has accuracy rates of over 90% for preliminary diagnoses of esophageal cancer, 95% for lung sarcoidosis, and 97% for diabetic retinopathy. Several of Tencent’s AI departments, such as the AI Lab and Tencent Youtu Lab, collaborated to develop the image recognition, using the over 1 billion images on the company’s social network. After the success in healthcare, Tencent is looking to apply its AI knowledge to other applications, such as transportation solutions, security, and protection, as well as voice recognition.

In this episode of the ChinaEconTalk podcast, China expert Jeff Ding of the Future of Humanity Institute discusses the detour Tencent is making from the national champion designation [12:18-13:35]:

Alibaba and Tencent are working on the city of the future…

ET City Brain
The Chinese government designated Alibaba with the task of applying innovative technology to improve urban life. This resonated in Alibaba’s cloud-powered and AI-driven urban project “ET City Brain,” which aims to use AI to optimize city-services in real-time. One of Alibaba’s first pilots focused on reducing traffic congestion in Hangzhou. The video below shows how innovations within several layers of the Stack (think of Cloud Computing, Facial Recognition, and AI) are merged to improve traffic speed up to 11%.

PATH
A joint effort in the smart city area is PATH (Ping An, Alibaba, Tencent, Huawei), a smart city initiative in which these four Chinese tech giants apply their core technologies and an investment of 50M RMB in order to propel China into the global smart cities race (and of course to counter some major problems such as air pollution and congestion).

…but rural areas are also a key priority for Alibaba and Tencent

While smart digital applications are often first rolled out in #tier 1 or 2 cities, both Alibaba and Tencent are currently working on a Rural Strategy. Especially Alibaba sees tier 3, 4 and 5 cities and rural areas as an important new addressable market.
Striking examples are:

•  Tencent-backed WeDoctor and Alibaba’s Good Doctor are making healthcare more accessible for patients in tier 3 and 4 cities.
•  Alibaba invested 716 million USD in Huitongda Network, a platform that offers a variety of business models to help offline stores sell goods via e-commerce offerings, and also help online retailers sell directly to rural residents.
•  Alibaba launched Rural Taobao in 2014, allowing rural residents to buy and sell items online through the company’s Taobao online marketplace. Since its creation, Rural Taobao has expanded steadily, growing to cover 29 provinces, more than 700 counties, and over 30,000 villages.
•  Juhuasuan is Alibaba’s group-buying and flash-sale platform and will be repositioned as an online marketplace for consumers in tier-4, tier-5 cities and rural areas.

“China is experiencing an ongoing consumption upgrade as people look for different ways to enhance their lifestyle. (…) We are now seeing more and more consumers in China’s less-developed regions becoming sophisticated shoppers. They are demanding the same high-quality products as those in top-tier cities.”

– Jiang Fan, President of Tmall and Taobao

Tencent and Alibaba aim for a friction-free consumer interaction through voice

Both Alibaba and Tencent are investing in new consumer interfaces. For example, they are discovering the power of voice as an interface, and more specifically the smart speaker;

Alibaba’s voice assistant is called Tmall Genie. The device is on the market as a regular speaker since 2017 but is also available as a mirror (Tmall Genie Queen) as a device in connected cars (Tmall Genie Auto), and with a built-in monitor (Tmall Genie Family).

The Voice Assistant will become an increasingly important player in our life. I believe that in the coming decade, it will be connected with more devices and be the point of connection for different scenarios in our life, using voice commands to control our homes, vehicles and our personal devices.”

– Miffy CHEN, General Manager, Alibaba AI Labs

Two years after Alibaba, Tencent launched its smart speaker Xiaowei. The launch of Xiaowei is seen as a move of Tencent into diversifying its products and services into more business and industries (such as the B2B and IoT market). Besides, Xiaowei (in English ‘WeChat italking’) will link WeChat users with Tencent’s services available through QQ and WeChat.

Tencent and Alibaba are investing in facial recognition technology

Based on the number of facial recognition patents, Tencent is more active in the field of face recognition than Alibaba. Nevertheless, both companies have already implemented facial recognition in real-life situations.
Tencent is working closely with government in implementing facial recognition. For example, some provinces are issuing electronic identification cards for their citizens using WeChat’s facial recognition technology. The mobile IDs can be used for authentication instead of carrying physical ID cards – mandatory for citizens at all times in China – for travel booking, real name registration at internet cafés, and other security checks. Furthermore, amid tighter scrutiny by the Chinese government, Tencent uses facial recognition to detect minors in relation to concerns that excessive video gaming is damaging public health.

In 2017, Alipay unveiled its facial recognition payment service ‘Smile to Pay.’ The company says that as facial recognition technology takes the place of QR codes, “paying by smiling” will most likely experience explosive growth over the next three years. Statistics from Alibaba during 2018’s shopping festival around singles day also suggest that payments through the face and fingerprint scans now make up 60% of all transactions.

Alibaba’s Smile To Pay system in KFC:

Alibaba and Tencent are developing their own social credit systems

The best-known private system is Sesame Credit, developed by Ant Financial, an affiliate of Alibaba. Sesame Credit is a scoring system that generates individual credit scores for consumers by tapping into Alibaba Group and Ant Financial’s vast online ecosystem and other personal credit information sources. Sesame Scores, which range from 350 to 950 points, are calculated based on five factors – credit history, behavioral preference, fulfillment capability, personal attributes and social network – and are indicators of the users’ creditworthiness. Although the system’s focus is on creditworthiness, a low score can have an impact beyond loans (e.g. being banned from certain hotels) and a government blacklist has also been integrated. At the same time, a high score gives members the possibility to relax in special lounges at China’s train stations or to use bike sharing platforms HelloBike and Ofo deposit free.

Listen to this NPR podcast on the rollout of a Chinese Social Credit System and the role of Alibaba in it:

Tencent is also testing a credit scoring feature for WeChat Pay. Similar to Alibaba’s Sesame Credit, its score is calculated based on WeChat Pay’s pool of data, particularly on personal consumption behaviour. According to Tencent, the purpose is to “provide services that make people’s lives simpler and more convenient.” Users with high scores will be rewarded with perks such as waiving of deposits for rental services and hotels, and paying for services and goods after delivery.

Tencent and Alibaba contirubte to the State’s innovation goals

Although Tencent and Alibaba are originally consumer-focused companies, they are expanding their businesses to the ‘industrial internet’, which involves the broader adoption of advanced consumer and industrial applications that take advantage of next-generation technologies for business purposes.

For instance, Tencent is teaming up with Huawei Technologies, a Chinese multinational technology company that provides telecommunications equipment and sells consumer electronics, to accelerate innovation in core technologies, such as AI and cloud computing.

Meanwhile, last year Alibaba’s CEO Jack Ma called for Chinese traditional manufacturers to fully embrace what he called the “New Manufacturing” model. New Manufacturing involves a transformation of traditional manufacturing industry by integrating technology capabilities in the internet, data, AI, cloud computing and IOT. “Proposing the New Manufacturing model is not because Alibaba plans to enter the manufacturing industry, but rather to help manufacturing companies to innovate and upgrade,” Ma said during the 2018 Cloud Computing Conference in Hangzhou. “During this shift, the current manufacturer-oriented industry will transition to a new era led by customers, where small and medium-sized enterprises can benefit the most.”’

Incubators
Furthermore, both Alibaba and Tencent invest heavily in startups and support emerging companies with incubator programs. Tencent’s WeStart for example operates innovation spaces where it offers start-ups office space to rent and incentives such as tax exemption for three years and favorably-priced access to Tencent’s products and infrastructure. Furthermore, the company assists start-ups to target government-backed support programs. Meanwhile, Alibaba’s Cloud division teamed up with the U.S. workspace operator WeWork to develop an incubation program for 20 foreign startups to enter China, and assist 30 Chinese companies to expand overseas.

Alibaba and Tencent investments in electric vehicles

Alibaba, Tencent and several other Chinese companies have joined efforts to meet China’s ambitions concerning green growth of the automotive industry. They have setup car-sharing services T3, which is powered by renewable energy, called T3.

Other examples of investments in the green future of this industry are Alibaba’s leading role in the 2.2B RMB funding round in Xiaopeng Motors, a Chinese electric car maker that aims to speed up the development of electric vehicles. Alibaba elaborates on this investment: “As a clean energy vehicle start-up, the investment in Xiaopeng Motors fits with Alibaba’s strategic focus in the automotive sector. Under our open-platform approach, we will continue to work with a range of automotive manufacturing partners to benefit Chinese consumers”.

Alipay and Wechat transformed China’s Digital payment landscape

China is a country where Visa and Mastercard are (still) banned, and it has an underdeveloped banking system. As a result, Chinese society remained largely cash-based for a long time. Nevertheless, when China started to manufacture cheap mobile phones, Alibaba and Tencent successfully set-up their own mobile payment solutions known as Alipay (by Alibaba) and WeChat Pay (by Tencent).

Users of these payment solutions link their bank cards to the wallet inside the app. Once linked, they are able to use the wallet as a debit card for direct payments in stores or for online purchases. Furthermore, users can transfer money from their bank account to create a balance on the wallet.

The digital solutions provided by Alibaba and Tencent made it extremely easy for consumers to pay with their mobile phone. In 2018, over 85% of purchases made in China were on mobile payment platforms.
In physical shops, merchants offer consumers the opportunity to pay with WeChat Pay and Alipay mostly with QR codes.

Alibaba and Tencent are SOE-investors

Established in the late nineties, with founders around 50 years old, Alibaba and Tencent are classic examples of companies that stem from the previous generation. Alibaba and Tencent realize though that today’s wave of entrepreneurs is bringing products and services that appeal to Generation Z, and this is the reason they are heavily investing in innovative startups within and beyond the Chinese border. Furthermore, to arm themselves against newcomers, Alibaba and Tencent are combining their strengths to secure their position (see section 1).

Alibaba and Tencent are SOE-investors

As a testing-ground of the mixed-ownership reform, Tencent and Alibaba have both invested in China Unicom, the country’s second-largest wireless telecom operator. These investments are financial, but are also intended to improve the services of state firms. For example, Alibaba and Unicom launched a cloud knowledge venture in order to meet demand from SOEs and governmental institutions in China for innovative technology solutions. Tencent and China Unicom are amongst other things, working on a network security platform.

Tencent’s hometown is a Special Economic Zone

Tencent’s hometown Shenzen was appointed one of the first Chinese area’s to be a SEZ. Tencent – founded in 1998 – witnessed the effects of the nomination: the share of high-tech industries in its total industrial output increased from less than 10% in 1990 to nearly 40% in 1998. Companies could make use of incentives such as access to quality infrastructure, corporate income tax exemptions, exemptions from tariffs on high-tech equipment and special treatment for employees. Other companies that arose in this area were Huawei and ZTE ( global telecommunications equipment, networks and mobile devices company).

Alibaba and Tencent endorse the Communist Party

Tencent released a mobile game titled ‘Clap for Xi Jinping: An Awesome Speech’, in which players have 19 seconds to generate as many claps as possible for Xi.

In 2019, Alibaba reportedly developed the popular Communist Party propaganda app ‘Xuexi Qiangguo’ (in English: study to make China strong). Alibaba staff is said to be responsible for developing and maintaining the app that includes news, videos, livestream and community comments.

Confucian philosophy & Daoism underlie Alibaba’s corporate culture

Without the philosophy of Buddhism, you cannot do well when your business grows to a certain extent. If you do not know the philosophy of Daoism, you have no chance of winning during competitions. If you do not understand Confucian philosophy on the construction of organizational system, you have no chance to be sustainable when your company grows to a certain size.”

– Jack Ma, Founder and CEO Alibaba

Alibaba’s Founder and CEO is strongly influenced by China’s idea of the good life. He always carries a copy of the Tao Te Ching, the foundational text of Taoist philosophy, is a big fan of Tai Chi, and has held meetings with the senior executive team of the company in a temple. Under the eyes of Buddha, the focus would naturally be how to help others, to help ever more people.
Furthermore, Ma actively spreads the Taoist way of thinking among company employees. In the early days, all of them had a Kung Fu nickname (Kung Fu and Taoism are closely linked), Jack Ma’s being “Feng Qingyang”, which refers to an “unpredictable and aggressive” swordsman.
According to Brian Wong, Alibaba’s vice president of global initiatives, an understanding of the principles behind the philosophies do help in having a better grasp of why the Chinese tech market works the way it does. “China is much more about integrating as opposed to taking over or competing in the traditional sense,” Wong explains. “We want to create and integrate.”

Rare earhts are none of Tencent’s and Alibaba’s business

Rare earths are none of Tencent’s and Alibaba’s business. Apart from Alibaba’s semiconductors, both companies do not produce goods, and therefore they are not investing in, or owning, rare earths.

Tencent has dipped its toes in vertical drama

Tencent first dipped its toes into the vertical drama category in 2018, releasing short series like My Boyfriend-ish Sister and My Idiot Boyfriend. These entertainment shows are specifically designed for the mobile screen.

Example of vertical drama by Tencent
Source: V.QQ (2018)