Dutch Uber Case Highlights Concerns about Secretive AI Decision-making

In a recent ruling delivered by a court in Amsterdam, Uber has been ordered to reveal data used as the basis for evaluating employees. The case established landmark rights for employees in the “gig economy” and also points toward critical questions that are likely to arise more frequently as companies move to AI-based techniques.

 

The drivers for Uber objected to the automated and opaque techniques (Uber’s Real Time ID and Ola’s Guardian system) that determined how much they earned. In December they sought access to the data that determine their payments. Uber was ordered to provide anonymized customer information, but withheld other information sought by Worker Info Exchange, the group representing the workers.

 

In a separate ruling, Ola Cabs was ordered to reveal driver performance related profiling, including the controversial “fraud probability” profile and “earnings profile” it maintains on every driver. The court did not find, as some drivers alleged, that accounts were terminated based solely on the basis of algorithms.

 

In the report Artificial Intelligence and Democratic Values, CAIDP identified “algorithmic transparency” as one of the key metrics for trustworthy and human centric AI. As the report explained, “One of the most significant AI policy issues today is Algorithmic Transparency. We take the position that individuals should have the right to access the logic, the factors, and the data that contributed to a decision concerning them.”

 

Countries that established algorithmic transparency ranked more highly in the CAIDP Index. The CAIDP report noted that algorithmic transparency is currently established in the GDPR (Article 22) and the modernized Council of Europe Privacy Convention (Article 9).

 

Marc Rotenberg

Center for AI and Digital Policy at the Michael Dukakis Institute

The Center for AI and Digital Policy advises governments on technology policy.

The critical role of A.I. in an enterprise today

Today, the role of artificial intelligence in an enterprise has become so important that it has touched every facet of business. Its role will become more critical in the years to come.

For the purposes of this article, let us define A.I. as follows. Human intelligence is learnt from experience. Machines so far have been primarily used to follow instructions, i.e. programmed, hence machines have provided automation based on rules.

A.I. is not programmed to follow rules, it is like human intelligence, learns from “experience”, i.e. data.

A.I. application in businesses today can be divided into 5 key areas:

  1. A.I. in data cleansing and streamlining.
  2. A.I. in BI—i.e. AI to replace business analysts in preliminary analysis on dashboards.
  3. A.I. in cognitive intelligence such as voice recognition, video analytics, face recognition.
  4. A.I. in natural interaction – chat bots, NLP, Natural-Language Generation (NLG).
  5. A.I. in expert systems—learning from myriad data sets and crystallizing an insight or action. This can be applied in classification of future unknowns e.g. fraud prevention, preventive maintenance. This can be applied also in forecasting quantities e.g. demand forecasting, supply shortage prediction. And can be applied in real time dynamic operations e.g. self-driving cars, dynamic digital marketing.

The original article was posted at Fortune India.

In support of positive AI development for human centric in the society, the Michael Dukakis Institute for Leadership and Innovation (MDI) and Boston Global Forum (BGF) established the Artificial Intelligence World Society (AIWS.net) in 2018. According to AIWS.net, AI can be an important tool for helping people achieve well-being and happiness, relieve them of resource constraints and arbitrary/inflexible rules and processes. In this effort, Michael Dukakis Institute for Leadership and Innovation (MDI) invites participation and collaboration with think tanks, universities, non-profits, firms, and other entities that share its commitment to the constructive and development of full-scale AI for world society.

4 key areas where AI and IoT are being combined

The Internet of Things (IoT) is a technology helping us to reimagine daily life, but artificial intelligence (AI) is the real driving force behind the IoT’s full potential.

From its most basic applications of tracking our fitness levels, to its wide-reaching potential across industries and urban planning, the growing partnership between AI and the IoT means that a smarter future could occur sooner than we think.

There are four major segments in which the AIoT is making an impact: wearables, smart home, smart city, and smart industry:

  1. Wearables

Wearable devices such as smartwatches continuously monitor and track user preferences and habits. Not only has this led to impactful applications in the healthtech sector, it also works well for sports and fitness. According to leading tech research firm Gartner, the global wearable device market is estimated to see more than $87 billion in revenue by 2023.

  1. Smart Home

Houses that respond to your every request are no longer restricted to science fiction. Smart homes are able to leverage appliances, lighting, electronic devices and more, learning a homeowner’s habits and developing automated “support.”

This seamless access also brings about additional perks of improved energy efficiency. As a result, the smart home market could see a compound annual growth rate (CAGR) of 25% between 2020-2025, to reach $246 billion.

  1. Smart City

As more and more people flock from rural to urban areas, cities are evolving into safer, more convenient places to live. Smart city innovations are keeping pace, with investments going towards improving public safety, transport, and energy efficiency.

The practical applications of AI in traffic control are already becoming clear. In New Delhi, home to some of the world’s most traffic-congested roads, an Intelligent Transport Management System (ITMS) is in use to make ‘real time dynamic decisions on traffic flows’.

  1. Smart Industry

Last but not least, industries from manufacturing to mining rely on digital transformation to become more efficient and reduce human error.

From real-time data analytics to supply-chain sensors, smart devices help prevent costly errors in industry. In fact, Gartner also estimates that over 80% of enterprise IoT projects will incorporate AI by 2022.

The original article was posted at the World Economic Forum.

According to Artificial Intelligence World Society Innovation Network (AIWS.net), AI can be an important tool tfor helping people achieve well-being and happiness, relieve them of resource constraints and arbitrary/inflexible rules and processes. In this effort, Michael Dukakis Institute for Leadership and Innovation (MDI) invites participation and collaboration with think tanks, universities, non-profits, firms, and other entities that share its commitment to the constructive and development of full-scale AI for world society.

CAIDP at Michael Dukakis Institute and AIWS to Host Screening of Coded Bias

On April 7, 2021, CAIDP at the Michael Dukakis Institute and the AI World Society will host a screening of the widely acclaimed film Coded Bias. CAIDP Senior Research Director Merve Hickok, founder of the AIEthicist.org, will lead a conversation with Director Shalini Kantayya prior to the screening.

 

About the Film

“In an increasingly data-driven, automated world, the question of how to protect individuals’ civil liberties in the face of artificial intelligence looms larger by the day. Coded Bias follows M.I.T. Media Lab computer scientist Joy Buolamwini, along with data scientists, mathematicians, and watchdog groups from all over the world, as they fight to expose the discrimination within facial recognition algorithms now prevalent across all spheres of daily life.

“While conducting research on facial recognition technology at the M.I.T. Media Lab, Buolamwini, a “poet of code,” made the startling discovery that the algorithm could not detect dark-skinned faces or women with accuracy. This led to the harrowing realization that the very machine-learning algorithms intended to avoid prejudice are only as unbiased as the humans and historical data programming them.

“Coded Bias documents the dramatic journey that follows, from discovery to exposure to activism, as Buolamwini goes public with her findings and undertakes an effort to create a movement toward accountability and transparency, including testifying before Congress to push for the first-ever legislation governing facial recognition in the United States.”

 

About Buolamwini

Joy Adowaa Buolamwini is a Ghanaian-American computer scientist and digital activist based at the MIT Media Lab. She founded the Algorithmic Justice League, an organization that looks to challenge bias in decision making software. She has testified before Congress about the dangers of facial recognition and she has called for a complete ban of police use of face surveillance. She has championed the need for algorithmic justice at the World Economic Forum and the United Nations.

Fortune Magazine described her as “the conscience of the A.I. Revolution.” In 2020, the AI World Society recognized Buolamwini as one of the leaders in  History of AI 2020

Coded Bias premieres on PBS on March 22, 2021.

Yoshua Bengio Team Proposes Causal Learning to Solve the ML Model Generalization Problem

Understanding and generalization beyond the training distribution are regarded as huge challenges in modern machine learning (ML) — and Yoshua Bengio argues it’s time to look at causal learning for possible solutions. In the paper Towards Causal Representation Learning, Turing Award honoree Bengio and his research team make an effort to unite causality and ML research approaches, delineate some implications of causality for ML, and propose critical areas for future research.

Bengio outlined the challenge in a causal representation learning talk he gave late last year, “I would say there are pretty significant gaps between current state-of-the-art in machine learning-driven AI and the intelligence that we see deployed in humans and many animals… We don’t have AI systems that actually understand at the level that humans do, or anywhere close.” Bengio characterized the meaning of human-level AI “understanding” as: capture causality; capture how the world works; understand abstract actions and how to use them to control; reason and plan, even in novel scenarios; explain what happened (inference, credit assignment); and generate out-of-distribution.

In this regard, most modern ML models remain far from true understanding, as they work only under fixed experimental conditions and interventions in the real world are seen as a nuisance that can hopefully be engineered away. It is therefore not surprising that most of today’s ML models lack an out-of-distribution generalization ability.

Causal learning, on the other hand, focuses on representing structural knowledge about the data-generating process to allow interventions and changes, making it easier to re-use and re-purpose learned knowledge. This approach is considered closer to human thinking.

This article was originally published at Synced.

Regarding to AI and Causal Inference, Professor Judea Pearl is a distinguished pioneer for developing a theory of causal and counterfactual inference based on structural models. In 2011, Professor Pearl won the Turing Award. In 2020, Michael Dukakis Institute for Leadership and Innovation (MDI) and Boston Global Forum (BGF) also awarded Professor Pearl as World Leader in AI World Society (AIWS). At this moment, Professor Judea is a Mentor of AIWS.net and Head of Modern Causal Inference section, which is one of important AIWS.net.

Global AI Policy News (March 2021)

With this issue of the CAIDP Update, we provide a survey of recent AI policy news around the globe. More AI policy news from CAIDP is available here.

The Court of Justice of the European Union heard legal arguments about the use of AI technique for the EU funded iBorderCtrl project. MEP Patrick Breyer filed the transparency lawsuit, seeking access to documents about the project. Breyer called the pilot project with lie-detecting avatars that quiz travelers at the borders “pseudo-scientific security hocus pocus.” At issue in the case is whether research funded by the EU must comply with EU fundamental rights.  (“Orwellian AI lie detector project challenged in EU court: Transparency suit highlights questions of ethics and efficacy attached to the bloc’s flagship R&D program,” Feb. 5, 2021)

According to Reuters, Japanese companies are ramping up the use of artificial intelligence and other advanced technology to reduce waste and cut costs in the pandemic, and looking to score some sustainability points along the way. (“Japanese companies go high-tech in the battle against food waste,” Feb. 28, 2021)

UNESCO has launched an Artificial Intelligence Needs Assessment Survey in Africa. The survey highlights the need to strengthen policy, legal and regulatory knowledge for AI governance in Africa. The survey notes that as AI policies are developed across Africa, countries will benefit from greater coordination and expertise to address similar and shared challenges. (UNESCO, March 4, 2021)

Digital Privacy News reports that facial-recognition technology is now one of the fastest-growing and most widely dispersed technologies in the world.  But nowhere has high-resolution facial recognition become more prevalent than inside China. According to experts in the global technology-surveillance industry, China has approximately 170 million close-circuit cameras around the nation, including at 200 airports. (“Mainland Chinese Fear Growing Use of Face Recognition,” Feb. 24, 2021)

The European Commission has launched a consultation “improving the working conditions in platform work” and algorithmic management. The inquiry noted that the Digital Services Act called for transparency in “algorithms and recommender systems used by online platforms.” (European Commission, Feb. 24, 2021)

In Kazakhstan President Kassym-Jomart Tokayev said that the pandemic has accelerated digitalization with 90% of public services now switched to e-format. President Tokayev also described a new educational initiative based on AI. He spoke at the international forum Digital Almaty 2021, which has become a key platform for discussing the digital policy agenda. (“Kazakh President addresses 4th edition of Digital Almaty int’l forum,” Feb. 5, 2021)

TechCrunch reports that Sweden’s data protection agency has fined the local police authority approximately $300,000 for unlawful use of the controversial facial recognition software Clearview AI. The police will be required to educate staff and prevent any future processing of personal data in breach of data protection rules and regulations. (Sweden’s data watchdog slaps police for unlawful use of Clearview AI,” Feb. 12, 2021)

In Mexico, Dr. Ricardo Monreal Ávila has introduced legislation to regulate social media. The proposal aims to ensure human review of automated decisions by AI systems that could limit access to the Internet, such as the permanent cancellation of user accounts. Senator Monreal is encouraging public comment on his proposal.

In the United States, the Chinese tech firm ByteDance, the operator of TikTok, has agreed to pay $92 million to settle a class action privacy lawsuit. The lawsuit charged, among several other claims, that the company provided user data to the Chinese government to assist in meeting two “crucial and intertwined state objectives: (a) world dominance in artificial intelligence  and (b) population surveillance and control.” Also at issue in the case was TikTok’s use of AI techniques  for facial recognition.

Uzbekistan accelerates introduction of artificial intelligence technologies. According to the Trend News Agency, the Institute for the Development of Artificial Intelligence will be created in Uzbekistan after President Shavkat Mirziyoyev signed a decree on measures to create conditions for the accelerated introduction of artificial intelligence technologies.

 

Marc Rotenberg, Director

Center for AI and Digital Policy at the Michael Dukakis Institute

The Center for AI and Digital Policy, founded in 2020, advises governments on technology policy.

Who Should Stop Unethical A.I.?

In computer science, the main outlets for peer-reviewed research are not journals but conferences, where accepted papers are presented in the form of talks or posters. In June, 2019, at a large artificial-intelligence conference in Long Beach, California, called Computer Vision and Pattern Recognition, I stopped to look at a poster for a project called Speech2Face. Using machine learning, researchers had developed an algorithm that generated images of faces from recordings of speech. A neat idea, I thought, but one with unimpressive results: at best, the faces matched the speakers’ sex, age, and ethnicity—attributes that a casual listener might guess. That December, I saw a similar poster at another large A.I. conference, Neural Information Processing Systems (Neurips), in Vancouver, Canada.

Many kinds of researchers—biologists, psychologists, anthropologists, and so on—encounter checkpoints at which they are asked about the ethics of their research. This doesn’t happen as much in computer science. Funding agencies might inquire about a project’s potential applications, but not its risks. University research that involves human subjects is typically scrutinized by an I.R.B., but most computer science doesn’t rely on people in the same way. In any case, the Department of Health and Human Services explicitly asks I.R.B.s not to evaluate the “possible long-range effects of applying knowledge gained in the research,” lest approval processes get bogged down in political debate. At journals, peer reviewers are expected to look out for methodological issues, such as plagiarism and conflicts of interest; they haven’t traditionally been called upon to consider how a new invention might rend the social fabric.

A few years ago, a number of A.I.-research organizations began to develop systems for addressing ethical impact. The Association for Computing Machinery’s Special Interest Group on Computer-Human Interaction (sigchi) is, by virtue of its focus, already committed to thinking about the role that technology plays in people’s lives; in 2016, it launched a small working group that grew into a research-ethics committee. The committee offers to review papers submitted to sigchi conferences, at the request of program chairs. In 2019, it received ten inquiries, mostly addressing research methods: How much should crowd-workers be paid? Is it O.K. to use data sets that are released when Web sites are hacked? By the next year, though, it was hearing from researchers with broader concerns. “Increasingly, we do see, especially in the A.I. space, more and more questions of, Should this kind of research even be a thing?” Katie Shilton, an information scientist at the University of Maryland and the chair of the committee, told me.

Shilton explained that questions about possible impacts tend to fall into one of four categories. First, she said, “there are the kinds of A.I. that could easily be weaponized against populations”—facial recognition, location tracking, surveillance, and so on. Second, there are technologies, such as Speech2Face, that may “harden people into categories that don’t fit well,” such as gender or sexual orientation. Third, there is automated-weapons research. And fourth, there are tools “to create alternate sets of reality”—fake news, voices, or images.

The original article was published at The New Yorker.

To support for AI Ethics, Michael Dukakis Institute for Leadership and Innovation (MDI) and Artificial Intelligence World Society (AIWS.net) has developed AIWS Ethics and Practice Index to measure the ethical values and help people achieve well-being and happiness, as well as solve important issues, such as SDGs. Regarding to AI Ethics, AI World Society (AIWS.net) initiated and promoted to design AIWS Ethics framework within four components including transparency, regulation, promotion and implementation for constructive use of AI. In this effort, Michael Dukakis Institute for Leadership and Innovation (MDI) invites participation and collaboration with think tanks, universities, non-profits, firms, and other entities that share its commitment to the constructive and development of full-scale AI for world society.

CAIDP Comments on AI Strategy to US AI Commission

The Center for AI and Digital Policy (CAIDP) at the Michael Dukakis Institute (MDI) have provided detailed recommendations  for the National Commission on AI. The recommendations follow from the CAIDP report Artificial Intelligence and Democratic Values, a comprehensive review of AI policies and practices in 30 countries.

The NSCAI is scheduled to release its final recommendations for Congress on Monday, March 1, 2021. CAIDP Director Marc Rotenberg and Michael Dukakis Institute CEO Tuan Nguyen wrote “We believe it is vitally important for the United States to pursue a policy for artificial intelligence that reflects democratic values.”

The CAIDP Statement to the NSCAI noted favorably US support for the OECD/G20 AI Principles, the Presidential Executive Orders on AI, and legislation in Congress to establish a national AI strategy that addresses concerns about bias and fairness. But the CAIDP Statement raised concerns about the “opaque policy process” in the US, the reluctance of the Commission to conduct open meetings, and the absence of a data protection agency in the United States.

Regarding the report of the NSCAI, the CAIDP acknowledged “the substantial work of the Commission over a two-year period on this complex and important issue.” CAIDP also supported the International Digital Democracy Initiative However, the CAIDP raised several concerns. “Although we appreciate the brief opportunity to comment on the draft of the final report, there was too little input from the general public in the work of the Commission and too few opportunities for formal comment. The US Commission on AI did not even assess whether the US had taken steps to implement the OECD AI Principles or the G20 AI Guidelines, formal international commitments that the United States has already made.”

“We are also concerned by the decision of the Commission not to support a global prohibition of AI-enabled and autonomous weapon systems. . . . our recent review of country policies strongly indicates support among democratic nations for limits on these systems.”

CAIDP made several recommendations for the final NSCAI report:

– implement the OECD AI Principles
– establish a process for meaningful public participation in the development of national AI policy
– establish an independent agency for AI oversight
– establish a right to algorithmic transparency
– support the Universal Guidelines for AI
– support the Social Contract for the AI Age
– support an International Accord for AI
– reconsider the opposition to a ban on lethal autonomous weapons

The NSCAI event will be cybercast on Monday, March 1, 2021 at 12:00 EST. Registration is open to the public. Comments on the NSCAI report may be sent here.

 

Marc Rotenberg, Director

Center for AI and Digital Policy at the Michael Dukakis Institute

The Center for AI and Digital Policy, founded in 2020, advises governments on technology policy.

Software Testing Is Tedious. AI Can Help.

These days, every business is a software business. As companies try to keep up with the rush to create new software, push updates, and test code along the way, many are realizing that they don’t have the manpower to keep pace, and that new developers can be hard to find. But, many don’t realize that it’s possible to do more with the staff they have, making use of new advances in AI and automation. AI can be used to address bugs and help write code, but it’s greatest time saving opportunity may be in unit testing, in which each unit of code it checked — tedious, time-consuming work. Using automation here can free up developers to do other (more profitable) work, but it can also allow companies to test more expansively and thoroughly than they would have before, addressing millions of lines of code — including legacy systems that have been built on — that may have been overlooked.

Not all of the software development workflow can be automated, but gradual improvements in technology have made it possible to automate increasingly significant tasks: Twenty years ago, a developer at SUN Microsystems created an automated system — eventually named Jenkins — that removed many of the bottlenecks in the continuous integration and continuous delivery software pipeline. Three years ago, Facebook rolled out a tool called Getafix, which learns from engineers’ past code repairs to recommend bug fixes. Ultimately these advances — which save developers significant time — will limit failures and downtimes and ensure reliability and resilience, which can directly impact revenue.

But as AI speeds up the creation of software, the amount of code that needs to be tested is piling up faster than developers can effectively maintain. Luckily, automation — and new automated tools — can help with this, too.

Automation is coming to all parts of the software development process, some sooner than others — as AI systems become increasingly powerful, the options for automation will only grow. OpenAI’s massive language model, GPT-3, can already be used to translate natural human language into web page designs and may eventually be used to automate coding tasks. But eventually, large portions of the software construction, delivery, and maintenance supply chain are going to be handled by machines. AI will, in time, automate the writing of application software altogether.

The original article was published at the Harvard Business Review.

In support of positive AI development for the society, Michael Dukakis Institute for Leadership and Innovation (MDI) and Boston Global Forum (BGF) has established Artificial Intelligence World Society Innovation Network (AIWS.net). In this effort, MDI and BGF invite participation and collaboration with governments, think tanks, universities, non-profits, firms, and other entities that share its commitment to the constructive and development of full-scale AI for world society. This initiative is to develop positive AI for helping people achieve well-being and happiness, relieve them of resource constraints and arbitrary/inflexible rules and processes, and solve important issues, such as SDGs.