China Focus: Data-labeling: the human power behind Artificial Intelligence

Source: Xinhua| 2019-01-17 20:42:21|Editor: ZX
Video PlayerClose

BEIJING, Jan. 17 (Xinhua) -- In a five-story building on the outskirts of Beijing, 22-year-old Zhang Yusen stares at a computer screen, carefully drawing boxes around cars in street photos.

As artificial voices replace human customer services in call centers and robots replace workers on production lines, Zhang, a vocational school graduate, has found a steady job: data-labeling, a new industry laying the groundwork for the development of AI technologies.

SUPERVISED LEARNING

As the "artificial" part of AI, data labeling receives much less media attention than the "intelligence" part of computer algorithms.

Facial recognition, self-driving, diagnosis of tumors by computer systems and the defeat of best human Go player by Alpha Go are ways AI technologies have amazed in recent years.

However, for researchers, the current AI technologies are still quite limited and at an early stage.

Professor Chen Xiaoping, director of Robotics Lab at the University of Science and Technology of China, said all AI technologies so far have come from "supervised" learning in which an AI system is trained with specific forms of data.

Take training a machine to recognize dogs for instance: the system must be fed vast numbers of pictures labeled by humans to tell the system which pictures have dogs and which don't.

Chen noted the human brain is excellent at processing unknown information with reasoning, but it is still impossible for AI. A kindergartener can make the guess of soccer ball from clues like "a black and white round object you can kick," but it's not a easy task for AI. An AI system might be able to tell all different kinds of dogs, but it cannot tell a stuffed animal is not real if such images are not sent to the system.

Yann LeCun, AI scientist at Facebook and widely considered one of the "godfathers" of machine-learning, said recently, "Our best AI systems have less common sense than a house cat."

Behind powerful AI algorithms are vast complicated dataset built and labeled by humans.

ImageNet is one of the world's largest visual databases designed to train AI systems to see. According to its inventors, it took nearly 50,000 people in 167 countries and regions to clean, sort and label nearly a billion images over more than three years.

QUALITY CHECKING

For top researchers like Chen Xiaoping, the next AI breakthrough is expected in self-supervised or unsupervised learning in which AI systems learn without human labeling. But no one knows when it will happen.

"I think in the next five to 10, maybe 15 years, AI systems will still rely on labeled data." said Du Lin, CEO and founder of data-labeling firm BasicFinder.

Du published his first paper about computer vision when he was in high school. After graduating from college, his first windfall came from selling a startup data-digging firm for 4 million U.S. dollars.

In 2014, Du and his partners noticed the rise of AI deep-learning and founded BasicFinder. The company is now a leading data-labeling company, with clients including Stanford University, the Chinese Academy of Sciences, China Mobile and Chinese AI startup SenseTime.

At BasicFinder, a typical work flow starts with taggers like Zhang Yusen. After training two to three months, they draw boxes around cars and pedestrians in street photos, tag ancient German letters, or transcribe snatches of speech.

The labeled images are submitted to quality inspectors who check 2,000 pictures a day. If one image is found inaccurately tagged in every 500 images in random checks, the company is not paid the original price. If the error rate exceeds 1 percent, clients can ask to change data-taggers.

Du said the company has been optimizing work flow to ensure greater accuracy as well as to protect intellectual property and privacy.

HUMAN IN LOOP

A model that requires human interaction is called "human in the loop" and humans remain in the loop much longer than many have expected, said Du.

Data-taggers now work on outsourcing platforms as far afield as Mexico, Kenya, India and Venezuela. Anyone can create an account to become a freelance data-tagger.

But Du strongly disagrees that data-labeling companies, depicted in some media reports as "the dirty little secret" of AI, resemble Foxconn's infamous iPhone factories.

He noted that due to the nature of AI deep-learning, it is the greater accuracy of labeled data that keeps a company alive and thriving, rather than low prices and cheap labor.

China's Caijing magazine reported in October last year that about half of data-labeling companies in China's Henan Province went bust in 2018 as orders dried up.

Du said that in the past two years, many found data-labeling a tough market. The first spurt of growth has ended and a lot of workshop-like companies have been knocked out.

A full-time data-tagger at BasicFinder can earn 6,000 to 7,000 yuan a month, along with accommodation and social benefits. In the first three quarters of 2018, the disposable income per capita in Beijing was 46,426 yuan, around 5,158 yuan a month, according to local government statistics.

Zhang Yusen and his girlfriend, who also works at BasicFinder as a quality inspector are so far enjoying their work.

TOP STORIES
EDITOR’S CHOICE
MOST VIEWED
EXPLORE XINHUANET
010020070750000000000000011100001377521541
全民彩票 大发app 凤凰彩票app 乐发iv游戏平台 凤凰彩票大厅 乐发彩票 乐发彩票app下载 大发彩票 乐发v官网 乐发lll 乐发lv入口 乐发iv首页 乐发ll登录 凤凰彩票大厅 乐发官网 乐发ii下载入口 乐发ll 乐发v平台 乐发v官网 乐发lll 乐发lv入口 乐发iv首页 乐发ll登录 乐发lv 乐发lll安装 乐发lv 乐发登录入口 乐发iv游戏平台 凤凰彩票登录 网信彩票 彩神 彩神彩票官方网站 彩神彩票官网首页 彩神官方app下载安卓版 凤凰彩票登录 彩神v3 凤凰彩票app下载 彩神官方app下载安卓版 网信快三 一分快3 快三彩票购彩平台 凤凰彩票官方 快3官网 网信彩票 快3app 网信彩票平台 百姓彩票平台 网信平台官网 快3app下载 百姓彩票 每日彩票 快3app 百姓彩票 每日彩票 快3app 百姓彩票平台 幸运5分彩快3 快3彩票app下载 百姓彩票网站网址 大发10分PK10 快3下载 网信彩票平台 网信平台官网 快3彩票官网app 凤凰彩票官方 彩神彩票 大发10分PK10 彩神v3 大发彩票app下载 百姓彩票网站网址 彩神购彩平台 每日彩票 官方正规快三彩票平台 彩神彩票购彩平台 百姓彩票 凤凰彩票购彩平台 凤凰彩票app下载 彩神官方app下载安卓版 网信快三 一分快3 快三彩票购彩平台 凤凰彩票官方 彩神彩票 大发10分PK10 彩神v3 凤凰彩票登录 乐发lv 乐发∨Il 百姓彩票网站网址 乐发彩票 乐发彩票官方网站 乐发lll安装 百姓彩票网站网址 凤凰彩票app下载 大发10分PK10 乐发2 乐发app 凤凰彩票 大发彩票app 乐发登录入口 乐发ll登录 乐发v官网 乐发官网 大发彩票app下载 凤凰彩票购彩平台 彩神彩票 官方正规快三彩票平台 一分快3 百姓彩票网站网址 凤凰彩票app下载 大发10分PK10 乐发2 乐发app 凤凰彩票 大发彩票app 乐发登录入口 乐发ll登录 乐发v官网 乐发官网 大发彩票app下载 凤凰彩票购彩平台 彩神彩票 官方正规快三彩票平台 1分快三平台 百姓彩票平台 凤凰彩票登录 幸运5分彩快3 彩神 乐发彩票 乐发 大发彩票 乐发iv游戏平台 乐发lv 乐发lll 乐发ii下载入口 乐发彩票官方网站 凤凰彩票官方网站 凤凰快3 彩神彩票官网首页 1分快三平台 百姓彩票平台 凤凰彩票登录 幸运5分彩快3 彩神 乐发彩票 乐发 大发彩票 乐发iv游戏平台 乐发lv 凤凰彩票app 乐发app 网信彩票平台 网信彩票平台 乐发iv游戏平台 凤凰彩票app 乐发lv 乐发彩票app下载 凤凰彩票app 网信彩票平台 乐发彩票app下载 乐发lv 乐发app 大发彩票安卓下载 大发彩票安卓下载 大发彩票 乐发彩票app下载 网信彩票平台 乐发iv游戏平台 彩神彩票 乐发彩票中心 极速快3彩票平台 人人快三凤凰 大发彩票app 大发彩票大全 乐发彩票 彩神彩票官方网站 乐发app 酷天堂彩票平台 凤凰彩票app下载 凤凰彩票大厅 凤凰彩票app 极速快3彩票平台 凤凰彩票 凤凰快3 乐发ll官网 乐发彩票中心 正规快三送彩金平台 凤凰彩票官方 乐发ll 乐发 网信彩票 彩神彩票 彩神彩票官方网站 大发彩票app 网信彩票用户 百姓快三 百姓彩票平台 乐发lv 乐发彩票app下载 彩信平台 网信彩票 乐发彩票官方网站 乐发∨Il 人人快三凤凰 凤凰彩票 凤凰快3 乐发ll官网 乐发彩票中心 正规快三送彩金平台 凤凰彩票官方 乐发ll 乐发 网信彩票 彩神彩票 彩神彩票官方网站 人人快三凤凰 乐发彩票 彩神彩票 乐发iv游戏平台 乐发彩票 大发彩票中心 凤凰彩票登录 凤凰彩票app 彩神彩票 大发彩票 乐发ll 大发彩票app 凤凰快3 凤凰彩票 彩神彩票 乐发ll 凤凰彩票 乐发lll 凤凰彩票大厅 网信彩票 彩神彩票 乐发lv 快盈彩票 乐发彩票官方网站 盈彩网投资平台 大发官网 一分时时彩 乐发lv 快3平台 凤凰快3 乐发ll 全民彩票 乐发彩票官方网站 百姓彩票 乐发彩票 大发彩票 极速快3 乐发app 大发官网 乐发lll 快3平台 凤凰快3 乐发ll 全民彩票 乐发彩票官方网站 百姓彩票 乐发彩票 大发彩票 极速快3 乐发app 彩神iv 大发彩票app 大小单双平台 一分pk10 乐发lv 快盈彩票 乐发官网 快彩彩票 百姓彩票 凤凰彩票大厅 网信彩票 乐发彩票中心 网信快3 乐发 彩神xl 三分快3 大发彩票 大发官网 乐发lll 快3平台 凤凰快3 乐发ll 全民彩票 乐发彩票官方网站 百姓彩票 乐发彩票 乐发彩票官方网站 大发彩票 乐发 分分快3 彩神vl 55世纪 55世纪 凤凰快3 乐发彩票 乐发lv welcome凤凰彩票 乐发ll 1分快3 彩神 彩神ll 1分快3官网 1分快3的平台 welcome凤凰彩票 三分快3 彩神x 彩神vl 凤凰彩票 彩神xl 大发彩票 凤凰彩票大厅 乐发官网 乐发ll 乐发lll 乐发lv 大发彩票app 大发彩票 乐发 乐发彩票 乐发彩票中心 凤凰快3 乐发彩票 彩神xl 腾讯快3 大发彩票 彩神xl 大发彩票 乐发彩票 大发彩票app 快3平台 乐发 1分快3 乐发彩票 彩神x 凤凰快3 彩神xl 彩吧助手 大发彩票app 快3平台 大发排列3 彩神iv 彩神vl 乐发IV 彩神x 一分pk10 大发排列3 乐发lv 快3彩票 乐发app下载 三分快3 快三平台助手 乐发彩票ll 彩神iv 乐发lll下载 盈彩网投资平台 乐发Ⅲ 一分pk10 凤凰彩票 乐发Vll 大发官网 乐发ll 大发彩票 乐发1 凤凰快3 彩神vl 乐发lx 百姓彩票 乐发VI 彩神x 乐发IV 极速快3 乐发 凤凰快3 网信快3 乐发lv 快3彩票 乐发app下载 三分快3 快三平台助手 乐发彩票ll 彩神iv 乐发lll下载 盈彩网投资平台 乐发Ⅲ 凤凰彩票大厅 乐发lv 乐发lv 乐发lv 凤凰彩票 大发彩票 大发彩票 凤凰彩票 乐发lv 凤凰彩票 凤凰彩票 乐发lv 乐发ll 凤凰彩票app下载 凤凰彩票 凤凰彩票 乐发lv 乐发ll 凤凰彩票app下载 凤凰彩票 凤凰彩票 乐发lv 彩神x 乐发 乐发ll 极速快3 乐发lv 乐发彩票中心 快3彩票 凤凰彩票大厅 彩神x 凤凰彩票app 分分快3 网信彩票 网盟彩票 凤凰彩票 百姓彩票 乐发 快彩彩票 乐发彩票 快3平台 百姓彩票 大小单双平台 凤凰快3 彩神xl 一分pk10 乐发lv 三分快3 大发彩票 乐发彩票 快3平台 百姓彩票 大小单双平台 凤凰快3 彩神xl 一分pk10 乐发lv 三分快3 大发彩票 极速快3 乐发ll 网信彩票 乐发lv 全民彩票 凤凰彩票app下载 快盈彩票 大发彩票app 大发官网 凤凰彩票 彩神iv 大发彩票 网信快3 凤凰彩票 百姓彩票