Presentation is loading. Please wait.

Presentation is loading. Please wait.

HUMAN COMPUTATION LUIS VON AHN CARNEGIE MELLON UNIVERSITY.

Similar presentations


Presentation on theme: "HUMAN COMPUTATION LUIS VON AHN CARNEGIE MELLON UNIVERSITY."— Presentation transcript:

1 HUMAN COMPUTATION LUIS VON AHN CARNEGIE MELLON UNIVERSITY

2 Verification technology developed in collaboration with Carnegie Mellon University

3 CAPTCHA A PROGRAM THAT CAN TELL WHETHER ITS USER IS A HUMAN OR A COMPUTER

4 CAPTCHA A.MOST HUMANS CAN PASS B.CURRENT COMPUTER PROGRAMS CANNOT PASS A PROGRAM THAT CAN GENERATE AND GRADE TESTS THAT:

5 EXAMPLE PICKS RANDOM STRING OF LETTERS oamg RENDERS IT INTO A DISTORTED IMAGE

6 …AND GENERATES A TEST: TYPE THE CHARACTERS THAT APPEAR IN THE IMAGE

7 ( FROM QUICKVOTE Which is the best Computer Science Grad School in the US? CMU MIT vote Berkeley StanfordCornell Washington

8 FREE SERVICES DATA COLLECTION WORMS AND SPAM PREVENTING DICTIONARY ATTACKS APPLICATIONS

9 CAPTCHA SWEAT SHOPS SPAM COMPANIES HIRE HUMANS TO SOLVE CAPTCHAS ALL DAY LONG $2.50 PER HOUR FOR EACH HUMAN 720 CAPTCHAS PER HOUR PER HUMAN 1/3 CENT PER ACCOUNT

10 VOTE FOR LUIS

11 Type the word in the box if you want to see the next picture Free Nude Photos

12 CAPTCHA HUMAN COMPUTATION

13 9 BILLION HUMAN-HOURS OF SOLITAIRE WERE PLAYED IN 2003 EMPIRE STATE BUILDING PANAMA CANAL 7 MILLION HUMAN-HOURS (6.8 HOURS OF SOLITAIRE) 20 MILLION HUMAN-HOURS (LESS THAN A DAY OF SOLITAIRE)

14 HUMAN COMPUTATION

15

16 LABELING IMAGES WITH WORDS MARTHA STEWART WOMAN FLOWERS SUPER EVIL STILL AN OPEN PROBLEM

17 IMAGE SEARCH ON THE WEB USES FILENAMES AND HTML TEXT

18 ACCESSIBILITY LESS THAN 10% OF THE WEB IS ACCESSIBLE TO THE VISUALLY IMPAIRED REASON:MOST IMAGES DON’T HAVE A CAPTION

19 DESIDERATA A METHOD THAT CAN LABEL ALL IMAGES ON THE WEB FAST AND CHEAP

20 USING HUMANS THE ESP GAME COULD LABEL ALL IMAGES ON GOOGLE IN A FEW WEEKS THE ESP GAME CLEVERLY

21 TWO-PLAYER ONLINE GAME PARTNERS DON’T KNOW EACH OTHER AND CAN’T COMMUNICATE OBJECT OF THE GAME: TYPE THE SAME WORD ONLY THING IN COMMON IS AN IMAGE THE ESP GAME

22 PLAYER 1PLAYER 2 GUESSING: CARGUESSING: BOY GUESSING: CAR SUCCESS! YOU AGREE ON CAR SUCCESS! YOU AGREE ON CAR GUESSING: KID GUESSING: HAT THE ESP GAME

23 © 2004 Carnegie Mellon University, all rights reserved. Patent Pending.

24 15 MILLION AGREEMENTS WITH 75,000 PLAYERS THE ESP GAME IS FUN THERE ARE MANY PEOPLE THAT PLAY OVER 20 HOURS A WEEK

25 LABELING THE ENTIRE WEB INDIVIDUAL GAMES IN YAHOO! AND MSN AVERAGE OVER 5,000 PLAYERS AT A TIME 5000 PEOPLE PLAYING SIMULTANEOUSLY CAN LABEL ALL IMAGES ON GOOGLE IN 2 MONTHS!

26

27 SINGLE-PLAYER GAME A SINGLE PERSON CAN PLAY WITH PRE- RECORDED ACTIONS AS THEIR PARTNER WHEN 2 PEOPLE PLAY, WE RECORD EVERY ACTION WITH TIMING INFORMATION WE EMULATE PARTNER BY PLAYING PRE- RECORDED MOVES (0:12) CAR (0:15) HAT (0:21) KID (0:08) BOY (0:23) CAR NOTICE THAT THIS DOESN’T STOP THE LABELING PROCESS!

28 COUNTING ALL THE EXTRA LABELS THAT THIS GENERATES, THE ESP GAME HAS COLLECTED OVER 39 MILLION LABELS ZERO-PLAYER GAME WE CAN ALSO PAIR PRE-RECORDED GAMES WITH EACH OTHER!

29 WE GIVE PLAYERS TEST IMAGES FOR WHICH WE KNOW ALL THE COMMON LABELS: WE ONLY STORE A PLAYER’S GUESSES IF THEY SUCCESSFULLY LABEL THE TEST IMAGES WHAT ABOUT CHEATING?

30 SEARCH RESULTS

31

32

33

34

35 GOOOOOOGLE

36 SAMPLE LABELS BEACH CHAIRS SEA PEOPLE MAN WOMAN PLANT OCEAN TALKING WATER PORCH SKY BELL

37 SADDAM MR. WILSON MAN FACE MOUSTACHE SAMPLE LABELS BUSH GEORGE PRESIDENT MAN DUMB YUCK COMING SOON: MEET YOUR SOUL MATE THROUGH THE GAME!

38 WHY DO PEOPLE LIKE THE ESP GAME?

39 THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. ON THE ONE HAND, YOU HAVE NO IDEA WHO YOUR PARTNER IS. ON THE OTHER HAND, THE TWO OF YOU ARE BRINGING YOUR MINDS TOGETHER IN A WAY THAT LOVERS WOULD ENVY. ” THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. ON THE ONE HAND, YOU HAVE NO IDEA WHO YOUR PARTNER IS. THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. “

40 STRANGELY ADDICTIVE “ ” IT’S SO MUCH FUN TRYING TO GUESS WHAT OTHERS THINK. YOU HAVE TO STEP OUTSIDE OF YOURSELF TO MATCH “ ” IT’S FAST-PACED “ ” HELPS ME LEARN ENGLISH “ ” IT’S LIKE CRACK! “ ”

41 BLOGS IN OTHER CROWNING ACHIEVEMENTS, I HAVEN'T PLAYED IN AT LEAST A WEEK (PROBABLY LONGER), AND I AM STILL ON THE TOP TEN LIST OF PLAYERS ON THE ESP GAME. NUMBER EIGHT IF I REMEMBER CORRECTLY. “ GOD, MY LIFE IS SAD. ”

42 THERE ARE MANY FASCINATING THINGS ABOUT THE ESP GAME: HOW IT USES A GAME STRUCTURE TO BUILD AN INDEX OF IMAGES ON THE WEB WHAT WORDS BECOME TABOO FROM FREQUENT USE HOW INTERESTING SOME OF THE IMAGES PULLED RANDOMLY FROM THE WEB ARE “ BUT BY FAR THE MOST INTRIGUING ASPECT OF THE GAME IS HOW OFTEN YOUR RANDOM, UNKNOWN PARTNER IS A COMPLETE IDIOT. ”

43 © 2005 Carnegie Mellon University, all rights reserved. Patent Pending. Your partner has entered a guess

44 THE ESP GAME IS AN “ALGORITHM” INPUT: AN IMAGE OUTPUT: SET OF KEYWORDS GAMES WITH A PURPOSE RUNNING A COMPUTATION IN PEOPLE’S BRAINS INSTEAD OF SILICON PROCESSORS

45 OTHER GAMES WITH A PURPOSE

46 LOCATING OBJECTS IN IMAGES ESP GAME MAN SKY WATER PLANT WOMAN

47 LOCATING OBJECTS IN IMAGES SUCH INFORMATION WOULD BE EXTREMELY USEFUL FOR COMPUTER VISION RESEARCH MAN SKY WATER PLANT WOMAN

48

49

50 HINT

51

52

53

54 BUSH

55

56

57

58

59 HINT

60

61

62

63

64 PICK

65 HINT “PINGS”

66

67 IS FUN! 27,000 PLAYERS 2,100,000 PIECES OF DATA MANY PLAYED OVER 120 HOURS IN THE FIRST 10 DAYS!

68 270 HOURS OF GAME-PLAY

69 RONALD

70

71 + SEGMENTATION

72

73

74 THE POWER OF HUMAN CYCLES OPEN PROBLEM CAPTCHA GAME

75

76 WWW. PEEKABOOM.ORG WWW. ESPGAME.ORG WWW. CAPTCHA.NET

77 WARDROBE PROVIDED BY THE GAP HAIRSTYLES ARNAUD SOME-FRENCH-LAST-NAME THIS WORK HAS BEEN AND WILL BE PARTIALLY SUPPORTED BY THE NSF ALADDIN CENTER MICROSOFT RESEARCH GOOGLE, INC SLIDE DESIGN LUIS VON AHN CAPTCHA CREW LUIS VON AHN MANUEL BLUM NICHOLAS HOPPER JOHN LANGFORD THE ESP GAME CREW LUIS VON AHN LAURA DABBISH TAKEO KANADE STEVEN KATZ MIHIR KEDIA JOHN LANGFORD ROY LIU JITENDRA MALIK UDI MANBER MONI NAOR LENORE RAMM CHUCK ROSENBERG RONI ROSENFELD PUSH SINGH DAVID STORK LATANYA SWEENEY SHINGO UCHIHASHI MANUELA VELOSO SPECIAL THANKS TO ADITYA AKELLA JOSH BENALOH LENORE BLUM MANUEL BLUM ANDREW BORTZ SHUCHI CHAWLA LAURA DABBISH ALEXEI EFROS ALAN EUSTACE BILL GATES SHIRY GINOSAR BRIGHTEN GODFREY NICK HOPPER SUSAN HRISHENKO PEEKABOOM CREW LUIS VON AHN ROY LIU VERBOSITY CREW LUIS VON AHN MIHIR KEDIA MANUEL BLUM SPEAKER’S ENTERTAINMENT PROVIDED BY HOMESTARRUNNER.COM


Download ppt "HUMAN COMPUTATION LUIS VON AHN CARNEGIE MELLON UNIVERSITY."

Similar presentations


Ads by Google