Presentation is loading. Please wait.

Presentation is loading. Please wait.

Adam Kilgarriff,* Vit Suchomel*^ *Lexical Computing Ltd, UK ^NLP Laboratory, Masaryk Univ, Brno, Cz 1.

Similar presentations


Presentation on theme: "Adam Kilgarriff,* Vit Suchomel*^ *Lexical Computing Ltd, UK ^NLP Laboratory, Masaryk Univ, Brno, Cz 1."— Presentation transcript:

1 Adam Kilgarriff,* Vit Suchomel*^ *Lexical Computing Ltd, UK ^NLP Laboratory, Masaryk Univ, Brno, Cz 1

2 The particular Moroccan oil could very well moisturize dry skin handing it out an even makeup including easier different textures. Now on the web stores are very aggressive price smart so there genuinely isnt any very good cause to go way out of your way to get the presents (unless of course of program you procrastinated). Hemorrhoids sickliness is incorrect to be considered as a lethiferous malaise even though shut-ins are struck with calamitous tantrums of agonizing hazards, bulging soreness and irritating psoriasis. 2

3 We dont want it OUP We cant take examples from your corpus without checking every one because they might be web spam More (or, cleverer) than it used to be enTenTen12 vs enTenTen08 Hard to filter (by design) Moving target 3

4 Web spamming : actions intended to mislead search engines into ranking some pages higher than they deserve Gyongyi and Garcia-Molina,

5 Moroccan Oil is alcohol-free and has a patented weightless formula with no build up. Softens thick unmanageable hair and restores shine and softness to dull lifeless hair. Instantly absorbed into the hair. Moroccan Oil will help eliminate frizz, speeds up styling time by 40%, and provides long-term conditioning to all hair types. Are $20 shampoos and conditioners worth it? Can good hair-care products be found at the drugstore, or are the expensive salon products really superior? 5

6 6

7 Taxonomy of techniques Gy¨ongyi and Garcia-Molina, 2005 AIRWEB (Adversarial IR on the web) Five workshops Held at WWW conferences Since2009 attention shifted to social-network spam 7

8 Best dataset: UK2007 Second challenge Collecting labelling effort 6479 hosts manually classified 6% of data is spam Uniform random sampling of web crawl By domain, not by page Six participants in challenge All used supervised learning Top score: 85% area under curve 8

9 No search engines, no web spam Lots of data, expertise, algorithms All private AIRWEB included representatives BootCaT Piggybacks on search engine anti-spam methods 9

10 Level of web page, not host, domain Contra AirWEB Lacks coherence Text with injections or target terms Anomalous words 10

11 Hypothesis Biggest difference is web spam Keywords method Frequencies in each corpus Normalise to per million Add smoothing parameter to each Divide higher number by lower Two keyword lists Dictionary filter hunspell Study top 100 of each 11

12 enTenTen12enTenTen08 lcFreqFreq/millFreqFreq/millScoreRank tweeted jewelries tweeting colorway hemorrhoid straighteners courageousness twitter straightener colorways anticlimaxes

13 NEW THINGS tweeting tweeted twitter (photo) voltaic (cells) atomizer (as part of apparatus for giving up smoking) jailbreak (verb: remove limitations on an Apple device) NEW WORDS colorway colorways aftereffect (increasingly spelt as one word) SHOPPING footwear espadrille sneaker slingback huarache handbags holdalls chronograph chronographs timepiece timepieces watchstrap watchmaking birthstone birthstones foodstuff headpins (jewelry making) pantyliner jerseys SERVICES locksmith locksmiths refacing (for kitchen cabinets) MONEY refinance refinancing remortgages defrayal cosigner loaners WEDDINGS bridesmaid boutonnieres honeymoons groomsmen 13

14 HEALTH AND BEAUTY periodontist whitening veneers aligners (both mainly for teeth) hemorrhoid hemorrhoids hairstyles straightener straighteners slimming physique cellulite liposuction stretchmarks suntanning moisturize moisturizes moisturized dehydrators detoxing pimples whiteheads blackhead blackheads breakouts (of acne etc) concealer concealers (of acne etc) tinnitus RARE DICTIONARY WORDS accouter osculate MORPHOLOGY humorousness severeness sturdiness impecuniousness comfortableness anxiousness adorableness courageousness neglectfulness moldiness safeness anticlimaxes chitchats attires apparels jewelries jackpots wagerer vacationer dandier acquirable conveyable dejecting unexceptionally NAMES (incorrectly included - most were filtered out) spellbinders (a name) circuital (album) android (operating system) OTHER frontward proficiently 14

15 enTenTen08enTenTen12 lcFreqFreq/millFreqFreq/millScoreRank twelfths holograph fuehrer declassification subtenant indemnifying libeler videocassette maunders palatinates wardresses reexports videodisc

16 enTenTen08enTenTen12 lcFreqFreq/millFreqFreq/millScoreRank twelfths holograph fuehrer declassification subtenant indemnifying libeler videocassette maunders palatinates wardresses reexports videodisc enTenTen12enTenTen08 lcFreqFreq/millFreqFreq/millScoreRank tweeted jewelries tweeting colorway hemorrhoid straighteners courageousness twitter straightener colorways anticlimaxes

17 New things have arrived on the web, more dramatically than things have left it 17

18 All except twitter words, voltaic, jailbreak Almost all of sample of concordances spam Marketing In between Lethiferous words Osculate (kiss) – porn spam Accouter (dress) – clothing spam 18

19 11 –ness nouns 6 pre-empted comfortableness / comfort 6 plurals 3 emphatically mass nouns Attires apparels jewelries 2 –er nouns Wagerer (exclusively in pure spam) and vacationer 2 –able adjectives 19

20 Computer is generating these forms Non-native speakers Dialect: Kachrus outer circle India Pakisatan Malaysia Kenya Nigeria 20

21 This, in addendum to modern sedate safeness concerns, numberless increases in data sum total, and rising cost pressures, closest these organizations with some uncommonly outstanding topic challenges. 21

22 A lot of individuals choose for numerous floor bunny rabbit cages with brings joining the levels. This grants the bunny rabbit a lot extra room without borrowing more room inside your haven. Owning a line flooring inside your bunny rabbit Cage isnt a good plan if you wouldlike to give comfortableness for your bunny rabbit. While having a wire bed with a pull out and makes for simpler maintaining, its not all of the time necessaryas bunnies are easily litter box trained. 22

23 It is dream of every woman to have a perfect wardrobe. The thing that tops the list to make the wardrobe a complete one is a black shoe. Ladies black shoes add style and versatility to the attires. From casuals to formal black is the colour that makes the feet stand out from the crowd. 23

24 The web isnt what it used to be Search engines: friend or foe Filtering it out AIRWEB challenges Hard, and a moving target if we publish, spammers will smile The cline From marketing to gibberish From language to noise Content farms Full of sound and fury / signifying nothing 24


Download ppt "Adam Kilgarriff,* Vit Suchomel*^ *Lexical Computing Ltd, UK ^NLP Laboratory, Masaryk Univ, Brno, Cz 1."

Similar presentations


Ads by Google