2009/03/31

Web Information Retrieval: Spam Detection and Named Entity Recognition

2 hours seminar

by Marcin Sydow

Query decomposition

 

Topical query descomposition

 

Query in red

Do blue set

 

Quality of decomposition

Cost: low topical scattered

Red faction low `(small quantity of documents)

Inter-query overlap (well descompose)

Uncovered (try to cover all the query).

 

Annealing function

Solutions are neighbors if they differed by 1 query.  

 

Properties:

Quasi-transitive (temperature preference)

Utility function

Social preferences

Majority voting: is not transitive

Single peakedness

Arrows social welfare function

 

We like:

Arrow’s impossibility theorem.

2009/03/30

english

studing english, 
phrasal verbs
checking who to explain things...

reading group

borderline-SMOTE:A New over-sampling Method in Imbalanced Data Sets Learning.
by me.

note:
my supervisor assist to the first part of the explanation.

searching books for spanish lectures

2009/03/29

Tree Kernels for semantic role labeling
reading paper

Tree Kernels for semantic role labeling

Tree Kernels for semantic role labeling (32 pages)

0.   Abstract

This paper is based on kernel functions to model parse tree properties in kernel based machines.

1.   Introduction

Recently attention: automatic labeling of semantic roles. It requires:

1. Detection of the target predicate

2. Detection and classification of constituting arguments.

Previous work:

-          Machine learning

-          Linking theories semantic and syntax

Tree kernel for:

-          Parsing re-ranking

-          Relation extraction

-          Name entity recognition.

Recent work with high labeling accuracy,

Joint inference on predicate-argument structure. For this -> extract features from sentence syntactic parse tree.

1-      Feature extraction.

2-      Combination with traditional attribute value models.

3-      Feature engineering using kernel combinations and marking strategies.

4-      Tree kernels….

5-      Identify the most important structured features: highest-weighted features -> better classifiers.

“Tree kernels should always be applied”.

Limitations:

a)      Poor impact on boundary detection.

b)      Limited contribution to overall accuracy.

Tree kernels for srl: types:

-          Canonical mappings

-          Feature extraction functions

Carefully engineered tree kernels always increase accuracy.

 

2.   Automatic shallow semantic parsing

3.   Tree kernels

4.   State of the art architecture for SRL

5.   Structured feature engineering

6.   Experiments

7.   Discursion and conclusions

estudiando ingles

2009/03/28

Semantic Role Labeling: An Introduction to the Special Issue

®  Sentence + designated verb: SRL identify the arguments of the verb. And label them with semantic roles.

®  Steps:

¯  1 Pruning.

¯  2 Local scoring

¯  3 Joint scoring

(4) Fixing common errors

 

Pruning

®  Filtering the set of arguments for a given predicate.

¯  Any subsequence of words in the sentence is an argument candidate.

®  Xue and Palmer (2004)

Joint scoring      

®  Good structure of labeled arguments.

®  Arguments do not overlap,

®  Core arguments do not repeat, etc.

®  Re-ranking

®  Probabilistic methods.

Conditional random fields

SRL architecture:

®  Combination of systems and input annotations.

¯  Increase robustness,

¯  Gain coverage

¯  Reduce effects of parse errors

®  One my combine:

¯  Output of independents srl basic systems

¯  Outputs from same srl s. changing input annotations or parameters.

Gaing of 2-3 F1 points.  

®  Joint labeling…

®  Dependency parsing

®  Combine parsing and srl in a single step. …

®  Characterize candidate argument
phrase type, headword, …

®  Characterize verb predicate +cntx
lemma, voice,

®  Characterize the relation.
Syntactic + semantic.
Left/right position of the constituent  with respect to the verb…

®  Recall:

®  81% argument identification

®  95% assigned correct semantic role.

®  SemEval-2007

®  Disambiguation of 50 verbs.

®  FrameNet

®  40 frames

®  F1=92% asigning semantic roles

®  F1 83% segmenting and labeling arg.

®  Complete analysis of semantic roles on unseen texts,

®  Precision 60s

®  Recall 30s

®  SRL relies on syntactic structure.

®  Output by statistical parser 90% matching.

®  Is common to use parser trees.

®  Gold-standard trees.???

®  Most of the errors are by having incorrect syntactic constituents.

®  SRL relies on syntactic structure.

®  Output by statistical parser 90% matching.

®  Is common to use parser trees.

®  Gold-standard trees.???

®  Most of the errors are by having incorrect syntactic constituents.

®  CoNLL-2005 Brown corpus annotated

®  Performance drop below 70%

®  They clamed errors are in assigning the semantic roles rather than identification of argument boundaries.

®  Spanish and catalan, CESS-ECE corpus.

®  86% disambiguation predicates

®  83% labeling arguments.

®  chinese

®  semEval-2007 25K SENTENCE

®  80% core elements.

Top performing team use machine learning techniques

2009/03/27

helping COST2102

2009/03/26

helping cost
burocracy
reading papers

2009/03/25

borderline-smote
slides ready for the reading group
PREPARING slides
helping COST 2102

2009/03/23

helping carl in cost

Semantic role labeling: an introduction to the special issue

 

1 Introduction SRL:

APLICATIONS:

Information extraction

Question ansering

Summarization

MT

NLP tasks

major conclusion of that work is that the patterns of syntactic alternation exhibit regularity that reflects an underlying semantic similarity among verbs, forming the basis for verb classes major conclusion of that work is that the patterns of syntactic alternation exhibit regularity that reflects an underlying semantic similarity among verbs, forming the basis for verb classes ?? what it means?

 

2  Semantic roles in linguistics

 

3 From Linguistic Theory to computational resources:

2002 first statistical machine learning approach to SRL

Verb lexicon

Proposition bank

Each verb has a framset listing its allowed role labeling.  

Arg0, arg1 -> to be specific with semantic roles

Abstract semantic role: agent, theme, location.

4 Approaches to automatic SRL:

Only supervised approach.

4.1 SRL Step by Step

First step: filtering or pruning.

The second step consists of a local scoring of argument candidates: argument identification and classification.

The third : joint scoring.

 ----------

FRAME SEMANTICS: 

Syntactic-oriented arguments and adjuncts

frame semantics core and peripheral.

...


posible topics :

 

2009/03/21

start to read 
semantic role labeling: an introduction to the spe3cial issue
helping carl to prepar COST2102

2009/03/20

we decided to work on semantic role labeling
by spanish book for spanish lectures + return books

2009/03/19

TCD
2 PART
machine learning