1. Image Retrieval and Ranking using L.S.I and Cross View Learning Sumit Kumar Vivek Gupta 11739 11816

2. Why Mapping in latent space Most of the methods based on single modality (only text). Problems with above are o Different query representation for same search intent o Noise in the surrounding textual data o Tag data required in this approach is limited and expensive.

3. Problem Statement Given a set of images, a set of queries and query image click data we aim to learn a common latent subspace so that query and image can be directly compared. This space is used for retrieving and ranking of images for a given textual query on basis of their relevance.

4. Mapping into Common Latent Space q1q1 q2q2 q3q3 v1v1 v2v2 v3v3 q’ 1 q‘ 2 q’ 3 v’ 1 v’ 2 v’ 3 Query Space Image Space Common Latent Space Transformation Matrix

5. Latent Semantic Indexing Row1: Machine Learning Computer Vision Row2 : Machine Learning Row3 : Computer Vision Row4: Machine Computer Term Feature Matrix After LSI Col1: Machine Col2: Learning Col3: Computer Col4: Vision

6. Approach/Idea Extract Feature Vectors for Image and query. Apply LSI on query matrix. Find mapping functions, represented by transformation matrices. Find and Minimize Cross View Distance and Structure Preservation using suitable gradient decent algorithm. Optimize algorithm for faster computation.

7. Results We trained our transformation matrices on a dataset of 309 image query pairs and tested it on a data set of size 145 image query pairs. Two methods for finding accuracy were used: o If the relevant image was the top first result, then give score = 1 otherwise 0. o If the relevant image was within the top three search results then we give a score of 1 else 0. Convergence was found for only few selected value of μ.

8. Performance vs Tradeoff

9. Performance vs Tmax

10. Literature Review Click through based Cross View Learning for image search(2014) by Y.Pan,T.Yao et. Al. Indexing by Latent semantic Analysis(1990) by S.Deerwester, S.T.Dumanas et. Al A feasible method for optimization with orthogonally constraints(2010) by Zaiwen Ven and Watao Yin An Introduction to Latent Semantic Analysis(1998) by T.K. Landeauer,P.W.Foltz and D Laham WSDM 2012 tutorial,Machine Learning for Query document matching in Web Search by Hang Li and Jun Xu

11. Thank You