Open Access Open Access  Restricted Access Subscription Access

Obtaining Description for Simple Images using Surface Realization Techniques and Natural Language Processing


Affiliations
1 SASTRA University, Thirumalaisamudram, Tanjore - 613401, Tamil Nadu, India
2 GITAM University, NH 207, Doddaballapur Taluk, Bangalore Rural District, Nagadenehalli, Bangalore – 562163, Karnataka, India
 

This paper aims at developing a simple mechanism to deduce corpora pertaining to an image through various computer vision and natural language processing techniques. The output of the vision detection is combined with the sentence formation approach to get the visual content in textual form. Vision detections are smoothed using a number of approaches to prune undesired combination of words that are semantically incorrect. Descriptions are generated based on syntactic trees and Markov Chains and compared for human likeness based on survey. The results of the survey indicate that the descriptions generated with the help of Markov Chains sound more human like. These generated descriptions can be indexed in lucene and image search can be made more efficient bridging the semantic gap.

Keywords

Attributes, Corpora Extraction, Image Detection, Textual Descriptions Generation
User

Abstract Views: 140

PDF Views: 0




  • Obtaining Description for Simple Images using Surface Realization Techniques and Natural Language Processing

Abstract Views: 140  |  PDF Views: 0

Authors

CS Reddy
SASTRA University, Thirumalaisamudram, Tanjore - 613401, Tamil Nadu, India
Janani Balasubramanian
SASTRA University, Thirumalaisamudram, Tanjore - 613401, Tamil Nadu, India
Arvind Narayanan S
SASTRA University, Thirumalaisamudram, Tanjore - 613401, Tamil Nadu, India
Mamatha E
GITAM University, NH 207, Doddaballapur Taluk, Bangalore Rural District, Nagadenehalli, Bangalore – 562163, Karnataka, India

Abstract


This paper aims at developing a simple mechanism to deduce corpora pertaining to an image through various computer vision and natural language processing techniques. The output of the vision detection is combined with the sentence formation approach to get the visual content in textual form. Vision detections are smoothed using a number of approaches to prune undesired combination of words that are semantically incorrect. Descriptions are generated based on syntactic trees and Markov Chains and compared for human likeness based on survey. The results of the survey indicate that the descriptions generated with the help of Markov Chains sound more human like. These generated descriptions can be indexed in lucene and image search can be made more efficient bridging the semantic gap.

Keywords


Attributes, Corpora Extraction, Image Detection, Textual Descriptions Generation



DOI: https://doi.org/10.17485/ijst%2F2016%2Fv9i22%2F134460