A Layout Based Detachment Approach for Extracting Content from Webpages
Deepa Chandran1 & Anna Saro Vijendran2 Show affiliations
- Department of Information Technology, SNR Sons College, Coimbatore, India
- MCA, SNR Sons College, Coimbatore, India
American Journal of Applied Sciences, Volume 12, Issue 6, pp. 411–420 · doi.org/10.3844/ajassp.2015.411.420
Abstract
Enormous amount of useful information presented in Internet is usually formatted for the web users. But it is a really complex task to extract the relevant data from various web sources. Recently, various approaches for the extraction of data from the webpages were proposed. This study provides a simple but effective approach, named Layout Based Detachment Approach (LBDA). The proposed approach extracts the main content from the webpage by removing the irrelevant information like header-footer contents, navigation bars, advertisements and other noisy images. The proposed methodology uses the following techniques: Tag tree parsing to get the analysis structure, block acquiring page segmentation method to remove unwanted tags and data extraction to retrieve the necessary contents. The proposed approach eliminates noise and perform effective extraction of the main content blocks from the webpage and display of the essential content to the users. The performance of the proposed approach is evaluated using the performance metrics such as accuracy, precision, recall, execution time and memory usage. The implementation results obviously show that our proposed LBDA approach exhibits better performance than the existing heuristic approach.
Licence and reuse
Open access. This article is licensed under a Creative Commons Attribution 3.0 Licence (CC BY 3.0), as printed on the article, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original authors and the source. No permission is needed.
How to reuse this articleResponses (0)
About this article
Chandran, D. & Vijendran, A. S. (2015). A Layout Based Detachment Approach for Extracting Content from Webpages. American Journal of Applied Sciences, 12(6), 411–420. https://doi.org/10.3844/ajassp.2015.411.420
- Licence
- CC BY 3.0
- Issue
- Volume 12, Issue 6
- Policies
- Editorial independenceUse of generative AIData availabilityAppeals and complaints
- Version
- Version of record
