Research ArticleOpen accessPhrase in the titleA New Filtering Algorithm for Duplicate Document Based on Concept AnalysisAhmad M. HasnahData bases and web pages contain currently a huge number of duplicate document. It is then fundamental to have a filter which can be embedded, for instance, within an information retrieval system like a search engine in order to prohibit the redundant documents references to appear on the screen as a reply to the user's query. This filter can save … …Journal of Computer Science, Vol. 2, Issue 5 · 31 May 2006 · 6,741 accessesView PDFCite
Research ArticleOpen accessPhrase in the titleEvaluating the Efficiency of CPUs, GPUs and FPGAs on a Near-Duplicate Document Detection Via OpenCLErcan CanhasiDiscovering identical or near-identical items is urgently important in many applications such as Web crawling since it drastically reduces the text processing costs. Simhash is a widely used technique, able to attribute a bit-string identity to a text, such that similar texts have similar identities. In this study, a real-time solution for a simhash calculation in OpenCL is presented. We … …Journal of Computer Science, Vol. 14, Issue 5 · 28 Apr 2018 · 7,370 accessesView PDFCite
Research ArticleOpen accessIn the abstractSketching-Din Elimination of Web PageP. Sivakumar, R. M.S. ParvathiProblem statement: The web content mining used to access lot of web pages, mining of web contents aims to extort positive information or awareness. Approach: There are several type of Web contents which can suggest valuable information to users are accessible in the Web, for instance graphical data, Extensible Markup Language documents, Hyper Text Markup Language documents and simple text. … …Journal of Computer Science, Vol. 7, Issue 12 · 22 Oct 2011 · 6,894 accessesView PDFCite