The boilerpipe library provides algorithms to detect and remove the surplus "clutter" (boilerplate, templates) around the main textual content of a web page.The library already provides specific strategies for common tasks (for example: news article extraction) and may also be easily extended for individual problem settings.Extracting content is very fast (milliseconds), just needs the input document (no global or site-level information required) and is usually quite accurate.Boilerpipe is a Java library written by Christian Kohlschütter. It is released under the Apache License 2.0.
A. Wu, M. Garland, und J. Han. KDD '04: Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, Seite 719--724. New York, NY, USA, ACM Press, (2004)