LingPipe Home

What is LingPipe?

Jargon Key

Text Data Mining / Text Analytics: Extracting and analyzing information patterns in text collections.
Discovery: Uncovering facts in text data and analyzing their connections.
Database Linkage: Matching extracted entities and relations to databases or ontologies.
Unstructured Information Management: Storage, analysis, and retrieval of human language data.
Natural Language Processing (NLP): Handling human language by computer.
Computational Linguistics: Science of the computational properties of language.
N-Best and Confidence: The ability to return multiple hypotheses ranked by statistical confidence.
Corpus: A collection of human language, often annotated with linguistic and/or content features.
API: Application Programmer's Interface; the language to communicate with LingPipe.
Concurrency: Doing more than one thing simultaneously.

LingPipe is a suite of Java libraries for the linguistic analysis of human language.

Feature Overview

LingPipe's information extraction and data mining tools:

track mentions of entities (e.g. people or proteins);
link entity mentions to database entries;
uncover relations between entities and actions;
classify text passages by language, character encoding, genre, topic, or sentiment;
correct spelling with respect to a text collection;
cluster documents by implicit topic and discover significant trends over time; and
provide part-of-speech tagging and phrase chunking.

Architecture

LingPipe's architecture is designed to be efficient, scalable, reusable, and robust. Highlights include:

Java API with source code and unit tests;
multi-lingual, multi-domain, multi-genre models;
training with new data for new tasks;
n-best output with statistical confidence estimates;
online training (learn-a-little, tag-a-little);
thread-safe models and decoders for concurrent-read exclusive-write (CREW) synchronization; and
character encoding-sensitive I/O.

Latest Release: LingPipe 3.9.3

Minor Release

The latest release of LingPipe is LingPipe 3.9.3. This release replaces LingPipe 3.9.2, with which it is fully backward compatible.

Upgrade Path to LingPipe 4.0

LingPipe 3.9.3 is scheduled to be the final 3.x release. LingPipe 4.0 is going to remove all currently deprecated classes and methods. As tempted as we were to enforce some kind of naming consistency, we decided to follow Java itself and maintain backward compatibility instead.

There was major refactoring for 3.9 and 3.9.1, which along with backward compatibility, leads to a rather clunky API with lots of duplicate functionality.

Updated Library Jars

Updates to the latest version include:

junit-4.8.2.jar
servlet-api-6.0.26.jar

LingPipe

Home