Back to AI Research

AI Research

OntoLearner: A Modular Python Library for Ontology... | AI Research

Key Takeaways

  • OntoLearner: A Modular Python Library for Ontology Learning with Large Language Models Ontology learning (OL) is the process of automatically building struct...
  • Ontology learning (OL) aims to automatically construct structured knowledge models from text, yet progress remains fragmented across methods, domains, and evaluation practices.
  • Despite decades of research, OL lacks a shared infrastructure for systematic evaluation and ontology access.
  • This absence has hindered progress and fragmented research, leaving the central challenges of OL largely unaddressed.
  • We introduce OntoLearner, a modular, cross-domain, and first-of-its-kind framework that unifies ontology access, large language model (LLM)-driven learning pipelines, and standardized benchmarking.
Paper AbstractExpand

Ontology learning (OL) aims to automatically construct structured knowledge models from text, yet progress remains fragmented across methods, domains, and evaluation practices. Despite decades of research, OL lacks a shared infrastructure for systematic evaluation and ontology access. This absence has hindered progress and fragmented research, leaving the central challenges of OL largely unaddressed. We introduce OntoLearner, a modular, cross-domain, and first-of-its-kind framework that unifies ontology access, large language model (LLM)-driven learning pipelines, and standardized benchmarking. OntoLearner releases 180 machine-readable ontologies spanning 22 domains and provides pipeline-ready datasets with train/dev/test splits for three core OL tasks: term typing, taxonomy discovery, and non-taxonomic relation extraction. Using this infrastructure, we conduct a large-scale empirical study of OL, evaluating 22 retrieval models and 12 LLMs across domains and tasks. The results converge on a finding that reframes the central challenge of OL: failure modes scale with ontological complexity rather than model size or architectural sophistication. The primary bottleneck is not model capability, but a structural mismatch between how models encode knowledge and how ontologies organize it. These findings establish that effective OL is reachable through the cross-domain, multi-task benchmarking enabled by OntoLearner. OntoLearner is open-source (MIT license) at this https URL .

OntoLearner: A Modular Python Library for Ontology Learning with Large Language Models
Ontology learning (OL) is the process of automatically building structured knowledge models from text. While this is essential for creating intelligent, interpretable AI systems, the field has long been fragmented, lacking a shared way to test and compare different methods. OntoLearner addresses this by providing a unified, open-source framework that combines ontology access, LLM-driven learning pipelines, and standardized benchmarking. By bridging the gap between raw text and formal knowledge structures, it aims to move the field from isolated experiments toward a more reproducible and scientific approach.

A Unified Infrastructure for Ontology Learning

Historically, ontology engineering and automated learning tools have operated in separate silos. Repository platforms focused on hosting and browsing, while learning systems focused on extraction, often using inconsistent methods and lacking shared datasets. OntoLearner acts as a bridge, offering a modular Python library that integrates these functions. It provides 180 machine-readable ontologies across 22 different domains, all formatted as pipeline-ready datasets. This allows researchers to easily load, version, and stream data into their workflows, ensuring that different models can be evaluated on the exact same benchmarks.

Standardized Tasks and Benchmarking

To enable rigorous comparison, OntoLearner focuses on three core tasks: term typing (identifying the category of a term), taxonomy discovery (organizing concepts into hierarchies), and non-taxonomic relation extraction (defining how concepts interact). The library provides standardized train, development, and test splits for these tasks. By offering a consistent environment, it allows for the fair evaluation of various approaches, ranging from classical statistical methods to modern LLM-based pipelines. This framework is designed to be extensible, supporting the integration of new models and datasets as the field evolves.

Insights from Large-Scale Empirical Study

Using this new infrastructure, the authors conducted a large-scale study evaluating 22 retrieval models and 12 LLMs. The results revealed a critical insight: the primary challenge in ontology learning is not necessarily the size or complexity of the AI model itself, but a "structural mismatch." The way LLMs encode knowledge often conflicts with the rigid, formal way ontologies organize it. The study found that failure rates tend to scale with the complexity of the ontology rather than the sophistication of the model. This suggests that future progress depends less on simply building larger models and more on better aligning how AI interprets knowledge with the structured requirements of formal ontologies.

Supporting Future Research

OntoLearner is built to be a community-driven resource, released under an MIT license and aligned with FAIR (Findable, Accessible, Interoperable, and Reusable) principles. By providing a common platform for benchmarking, it helps researchers move beyond exploratory prototyping. The library is designed to serve as a standard tool for both semantic web and machine learning practitioners, encouraging a more collaborative and transparent approach to developing AI systems that can effectively reason over structured knowledge.

Comments (0)

No comments yet

Be the first to share your thoughts!