dotlah! dotlah!
  • Cities
  • Technology
  • Business
  • Politics
  • Society
  • Science
  • About
Social Links
  • zedreviews.com
  • citi.io
  • aster.cloud
  • liwaiwai.com
  • guzz.co.uk
  • atinatin.com
0 Likes
0 Followers
0 Subscribers
dotlah!
  • Cities
  • Technology
  • Business
  • Politics
  • Society
  • Science
  • About
  • Artificial Intelligence
  • Technology

IBM contributes key open-source projects to Linux Foundation to advance AI community participation

  • March 22, 2025
Total
0
Shares
0
0
0

IBM is contributing 3 open-source projects—Docling, Data Prep Kit and BeeAI—to the Linux Foundation. This move signals not only the potential growth of these projects but also IBM’s ongoing commitment to open-source AI.

“We’re continuing our long history of contributing open-source projects to ensure that they’re easy to consume and that it’s easy for others—not just us—to contribute,” says Brad Topol, IBM Distinguished Engineer and Director of Open Technologies, in an interview. Topol also chairs the Governing Board of the LF AI & Data Foundation, a group hosted under the Linux Foundation focused on advancing open-source innovation across artificial intelligence and data technologies.

Each project is focused on an essential part of the AI development stack. As the industry matures, innovation driven by the broader developer community in these areas is key to making AI enterprise ready.

Docling, which launched and open-sourced a year ago, addresses a limit that many foundation models have for enterprise use. While the models have been trained on every scrap of publicly available information, much of the data valuable to businesses lies in documents that are not accessible online: PDFs, annual reports, slide decks.

Docling streamlines the process of turning unstructured documents into JSON and Markdown files that are easy for large language models (LLMs) and other foundation models to digest.

Since its release, Docling has gained traction, earning more than 23,000 stars on GitHub. When combined with retrieval-augmented generation (RAG) techniques, Docling improves LLM outputs. “Docling can make the LLMs answer much better and much more specific to their needs,” says Topol. In addition to gaining traction in the open-source community, Docling helps power Red Hat® Enterprise Linux® AI, where it enables context aware chunking and supports the platform’s new data ingestion pipeline.

Of course, another critical step in deploying AI is data preparation. IBM’s Data Prep Kit, which was released in 2024, has also gained popularity: it helps clean, transform and enrich unstructured data for pre-training, fine-tuning and RAG use cases.

Unstructured data—such as databases, web pages and audio files which are more complex to parse and extract insights—accounts for 90% of all enterprise-generated data, according to IDC. LLMs can analyze vast amounts of unstructured data and extract relevant insights to generate and test new product or service ideas, for instance, in hours rather than months.

Data Prep Kit is designed to simplify data prep for LLM applications—currently focused on code and language models—supporting pre-training, fine-tuning and RAG use cases. Built on familiar distributed processing frameworks like Spark and Ray, it gives developers the flexibility to create custom modules that scale easily, whether running on a laptop or across an entire data center.

“We used to say, garbage in, garbage out. You definitely want good data going in,” Topol says. “This is not a glamorous project compared to some of the other parts of the LLM life cycle, but it’s incredibly critical, incredibly valuable and a definite must-have.” Data Prep Kit is beginning to power IBM offerings and is now in IBM’s TechPreview of IBM Data Integration for Unstructured Data.

Finally, as agents are gaining traction, IBM released BeeAI. BeeAI can be used by developers to discover, run and compose AI agents from any framework, including CrewAI, LangGraph, and AutoGen. The project includes the Agent Communication Protocol, which powers agent discoverability and interoperability, and the BeeAI-framework, its native framework for building agents in Python or TypeScript, optimized for open source models.

“There are other frameworks for building agents,” says Topol. “But what’s nice about BeeAI is that it provides a platform where you can also plug in agents from those other technologies. BeeAI doesn’t just work with its own agents.”

By contributing these projects to the Linux Foundation, IBM aims to expand their reach and attract new contributors and users. “The projects are in a wonderful spot where people can invest their resources. It makes a huge difference,” says Topol. “It’s like an insurance policy. The open governance also makes people feel better that if they contribute, over time, they’re going to earn their stripes through what we call meritocracy and earn a more influential role in the project. They can also feel secure that the project won’t make any drastic open-source license changes that could dramatically impede future use of the project.”

Pointing to Kubernetes—an open-source container orchestration system originally developed by Google and later donated to the Cloud Native Computing Foundation—Topol notes how its adoption surged after becoming part of an open governance model, ultimately turning it into an industry standard.

He has bold ambitions for these projects.

“An open-source project with a powerful ecosystem is, frankly, unstoppable,” he says.

Learn more about projects like Docling, Data Prep Kit and BeeAI at the IBM TechXchange Conference October 6-9, 2025, in Orlando, FL. Experts, including project committers and contributors, will be on-site for presentations, hands-on learning and networking opportunities, with more than 30 open-source projects showcased. Registration opens April 4.

By: Anabelle Nicoud (Tech Reporter, IBM)
Originally published at: IBM

Source: zedreviews.com

Total
0
Shares
Share
Tweet
Share
Share
Related Topics
  • AI
  • Artificial Intelligence
  • BeeAI
  • Data Prep Kit
  • Docling
  • IBM
  • Linux
  • Linux Foundation
  • Open Source
dotlah.com

Previous Article
PiPiPi
  • Gears

The Unexpected Pi-Fect Deals This March 14

  • March 14, 2025
View Post
Next Article
  • Lah!

Tariffs, Trump, and Other Things That Start With T – They’re Not The Problem, It’s How We Use Them

  • March 25, 2025
View Post
You May Also Like
View Post
  • Gears
  • Technology

Apple Vision Pro upgraded with the powerful M5 chip and comfortable Dual Knit Band

  • Dean Marc
  • October 15, 2025
View Post
  • Gears
  • Technology

Meet Samsung Galaxy Tab S11 Series: Packing Everything You Expect From a Premium Tablet

  • Dean Marc
  • September 4, 2025
View Post
  • Technology

Malaysia’s ‘ASEAN Shenzhen’ needs some significant legal reform to take off — here’s how

  • dotlah.com
  • August 25, 2025
View Post
  • Gears
  • Technology

Samsung Electronics Debuts Odyssey G7 Monitors, Showcasing Top Games on Its Displays at Gamescom 2025

  • Dean Marc
  • August 20, 2025
View Post
  • Artificial Intelligence
  • Technology

Thoughts on America’s AI Action Plan

  • Dean Marc
  • July 24, 2025
View Post
  • Technology

ESWIN Computing launches the EBC77 Series Single Board Computer with Ubuntu

  • dotlah.com
  • July 17, 2025
View Post
  • Gears
  • Technology

Samsung Galaxy Z Fold7: Raising the Bar for Smartphones

  • Dean Marc
  • July 9, 2025
View Post
  • Cities
  • Technology

Meralco PowerGen’s PacificLight starts up 100 MW fast-response plant in Singapore

  • dotlah.com
  • June 20, 2025


Trending
  • 1
    • Business
    • People
    • Technology
    How Technology Is Improving Human Resources Management
    • February 14, 2020
  • 2
    • Gears
    Apple unveils iPhone 17 Pro and iPhone 17 Pro Max, the most powerful and advanced Pro models ever
    • September 9, 2025
  • citiio-construction-site-mark-potterton-sNVkn3507Oo-unsplash 3
    • Business
    • Cities
    • Features
    On Solid Ground: Meeting Safety Standards in Construction
    • March 19, 2024
  • goswifties_from-stockholm-to-lisbon_20240523_wm 4
    • Featured
    From The Heart of Stockholm To Welcoming City Of Seven Hills
    • May 24, 2024
  • 5
    • Cities
    • Lah!
    9.6km Of New Cycling Paths In Taman Jurong And Tampines
    • November 3, 2021
  • 6
    • Economy
    Trump’s global trade plans are in disarray, after a US court ruling on ‘Liberation Day’ tariffs
    • May 29, 2025
  • 7
    • Lah!
    DBS To Adopt The Equator Principles
    • November 19, 2019
  • 8
    • Cities
    • Lah!
    Singapore Retains Top Spot Amongst World Maritime Centres For The Eighth Consecutive Year
    • July 13, 2021
  • chicago 9
    • Cities
    • Scapes
    Rediscovering Chicago’s Rich History And What We Can Learn From It Today
    • December 28, 2020
  • workplace 10
    • Business
    • People
    Simple Tips That Will Help Protect Your Rights In The Office
    • January 13, 2021
  • 11
    • Technology
    NUS Researchers Discovered A New Personalised Tool To Detect Cancer Using Big Data Analytics
    • January 14, 2020
  • iceland-landon-arnold-MgWEUyCU0rs-unsplash 12
    • Cities
    • World Events
    How To Build More Resilient Countries After The COVID-19 Pandemic
    • February 16, 2021
Trending
  • Bluetooth speakers 1
    Best Bluetooth Speakers Under $200 (2025 Edition)
    • October 16, 2025
  • 2
    Apple Vision Pro upgraded with the powerful M5 chip and comfortable Dual Knit Band
    • October 15, 2025
  • 3
    Apple unveils new 14‑inch MacBook Pro powered by the M5 chip, delivering the next big leap in AI for the Mac
    • October 15, 2025
  • 4
    Apple introduces the powerful new iPad Pro with the M5 chip
    • October 15, 2025
  • 5
    Singapore’s national identity excludes those who don’t look like a ‘regular family’
    • October 9, 2025
  • Smart Watch 6
    Best Smartwatches, Your Gateway to Health Monitoring and Everyday Use
    • October 5, 2025
  • Cooking pots and pans 7
    Best Pots and Pans 2025: All-Season, All-Purpose Picks for Every Kitchen
    • September 23, 2025
  • 8
    Politicians love comparing NZ’s economy to Singapore or Ireland – but it’s simplistic and misleading
    • September 21, 2025
  • Kitchen Knives - Best All-Around Picks in 2025 9
    Kitchen Knives : The Surgeons of Cooking – Best All-Around Picks in 2025
    • September 15, 2025
  • 10
    Apple unveils iPhone 17 Pro and iPhone 17 Pro Max, the most powerful and advanced Pro models ever
    • September 9, 2025
Social Links
dotlah! dotlah!
  • Cities
  • Technology
  • Business
  • Politics
  • Society
  • Science
  • About
Connecting Dots Across Asia's Tech and Urban Landscape

Input your search keywords and press Enter.