dotlah! dotlah!
  • Cities
  • Technology
  • Business
  • Politics
  • Society
  • Science
  • About
Social Links
  • zedreviews.com
  • citi.io
  • aster.cloud
  • liwaiwai.com
  • guzz.co.uk
  • atinatin.com
0 Likes
0 Followers
0 Subscribers
dotlah!
  • Cities
  • Technology
  • Business
  • Politics
  • Society
  • Science
  • About
  • Artificial Intelligence
  • Technology

IBM contributes key open-source projects to Linux Foundation to advance AI community participation

  • March 22, 2025
Total
0
Shares
0
0
0

IBM is contributing 3 open-source projects—Docling, Data Prep Kit and BeeAI—to the Linux Foundation. This move signals not only the potential growth of these projects but also IBM’s ongoing commitment to open-source AI.

“We’re continuing our long history of contributing open-source projects to ensure that they’re easy to consume and that it’s easy for others—not just us—to contribute,” says Brad Topol, IBM Distinguished Engineer and Director of Open Technologies, in an interview. Topol also chairs the Governing Board of the LF AI & Data Foundation, a group hosted under the Linux Foundation focused on advancing open-source innovation across artificial intelligence and data technologies.

Each project is focused on an essential part of the AI development stack. As the industry matures, innovation driven by the broader developer community in these areas is key to making AI enterprise ready.

Docling, which launched and open-sourced a year ago, addresses a limit that many foundation models have for enterprise use. While the models have been trained on every scrap of publicly available information, much of the data valuable to businesses lies in documents that are not accessible online: PDFs, annual reports, slide decks.

Docling streamlines the process of turning unstructured documents into JSON and Markdown files that are easy for large language models (LLMs) and other foundation models to digest.

Since its release, Docling has gained traction, earning more than 23,000 stars on GitHub. When combined with retrieval-augmented generation (RAG) techniques, Docling improves LLM outputs. “Docling can make the LLMs answer much better and much more specific to their needs,” says Topol. In addition to gaining traction in the open-source community, Docling helps power Red Hat® Enterprise Linux® AI, where it enables context aware chunking and supports the platform’s new data ingestion pipeline.

Of course, another critical step in deploying AI is data preparation. IBM’s Data Prep Kit, which was released in 2024, has also gained popularity: it helps clean, transform and enrich unstructured data for pre-training, fine-tuning and RAG use cases.

Unstructured data—such as databases, web pages and audio files which are more complex to parse and extract insights—accounts for 90% of all enterprise-generated data, according to IDC. LLMs can analyze vast amounts of unstructured data and extract relevant insights to generate and test new product or service ideas, for instance, in hours rather than months.

Data Prep Kit is designed to simplify data prep for LLM applications—currently focused on code and language models—supporting pre-training, fine-tuning and RAG use cases. Built on familiar distributed processing frameworks like Spark and Ray, it gives developers the flexibility to create custom modules that scale easily, whether running on a laptop or across an entire data center.

“We used to say, garbage in, garbage out. You definitely want good data going in,” Topol says. “This is not a glamorous project compared to some of the other parts of the LLM life cycle, but it’s incredibly critical, incredibly valuable and a definite must-have.” Data Prep Kit is beginning to power IBM offerings and is now in IBM’s TechPreview of IBM Data Integration for Unstructured Data.

Finally, as agents are gaining traction, IBM released BeeAI. BeeAI can be used by developers to discover, run and compose AI agents from any framework, including CrewAI, LangGraph, and AutoGen. The project includes the Agent Communication Protocol, which powers agent discoverability and interoperability, and the BeeAI-framework, its native framework for building agents in Python or TypeScript, optimized for open source models.

“There are other frameworks for building agents,” says Topol. “But what’s nice about BeeAI is that it provides a platform where you can also plug in agents from those other technologies. BeeAI doesn’t just work with its own agents.”

By contributing these projects to the Linux Foundation, IBM aims to expand their reach and attract new contributors and users. “The projects are in a wonderful spot where people can invest their resources. It makes a huge difference,” says Topol. “It’s like an insurance policy. The open governance also makes people feel better that if they contribute, over time, they’re going to earn their stripes through what we call meritocracy and earn a more influential role in the project. They can also feel secure that the project won’t make any drastic open-source license changes that could dramatically impede future use of the project.”

Pointing to Kubernetes—an open-source container orchestration system originally developed by Google and later donated to the Cloud Native Computing Foundation—Topol notes how its adoption surged after becoming part of an open governance model, ultimately turning it into an industry standard.

He has bold ambitions for these projects.

“An open-source project with a powerful ecosystem is, frankly, unstoppable,” he says.

Learn more about projects like Docling, Data Prep Kit and BeeAI at the IBM TechXchange Conference October 6-9, 2025, in Orlando, FL. Experts, including project committers and contributors, will be on-site for presentations, hands-on learning and networking opportunities, with more than 30 open-source projects showcased. Registration opens April 4.

By: Anabelle Nicoud (Tech Reporter, IBM)
Originally published at: IBM

Source: zedreviews.com

Total
0
Shares
Share
Tweet
Share
Share
Related Topics
  • AI
  • Artificial Intelligence
  • BeeAI
  • Data Prep Kit
  • Docling
  • IBM
  • Linux
  • Linux Foundation
  • Open Source
dotlah.com

Previous Article
PiPiPi
  • Gears

The Unexpected Pi-Fect Deals This March 14

  • March 14, 2025
View Post
Next Article
  • Lah!

Tariffs, Trump, and Other Things That Start With T – They’re Not The Problem, It’s How We Use Them

  • March 25, 2025
View Post
You May Also Like
View Post
  • Gears
  • Technology

Meet Samsung Galaxy Tab S11 Series: Packing Everything You Expect From a Premium Tablet

  • Dean Marc
  • September 4, 2025
View Post
  • Technology

Malaysia’s ‘ASEAN Shenzhen’ needs some significant legal reform to take off — here’s how

  • dotlah.com
  • August 25, 2025
View Post
  • Gears
  • Technology

Samsung Electronics Debuts Odyssey G7 Monitors, Showcasing Top Games on Its Displays at Gamescom 2025

  • Dean Marc
  • August 20, 2025
View Post
  • Artificial Intelligence
  • Technology

Thoughts on America’s AI Action Plan

  • Dean Marc
  • July 24, 2025
View Post
  • Technology

ESWIN Computing launches the EBC77 Series Single Board Computer with Ubuntu

  • dotlah.com
  • July 17, 2025
View Post
  • Gears
  • Technology

Samsung Galaxy Z Fold7: Raising the Bar for Smartphones

  • Dean Marc
  • July 9, 2025
View Post
  • Cities
  • Technology

Meralco PowerGen’s PacificLight starts up 100 MW fast-response plant in Singapore

  • dotlah.com
  • June 20, 2025
View Post
  • Technology

Apple services deliver powerful features and intelligent updates to users this autumn

  • Dean Marc
  • June 12, 2025


Trending
  • 1
    • Lah!
    ? 10 Panda-Stic Must-Know Facts About Our New Proud Panda Parents!
    • August 22, 2021
  • 2
    • Cities
    Why Are Electric Scooters Dangerous?
    • June 5, 2020
  • 3
    • Cities
    • Technology
    100 Million Changi Rewards Points And Porsche’s First All-Electric Sports Car To Be Won In Changi Airport’s Brand New ‘Win With Changi’ Shopping Campaign
    • November 3, 2021
  • 4
    • Lah!
    • Technology
    First On-Demand Autonomous Shuttle Trial Opens To Public
    • August 20, 2019
  • 5
    • Lah!
    OCBC Bank And Staff Donate Additional S$1,225,000 To Provide Targeted Support To 1,000 Needy Singaporean Families And 55,800 Migrant Workers
    • May 2, 2020
  • AI | Human | Peace | Handshake 6
    • Features
    • People
    • Technology
    The Traits And Qualities That Humans Have. And How AI Would And Should Learn From It.
    • June 23, 2023
  • 7
    • Society
    • Technology
    Singtel Named Employer Of Choice In Asia
    • October 8, 2020
  • 8
    • Cities
    • Lah!
    Additional $120 Million To Help Taxi And Private Hire Car Drivers Affected By Covid-19
    • March 27, 2020
  • new york city 9
    • Cities
    • Scapes
    The Best Views In New York
    • November 10, 2020
  • 10
    • Technology
    SGInnovate To Create More Jobs & Traineeships In Deep Tech Industry
    • September 10, 2020
  • 11
    • Technology
    The Weird, The Wacky, The Just Plain Cool: Best Of CES 2020
    • January 13, 2020
  • 12
    • Technology
    Mastering The ‘Must-Dos’ Of Data Protection
    • November 3, 2021
Trending
  • Smart Watch 1
    Best Smartwatches, Your Gateway to Health Monitoring and Everyday Use
    • October 5, 2025
  • Cooking pots and pans 2
    Best Pots and Pans 2025: All-Season, All-Purpose Picks for Every Kitchen
    • September 23, 2025
  • 3
    Politicians love comparing NZ’s economy to Singapore or Ireland – but it’s simplistic and misleading
    • September 21, 2025
  • Kitchen Knives - Best All-Around Picks in 2025 4
    Kitchen Knives : The Surgeons of Cooking – Best All-Around Picks in 2025
    • September 15, 2025
  • 5
    Apple unveils iPhone 17 Pro and iPhone 17 Pro Max, the most powerful and advanced Pro models ever
    • September 9, 2025
  • 6
    Apple debuts iPhone 17
    • September 9, 2025
  • Fruits and vegetables for cooking. For food processors. 7
    Food Processor: The Swiss Army Knife of the Kitchen – Best All-Around Picks in 2025
    • September 8, 2025
  • 8
    Meet Samsung Galaxy Tab S11 Series: Packing Everything You Expect From a Premium Tablet
    • September 4, 2025
  • 9
    Malaysia’s ‘ASEAN Shenzhen’ needs some significant legal reform to take off — here’s how
    • August 25, 2025
  • French Fries 10
    Air Fryer: The One Cooking Appliance to Rule Them All – Best All-Around Picks in 2025
    • August 22, 2025
Social Links
dotlah! dotlah!
  • Cities
  • Technology
  • Business
  • Politics
  • Society
  • Science
  • About
Connecting Dots Across Asia's Tech and Urban Landscape

Input your search keywords and press Enter.