dotlah! dotlah!
  • Cities
  • Technology
  • Business
  • Politics
  • Society
  • Science
  • About
Social Links
  • zedreviews.com
  • citi.io
  • aster.cloud
  • liwaiwai.com
  • guzz.co.uk
  • atinatin.com
0 Likes
0 Followers
0 Subscribers
dotlah!
  • Cities
  • Technology
  • Business
  • Politics
  • Society
  • Science
  • About
  • Artificial Intelligence
  • Technology

IBM contributes key open-source projects to Linux Foundation to advance AI community participation

  • March 22, 2025
Total
0
Shares
0
0
0

IBM is contributing 3 open-source projects—Docling, Data Prep Kit and BeeAI—to the Linux Foundation. This move signals not only the potential growth of these projects but also IBM’s ongoing commitment to open-source AI.

“We’re continuing our long history of contributing open-source projects to ensure that they’re easy to consume and that it’s easy for others—not just us—to contribute,” says Brad Topol, IBM Distinguished Engineer and Director of Open Technologies, in an interview. Topol also chairs the Governing Board of the LF AI & Data Foundation, a group hosted under the Linux Foundation focused on advancing open-source innovation across artificial intelligence and data technologies.

Each project is focused on an essential part of the AI development stack. As the industry matures, innovation driven by the broader developer community in these areas is key to making AI enterprise ready.

Docling, which launched and open-sourced a year ago, addresses a limit that many foundation models have for enterprise use. While the models have been trained on every scrap of publicly available information, much of the data valuable to businesses lies in documents that are not accessible online: PDFs, annual reports, slide decks.

Docling streamlines the process of turning unstructured documents into JSON and Markdown files that are easy for large language models (LLMs) and other foundation models to digest.

Since its release, Docling has gained traction, earning more than 23,000 stars on GitHub. When combined with retrieval-augmented generation (RAG) techniques, Docling improves LLM outputs. “Docling can make the LLMs answer much better and much more specific to their needs,” says Topol. In addition to gaining traction in the open-source community, Docling helps power Red Hat® Enterprise Linux® AI, where it enables context aware chunking and supports the platform’s new data ingestion pipeline.

Of course, another critical step in deploying AI is data preparation. IBM’s Data Prep Kit, which was released in 2024, has also gained popularity: it helps clean, transform and enrich unstructured data for pre-training, fine-tuning and RAG use cases.

Unstructured data—such as databases, web pages and audio files which are more complex to parse and extract insights—accounts for 90% of all enterprise-generated data, according to IDC. LLMs can analyze vast amounts of unstructured data and extract relevant insights to generate and test new product or service ideas, for instance, in hours rather than months.

Data Prep Kit is designed to simplify data prep for LLM applications—currently focused on code and language models—supporting pre-training, fine-tuning and RAG use cases. Built on familiar distributed processing frameworks like Spark and Ray, it gives developers the flexibility to create custom modules that scale easily, whether running on a laptop or across an entire data center.

“We used to say, garbage in, garbage out. You definitely want good data going in,” Topol says. “This is not a glamorous project compared to some of the other parts of the LLM life cycle, but it’s incredibly critical, incredibly valuable and a definite must-have.” Data Prep Kit is beginning to power IBM offerings and is now in IBM’s TechPreview of IBM Data Integration for Unstructured Data.

Finally, as agents are gaining traction, IBM released BeeAI. BeeAI can be used by developers to discover, run and compose AI agents from any framework, including CrewAI, LangGraph, and AutoGen. The project includes the Agent Communication Protocol, which powers agent discoverability and interoperability, and the BeeAI-framework, its native framework for building agents in Python or TypeScript, optimized for open source models.

“There are other frameworks for building agents,” says Topol. “But what’s nice about BeeAI is that it provides a platform where you can also plug in agents from those other technologies. BeeAI doesn’t just work with its own agents.”

By contributing these projects to the Linux Foundation, IBM aims to expand their reach and attract new contributors and users. “The projects are in a wonderful spot where people can invest their resources. It makes a huge difference,” says Topol. “It’s like an insurance policy. The open governance also makes people feel better that if they contribute, over time, they’re going to earn their stripes through what we call meritocracy and earn a more influential role in the project. They can also feel secure that the project won’t make any drastic open-source license changes that could dramatically impede future use of the project.”

Pointing to Kubernetes—an open-source container orchestration system originally developed by Google and later donated to the Cloud Native Computing Foundation—Topol notes how its adoption surged after becoming part of an open governance model, ultimately turning it into an industry standard.

He has bold ambitions for these projects.

“An open-source project with a powerful ecosystem is, frankly, unstoppable,” he says.

Learn more about projects like Docling, Data Prep Kit and BeeAI at the IBM TechXchange Conference October 6-9, 2025, in Orlando, FL. Experts, including project committers and contributors, will be on-site for presentations, hands-on learning and networking opportunities, with more than 30 open-source projects showcased. Registration opens April 4.

By: Anabelle Nicoud (Tech Reporter, IBM)
Originally published at: IBM

Source: zedreviews.com

Total
0
Shares
Share
Tweet
Share
Share
Related Topics
  • AI
  • Artificial Intelligence
  • BeeAI
  • Data Prep Kit
  • Docling
  • IBM
  • Linux
  • Linux Foundation
  • Open Source
dotlah.com

Previous Article
PiPiPi
  • Gears

The Unexpected Pi-Fect Deals This March 14

  • March 14, 2025
View Post
Next Article
  • Lah!

Tariffs, Trump, and Other Things That Start With T – They’re Not The Problem, It’s How We Use Them

  • March 25, 2025
View Post
You May Also Like
View Post
  • Technology

Malaysia’s ‘ASEAN Shenzhen’ needs some significant legal reform to take off — here’s how

  • dotlah.com
  • August 25, 2025
View Post
  • Gears
  • Technology

Samsung Electronics Debuts Odyssey G7 Monitors, Showcasing Top Games on Its Displays at Gamescom 2025

  • Dean Marc
  • August 20, 2025
View Post
  • Artificial Intelligence
  • Technology

Thoughts on America’s AI Action Plan

  • Dean Marc
  • July 24, 2025
View Post
  • Technology

ESWIN Computing launches the EBC77 Series Single Board Computer with Ubuntu

  • dotlah.com
  • July 17, 2025
View Post
  • Gears
  • Technology

Samsung Galaxy Z Fold7: Raising the Bar for Smartphones

  • Dean Marc
  • July 9, 2025
View Post
  • Cities
  • Technology

Meralco PowerGen’s PacificLight starts up 100 MW fast-response plant in Singapore

  • dotlah.com
  • June 20, 2025
View Post
  • Technology

Apple services deliver powerful features and intelligent updates to users this autumn

  • Dean Marc
  • June 12, 2025
View Post
  • Artificial Intelligence
  • Machine Learning
  • Technology

Apple supercharges its tools and technologies for developers to foster creativity, innovation, and design

  • Dean Marc
  • June 11, 2025


Trending
  • 1
    • Cities
    • People
    2020’s Best And Worst US States For Women
    • March 8, 2020
  • hong-kong-mtr-cheung-yin-7PrfWLpoPSs-unsplash 2
    • Cities
    Top 10 Cities With The Best Public Transport
    • December 16, 2022
  • support group holding hands 3
    • People
    Drug And Alcohol Rehab Success Rates: Do They Really Work?
    • October 22, 2020
  • 4
    • Lah!
    National Gallery Singapore Celebrates National Day
    • August 8, 2019
  • 5
    • Society
    CapitaLand Sets Up RMB10 Million Healthcare Fund To Support Relief Efforts In China
    • January 28, 2020
  • 6
    • Lah!
    • Technology
    Measuring The Digital Pulse Of Employee Engagement
    • July 8, 2021
  • 7
    • Lah!
    Remembering The War Through Battle For Singapore
    • February 4, 2020
  • 8
    • Cities
    • Lah!
    Empowering Cloud Sustainability With The Microsoft Emissions Impact Dashboard
    • October 16, 2021
  • 9
    • Cities
    • Technology
    Partnerships To Build A Safer Internet In Asia Pacific
    • February 8, 2022
  • time-mag-poy-2020-cover 10
    • People
    Time Magazine’s “Person of the Year” Grows More Diverse
    • December 12, 2020
  • 11
    • Cities
    3 Monthly Expenses You Can Trim To Save Money In The City
    • February 25, 2020
  • 12
    • Cities
    • Lah!
    FairPrice Launches Share-A-Textbook Project And A Hackathon To Empower Students In Generating Sustainability Ideas
    • October 27, 2021
Trending
  • 1
    Malaysia’s ‘ASEAN Shenzhen’ needs some significant legal reform to take off — here’s how
    • August 25, 2025
  • French Fries 2
    Air Fryer: The One Cooking Appliance to Rule Them All – Best All-Around Picks in 2025
    • August 22, 2025
  • 3
    Samsung Electronics Debuts Odyssey G7 Monitors, Showcasing Top Games on Its Displays at Gamescom 2025
    • August 20, 2025
  • 4
    HP Cranks Up the Game with Smarter Systems, Cooler Builds, and Gear That Hits Different
    • August 14, 2025
  • 5
    New Trump tariffs: early modelling shows most economies lose – the US more than many
    • August 6, 2025
  • Scuba Diving 6
    Wetsuit or Drysuit? As always, it depends. This quick guide can help you choose.
    • August 2, 2025
  • 7
    Thoughts on America’s AI Action Plan
    • July 24, 2025
  • 8
    Introducing Surface Laptop 5G: Seamless connectivity, built for business
    • July 23, 2025
  • 9
    Press Start (Or Hit Enter)! Your Go-To Loadout for Streamers and Gamers.
    • July 19, 2025
  • 10
    ESWIN Computing launches the EBC77 Series Single Board Computer with Ubuntu
    • July 17, 2025
Social Links
dotlah! dotlah!
  • Cities
  • Technology
  • Business
  • Politics
  • Society
  • Science
  • About
Connecting Dots Across Asia's Tech and Urban Landscape

Input your search keywords and press Enter.