IBM Developer Hungary

Overview
When building machine learning and data applications, a significant portion of your time will be dedicated to data wrangling - from content extraction and cleaning up data. This session introduces Dockling - a robust, open source tool, designed to handle many types of document formats including PDF, DOCX, HTML and PPTX. Attendees will learn first hand how to use Docling to extract and cleanup data from various documents.

Description
Docling is a versatile document processor that handles various file types, including PDF, HTML, and DOCX. It can handle complex document structures like tables, multi-column format etc. It can even extract text from scanned documents. Docling is open source and easy to use.

More about docking: https://github.com/DS4SD/docling

Join us for this hands-on session to explore how to use Docling for your data needs..

In this workshop we will do the following:

• getting started with Docling
• extracting content from various documents (PDF / HTML)
• Handling table and image data
• Extracting content from scanned PDF documents using OCR (Optical Character Recognition)

What do you need to participate in this workshop?

• Comfortable in python programming language
• We will run the workshop code using Google Collab (free) - no other setup is needed!

Session Type
Hands-on workshop

Audience
LLM app developers, data scientists, data engineers

Technical Level
Beginner - Intermediate

Prerequisites

• Comfortable in python programming language
• We will run the workshop using Google Collab (free) - no other setup is needed!

Duration
45 mins

Industry
Cross industry

Speaker Bio
https://sujee.dev/bio

Overview
When building machine learning and data applications, a significant portion of your time will be dedicated to data wrangling - from content extraction and cleaning to de-duplication and filtering out problematic data. In this hands-on session we will explore Data Prep Kit - an open source toolkit, designed to streamline these essential tasks. Attendees will learn first hand how to use the Data Prep Kit to accelerate data preparation, improve overall data quality, and enhance the efficiency of building robust LLM applications.

Description
Data Prep Kit is a comprehensive Python library that democratizes and accelerates data preparation by providing out-of-the-box solutions for common tasks. Engineered to scale from a single laptop to large cloud clusters, it has been successfully used to process terabytes of data for training IBM Granite Large Language Models (LLMs).

Data Prep Kit offers a robust feature set including duplicate elimination, advanced document and code handling, language detection (for both spoken and programming languages), removal of personally identifiable information (PII), as well as spam, hate speech, and malware detection.

More about Data Prep Kit : https://github.com/IBM/data-prep-kit

Join us for this hands-on session to explore how to use Data Prep Kit to accelerate data preparation, enhance data quality.

In this workshop we will do the following:

• getting started with Data Prep Kit
• Extract content from various documents (PDFs, DOCX, HTML)
• Cleanup documents by removing excess markup
• Detect and remove duplicate documents
• Detect and remove low quality and spam documents

What do you need to participate in this workshop?

• Comfortable in python programming language
• We will run the workshop code using Google Collab (free) - no other setup is needed!

Session Type
Hands-on workshop

Audience
LLM app developers, data scientists, data engineers

Technical Level
Beginner - Intermediate

Prerequisites

• Comfortable in python programming language
• We will run the workshop using Google Collab (free) - no other setup is needed!

Duration
60 mins

Industry
Cross industry

Speaker Bio
https://sujee.dev/bio

Overview
When building machine learning and data applications, a significant portion of your time will be dedicated to data wrangling - from content extraction and filtering out problematic and low quality data. In this hands-on session we will explore Data Prep Kit - an open source toolkit, designed to streamline these essential tasks. Attendees will learn first hand how to use the Data Prep Kit to improve overall data quality such as removing spam and low quality documents, removing HAP (Hate Abuse Profanity) speech, removing PII (Personally Identifiable Information) data, thus leading to higher quality dataset.

Description
Join us for an interactive, hands-on session where you will learn to clean up data and prepare high quality datasets.

In this workshop we will do the following:

• Extract content from various documents (PDFs, HTML)
• cleanup and remove markups
• Detect and remove SPAM content
• Score and remove low-quality documents
• Identify and remove PII data
• Detect and remove HAP (Hate Abuse Profanity) speech from documents

More about Data Prep Kit : https://github.com/IBM/data-prep-kit

What do you need to participate in this workshop?

• Comfortable in python programming language
• We will run the workshop code using Google Collab (free) - no other setup is needed!

Session Type
Workshop (hands-on)

Audience
LLM app developers, data scientists, data engineers

Technical Level
Beginner - Intermediate

Prerequisites

• Comfortable in python programming language
• We will run the workshop using Google Collab (free to use) - no other setup is needed!

Duration
60 mins

Industry
Cross industry

Speaker Bio
https://sujee.dev/bio