CONNECT WITH US
AI & Deeptech

AI & Deeptech

Announcing AI data preparation capabilities in Amazon SageMaker: Build high-quality datasets for model development workflows

AWS Machine Learning logo

Published on

Add as a preferred source on Google
Announcing AI data preparation capabilities in Amazon SageMaker: Build high-quality datasets for model development workflows

Teams that ship generative AI to production know that a model is only as good as its data. That is why preparing high-quality training and evaluation data comes first. Fine-tuning an open-weight model, running reinforcement learning, or building an evaluation suite all depend on data that is accurate, well-labeled, and representative of your task. For narrow, well-defined tasks, a smaller model customized on clean, task-specific data can often match or exceed the accuracy of a larger general-purpose model prompted into shape, at a lower cost per inference.

In practice, though, preparing that data is often the slowest part of the project. Labeled examples are scarce or expensive, and privacy rules limit what you can use. Quality problems such as duplicates, label noise, and answer leakage go unnoticed until a training run disappoints, and every training technique expects data in its own format. As a result, data scientists spend weeks wrangling data instead of building models.

Today, we’re expanding Amazon SageMaker AI with new AI data preparation capabilities for model development workflows. You can generate synthetic examples, assess and improve existing datasets, and bring expert feedback into the process through Python SDK APIs and the AWS AI-ML agent skill. You work in your notebook or IDE, with specifications and code that you can inspect and change.

With AI Data Preparation capabilities, you don’t need to stitch together labeling tools, generation scripts, and validation jobs. Each capability is a standalone building block. You can use one of them on its own or chain them together according to the workflow you want.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.