Aarti Jha
Aarti Jha is currently a Senior Data Scientist at Red Hat, Bengaluru, India, where she develops AI-driven solutions to streamline processes and reduce operational costs for internal initiatives. With over six years of experience, she has previously led the development of search and recommendation systems for e-pharma at her prior organisation.
In her free time, Aarti enjoys bringing her creative visions to life through sketching.
Sessions
In an era of information overload, the ability to distill vast amounts of text into clear, concise summaries is more essential than ever. Large Language Models (LLMs) have become powerful tools for this task, revolutionizing how we process and comprehend data. However, the journey from raw data to insightful summaries isn't without its hurdles. Beyond their impressive capabilities, LLMs face significant challenges, particularly when dealing with extensive texts. How can we overcome the constraints of limited context windows? How to even scale such LLMs for thousands of concurrent users? In this talk Aarti will walk through the art and science of tackling these issues, from effectively chunking long documents, optimizing model performance within limited context windows and eventually deploying such models into production. She will also demonstrate advanced evaluation techniques to ensure that the summaries generated are both accurate and meaningful. An AI enthusiast or a seasoned professional, this session will equip the attendees with strategies to enhance their text summarization and maximize the potential of LLMs.