PyData NYC 2024

Dharhas Pothina

Dharhas Pothina is the CTO at Quansight where he helps clients wrangle their data using the pydata stack. He also leads the development teams for the Nebari, Conda-Store and Ragna open source projects.

His background includes expertise in computational modeling, big data/high performance computing, visualization and geospatial analysis. Prior to his current position he worked for 15 years in state and federal research labs where he led large multi-disciplinary, multi-agency research projects.

He holds a PhD in Civil Engineering and an MS in Aerospace Engineering from the University of Texas at Austin and a BTech in Aerospace Engineering from the Indian Institute of Technology Madras.

Dharhas is passionate about enabling scientists and engineers with tools that let them scale as well as share their analyses, he loves woodworking, photography and teaching his daughters to love science.

The speaker's profile picture

Sessions

11-07
10:55
40min
How many dataframe libraries do you need to change a lightbulb?
Dharhas Pothina

“Have you tried ? It will change everything!” ~ My enthusiastic colleagues every other week.

The DataFrame landscape has never been more exciting, from mature libraries like pandas, Dask, and PyArrow, to newer ones like Polars, DuckDB, and Ibis. Let’s get past the hype and evaluate contexts and domains where they excel—whether it’s efficient eager execution, single machine performance, or large-scale data processing.

Central Park West