DuckDB

DuckDB is a database intended to empower single machines with the ability to process large volumes of data.   Open-source, embedded, in-process, relational OLAP DBMS that is typically orders of magnitude faster than Pandas. You can use it from the shell or over 10 different programming languages. In most of them, you can choose between a traditional analytical interface and a SQL interface.

Related Links

My First Billion (of Rows) in DuckDB

Python One Billion Row Challenge — From 10 Minutes to 4 Seconds