We're[0] building a tool that helps you do what you described. We mainly advertise our ability to do this over your data warehouse, like Snowflake, but we also use DuckDB to help people query CSVs.

3.5 has worked pretty well for us in most cases. It's also a good amount faster. GPT-4 seems to really stand out for our complex joins.

- 0 = https://www.definite.app