this post was submitted on 22 Apr 2024
137 points (93.6% liked)

Programmer Humor

19570 readers
1438 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 1 year ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] bobburger@fedia.io 4 points 6 months ago

I love duckDB, my usual workflow is:

  • initially read my data from whatever source (CSV, relational database somewhere, whatever)
  • write it to one or more parquet files in a directory
  • tell duckdb that the directory is my data source

Then duckdb treats the directory just like a databese that you can build indexes on, and since they're parquet files they're hella small and have static typing. It was pretty fast and efficient before, and duckdb has really sped up my data wrangling and analysis a ton.