Kache@lemm.eetoProgramming@programming.dev•Any data scientists out there? What's your go to programming language and tools for your work?
0·
3 days agoWhat kind of query optimization can it for scanning data that’s already in memory?
What kind of query optimization can it for scanning data that’s already in memory?
Hm, that’s kind of interesting
But my first reaction is that optimizations only at the “Python processing level” are going to be pretty limited since it’s not going to have metadata/statistics, and it’d depend heavily on the source data layout, e.g. CSV vs parquet