The reason your pgvector benchmark is lying to you

TL;DR AI
2 min readKey summary
pgvector can behave very differently at production scale than in small demos.
HNSW indexing (v0.5.0) improved recall and consistency but index builds use substantial RAM and time.
Run benchmarks on representative data and scale, and tune index parameters before committing.
Use SQL filters to narrow candidates and combine ANN with re-ranking to improve performance.



