Layer 1: Traditional ANN Layer 2: RuVector GNN Encode Vector Top-K Interact Reward Update Weights User Query Embedding Index Search Result List User Query Embedding Index Search Result List User Action Q-Value Update