Raw Data
↓
Download + Preprocessing
↓
Embedding Generation (Text / Image / CF / VLM)
↓
Multimodal Fusion (optional)
↓
Quantization (RQ-VAE / OPQ / PQ / RKMeans)
↓
Generative Recommender (TIGER / RPG / LETTER / LLMs)
↓
Inference (Beam Search / Prefix-tree / Contrastive Rerank)
Requirements
- Python 3.10 (recommended)
- CUDA 11.8+ (for GPU acceleration)
- PyTorch, CUDA, and other dependencies will be installed automatically via
requirements.txt
pip install -r requirements.txtWe provide a dedicated submodule for downloading, cleaning, and extracting embeddings (Text/Image/CF).
👉 See detailed tutorial:
GenRec-Factory Data Processing & Embedding Guide
Convert dense embeddings into discrete Semantic IDs (SIDs)
cd quantization
python main.py \
--model_name rqvae \
--dataset_name amazon-musical-instruments-23 \
--embedding_modality text \
--embedding_model sentence-t5-baseTrain a generative recommender using the generated SIDs.
cd recommendation
python main.py \
--model ReGen \
--dataset amazon-musical-instruments-23 \
--quant_method rqvae