langchain loading documents into vector storage
This commit is contained in:
@@ -24,6 +24,7 @@ rag-solution/services/rag/langchain/
|
||||
├── app.py # Main application file (currently empty)
|
||||
├── cli.py # CLI entrypoint with click library
|
||||
├── EXTENSIONS.md # Supported file extensions and LangChain loaders
|
||||
├── enrichment.py # Document enrichment module for loading documents to vector storage
|
||||
├── PLANNING.md # Development roadmap and phases
|
||||
├── QWEN.md # Current file - project context
|
||||
├── requirements.txt # Python dependencies
|
||||
@@ -64,10 +65,10 @@ The project is organized into 6 development phases as outlined in `PLANNING.md`:
|
||||
- [x] Prepare OpenAI fallback (commented)
|
||||
|
||||
### Phase 4: Document Loading Module
|
||||
- [ ] Create `enrichment.py` for loading documents to vector storage
|
||||
- [ ] Implement text splitting strategies
|
||||
- [ ] Add document tracking to prevent re-processing
|
||||
- [ ] Integrate with CLI
|
||||
- [x] Create `enrichment.py` for loading documents to vector storage
|
||||
- [x] Implement text splitting strategies
|
||||
- [x] Add document tracking to prevent re-processing
|
||||
- [x] Integrate with CLI
|
||||
|
||||
### Phase 5: Retrieval Feature
|
||||
- [ ] Create `retrieval.py` for querying vector storage
|
||||
|
||||
Reference in New Issue
Block a user