using openailike for llamaindex that will allow of usage of any openai compatible models via api, and not just hardcoded models inside default OpenAI class in llamaindex
This commit is contained in:
@@ -93,3 +93,10 @@ Chosen data folder: relatve ./../../../data - from the current folder
|
||||
- optionally filter low-information chunks (headers/footers)
|
||||
- [x] Add optional metadata-aware retrieval improvements (years/events/keywords) parity with LangChain approach (folder near current folder), if feasible in the chosen LlamaIndex primitives.
|
||||
- [x] Update `server.py` endpoint to use the new agent-like chat path (keep simple retrieval endpoint available as fallback or debug mode).
|
||||
|
||||
# Phase 13 (make wrapper around OpenAI llamaindex class or install library to help use any openai compatible models)
|
||||
|
||||
Inside config.py file object is being created for using as Chat Model. Unfortunately, it allows only "supported" models as value for "model" argument in constructor.
|
||||
|
||||
- [x] Search online for library or plugin for llamainde, that fixes the OpenAI class behaviour or provides replacement, that will allow any models. If found, install it in project venv, update then requirements.txt and replace usage of OpenAI to new one in the code.
|
||||
- [x] Fallback option: create wrapper of OpenAI class, that will inherit and replace methods/features that check for "registered" models. Use the replacement then in the code.
|
||||
|
||||
Reference in New Issue
Block a user