01 · software
Neptel
A private GenAI platform for organisations that cannot send their data to a third party: self-hosted LLMs, retrieval and orchestration on their own hardware.
- ›OpenAI-compatible API over quantized models on on-prem GPUs.
- ›(Q)LoRA fine-tuning and quantization cut VRAM requirements by 35%.
- ›RAG over vector databases with LangChain for domain-specific Q&A.