LLM Fine-Tuning & Local Inference
Fine-tuning open-source LLMs with LoRA and running them locally via Ollama and llama.cpp.
NLPDeep Learning
Overview
Personal exploration of parameter-efficient fine-tuning for open-source LLMs (LoRA), with local inference via Ollama and llama.cpp. Includes prompt-engineering experiments and adapter-merging for domain-specific tasks.
Key Highlights
- LoRA fine-tuning for domain-specific tasks
- Local inference via Ollama and llama.cpp
- Prompt-engineering and adapter merging experiments
Tech Stack
PythonPyTorchPEFTTransformersOllama
Other Projects
All ProjectsProjection Mapping in Unity3D
Data Engineering
Spatial calibration + blending for multi-projector image/video content, in Unity3D.
View ProjectArc-Mode Classification + PyQt GUI
Deep LearningComputer VisionPython
Deep-learning pipeline that classifies arc appearance modes from high-speed video, with a PyQt analysis GUI.
View ProjectMultitask NLP Classifier with BERT
NLPDeep Learning
Multitask BERT for paraphrase detection, semantic textual similarity and sentiment analysis.
View ProjectStay Updated
Subscribe to get the latest blog posts, project updates, and data science insights straight to your inbox.
No spam. Unsubscribe anytime.