llama : refactor src/llama.cpp

[ggerganov]

Attempting to split the src/llama.cpp into a few separate modules. Very work-in-progress, mainly opening this PR for people to keep track and suggest improvements as we move along. This part does not involve functional changes, just code reorganization and decoupling to make it easier to work with the codebase. The batch and KV cache abstractions and reimplementations will be done in follow-up PRs.

graph TD;
model   --> arch;
model   --> vocab;
model   --> mmap;
context --> batch;
context --> model;
context --> kv_cache;
context --> control_vector;

Loading

[ngxson]

I think control_vector and lora related stuff should be re-grouped into a module, maybe called adapters (if someone has a better naming, feel free to comment). That's because they work kinda the same way, by "adding things" on top of the original cgraph.