fix: respect CPU affinity and cgroup CPU quota for default thread counts - #2385

fix: respect CPU affinity and cgroup CPU quota for default thread counts#2385

manunicholasjacob wants to merge 2 commits into

abetlen:mainabetlen/llama-cpp-python:mainfrom

manunicholasjacob:fix/default-threads-cgroup-limitmanunicholasjacob/llama-cpp-python:fix/default-threads-cgroup-limitCopy head branch name to clipboard