MLX-compatible REAP for pruning MoE models on Apple Silicon
-
Updated
Oct 14, 2026 - Python
#
expert-pruning
Here are 10 public repositories matching this topic...
MoE expert compression toolkit — prune, merge, and forge specialist models for local inference.
machine-learning pytorch moe pruning quantization model-compression mixture-of-experts llm llama-cpp vllm local-llm llm-inference gguf expert-pruning
-
Updated
Oct 15, 2026 - Python
RAZOR: Pruning Replaceable Experts in LLMs — training-free expert pruning for Mixture-of-Experts (MoE) models, with the MoECal calibration corpus
pytorch moe pruning model-compression mixture-of-experts llm training-free llm-compression expert-pruning moe-pruning
-
Updated
Oct 1, 2026 - Python
Experimental MoE expert pruning and router analysis for safetensors checkpoints. CPU probing, keep plans, dry runs, and checkpoint rewriting with synthetic tests.
python pytorch moe model-compression mixture-of-experts llm safetensors qwen mixtral deepseek router-analysis olmoe expert-pruning
-
Updated
Oct 11, 2026 - Python
Less is MoE (EMNLP 2026 Main); Fisher-MoE: intra-expert structured pruning and compression for Mixture-of-Experts (MoE) LLMs. Prunes FFN intermediate dimensions by Fisher importance instead of dropping whole experts. Official code.
moe pruning model-compression efficient-inference fisher-information mixture-of-experts neuron-pruning structured-pruning large-language-models llm vllm qwen llm-compression emnlp2026 olmoe expert-pruning
-
Updated
Sep 25, 2026 - Python
Code release for DIET: DeletIon-response Expert Trimming for Video Diffusion Transformers
-
Updated
Sep 30, 2026 - Python
KL-divergence + blind task eval of GLM-4.7-Flash and its REAP-pruned variant vs gpt-oss-20b on llama.cpp
moe glm quantization kl-divergence runpod llama-cpp local-llm gguf llm-evaluation gpt-oss expert-pruning
-
Updated
Jun 12, 2026 - Python
How I fit 35B-parameter MoE models into 16 GB of consumer VRAM: REAP expert pruning + NVFP4 quantization on an RTX 5070 Ti (SM120), served on vLLM, with measured evals.
moe quantization reap mixture-of-experts blackwell vllm llm-inference consumer-gpu nvfp4 expert-pruning
-
Updated
Sep 9, 2026
Serving a large MoE coder model on consumer Blackwell GPUs via REAP expert pruning + NVFP4 quantization.
-
Updated
Sep 22, 2026 - Python
REAP pruning + NVFP4 quantization of Ornith-1.5-35B-A3B for 16GB VRAM
-
Updated
Sep 22, 2026 - Python
Add this topic to your repo
To associate your repository with the expert-pruning topic, visit your repo's landing page and select "manage topics."