Tencent/ncnn

ncnn is a category-defining project in the edge inference space. With over 23,000 stars and nearly 9 years of development, it has established an incredible moat through extreme low-level optimization. Its primary strength lies in its hand-written assembly kernels for ARM NEON and its pioneer status in using Vulkan for cross-vendor mobile GPU acceleration. Unlike TensorFlow Lite or CoreML, ncnn is 'zero-dependency,' making it the preferred choice for C++ developers who need to embed AI into apps without bloating binary sizes or dealing with complex toolchains. While Google (TFLite) and Apple (CoreML) dominate their respective platforms, ncnn provides a superior cross-platform ' Switzerland' for mobile deployment, used extensively in high-traffic apps like WeChat. Its defensibility comes from the sheer volume of chipset-specific optimizations that would take years for a new competitor to replicate. Frontier labs are unlikely to compete here as they focus on large-scale model training and cloud API delivery, leaving the 'last mile' of edge optimization to established infrastructure projects like ncnn and Alibaba's MNN.