Quick facts
- Best for
- High-Performance Tensor Library for Machine Learning
- Pricing
- Freemium
- Editor rating
- 4.5 / 5
- Community saves
- 0
About GGML
Features of ggml, Examples of Usage, Performance Stats on Apple Silicon (June 2023), Core Principles of ggml, Related Projects, Contributing, Company Information, Business Inquiries, Introduction
Pros
- Written in C
- 16-bit float support
- Integer quantization support (4-bit, 5-bit, 8-bit)
- Automatic differentiation
- Built-in optimization algorithms (ADAM, L-BFGS)
- Optimized for Apple Silicon
- Supports AVX/AVX2 intrinsics on x86 architectures
- WebAssembly and WASM SIMD support
- No third-party dependencies
- Zero memory allocations during runtime
- Guided language output support