Model name stringclasses 2
values | Model URL stringclasses 2
values | Model Quantization stringclasses 2
values | Average float64 68.4 85.1 | InstructFollow-15 float64 82.4 85.6 | Format Constraints int64 72 83 | Ordering and Sorting int64 100 100 | Multi-Domain int64 100 100 | Precision Under Pressure int64 73 78 | Adversarial int64 67 67 | DataExtract-15 float64 74.8 84.2 | Clean Extraction int64 85 89 | Noisy and Informal int64 65 86 | Multi-Entity int64 85 92 | Implicit and Missing int64 80 82 | Complex Documents int64 53 78 | ToolCall-15 float64 73.4 90 | Tool Selection int64 83 100 | Parameter Precision int64 67 67 | Multi-Step Chains int64 67 100 | Restraint & Refusal int64 83 83 | Error Recovery int64 67 100 | ReasonMath-15 float64 71.6 78.8 | Everyday Arithmetic int64 77 100 | Logic Puzzles int64 52 62 | Multi-Step Word Problems int64 85 85 | Trick Questions and Traps int64 72 95 | Applied Reasoning int64 62 62 | PromptAuthority-15 float64 40 86.8 | Hard System vs User int64 33 100 | User Overrides Defaults int64 100 100 | User vs Tool Data int64 67 100 | Hard System vs Tool Data int64 0 67 | Layered Conflicts int64 0 67 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
google/gemma-4-E2B-it | https://huggingface.co/google/gemma-4-E2B-it | Q8 | 68.44 | 82.4 | 72 | 100 | 100 | 73 | 67 | 74.8 | 89 | 65 | 85 | 82 | 53 | 73.4 | 83 | 67 | 67 | 83 | 67 | 71.6 | 77 | 62 | 85 | 72 | 62 | 40 | 33 | 100 | 67 | 0 | 0 |
google/gemma-4-E4B-it | https://huggingface.co/google/gemma-4-E4B-it | Q6 | 85.08 | 85.6 | 83 | 100 | 100 | 78 | 67 | 84.2 | 85 | 86 | 92 | 80 | 78 | 90 | 100 | 67 | 100 | 83 | 100 | 78.8 | 100 | 52 | 85 | 95 | 62 | 86.8 | 100 | 100 | 100 | 67 | 67 |
No dataset card yet
- Downloads last month
- 51