mirror of
				https://github.com/ggml-org/llama.cpp.git
				synced 2025-10-31 08:51:55 +00:00 
			
		
		
		
	
		
			
				
	
	
		
			9 lines
		
	
	
		
			234 B
		
	
	
	
		
			Markdown
		
	
	
	
	
	
			
		
		
	
	
			9 lines
		
	
	
		
			234 B
		
	
	
	
		
			Markdown
		
	
	
	
	
	
| # llama.cpp/examples/speculative
 | |
| 
 | |
| Demonstration of speculative decoding and tree-based speculative decoding techniques
 | |
| 
 | |
| More info:
 | |
| 
 | |
| - https://github.com/ggerganov/llama.cpp/pull/2926
 | |
| - https://github.com/ggerganov/llama.cpp/pull/3624
 | 
