ID photo of Ciro Santilli taken in 2013 right eyeCiro Santilli OurBigBook logoOurBigBook.com $£ Sponsor 中国独裁统治 China Dictatorship 新疆改造中心、六四事件、法轮功、郝海东、709大抓捕、2015巴拿马文件 邓家贵、低端人口、西藏骚乱

llama-cli inference batching

As of llama.cpp 79e0b68c178656bb0632cb8602d2940b755077f8 there is a --parallel option but not sure what it does.
Bibliography:

Ancestors (17)

  1. llama-cli
  2. llama.cpp
  3. Ollama
  4. Open source LLM
  5. Large language model
  6. Text-to-text model
  7. AI text generation
  8. Generative AI by modality
  9. Generative AI
  10. AI by capability
  11. Artificial intelligence
  12. Machine learning
  13. Computer
  14. Information technology
  15. Area of technology
  16. Technology
  17. Home