Vision LLMs vs. OCR for PDF Q&A: OCR Still Wins on Cost and Accuracy

// related

• #0001

  #0001OtherGeekNews3 days ago

  Firefox Desktop 151 Adds `Web Serial API` Support

  60radar

  Web Serial APIBrowser API — direct serial device access from JavaScript

  Hardware-connected web apps get less Chrome-only. Web Serial API can remove native bridge apps for microcontrollers, 3D printers, and meters; useful for small browser-first tools.

  • —Desktop support starts with Firefox 151; web apps can talk to compatible serial devices without native software.
  • —Web Serial API lets JavaScript read and write serial data, covering microcontrollers, 3D printers, power meters, and similar hardware.
  • —This lowers the friction for browser-based device dashboards, setup tools, and diagnostics, though mobile/browser coverage still needs checking.

  Source: news.hada.io/topic?id=29761Read original →
• #0002

  #0002OtherGeekNews3 days ago

  `Utilyze` Measures How Efficiently GPUs Do Useful Work

  40radar

  UtilyzeGPU monitoring tool — shows real usage via performance counters

  Standard GPU monitors can report 100% usage even when only a small slice of hardware is doing real work. This is a niche but handy debugging tool for local inference or media workloads.

  • —nvidia-smi and nvtop mainly show whether kernels are running, so utilization can look saturated while real hardware use stays low.
  • —Utilyze reads GPU performance counters directly and shows live resource usage. Bottleneck diagnosis gets more concrete than a single utilization percent.
  • —Best fit is local LLM, image, video, or CUDA experiments where GPU cost and runtime matter. General web app work can ignore it.

  Source: news.hada.io/topic?id=29749Read original →
• #0003

  #0003Otherr/LocalLLaMA4 days ago

  `ik_llama.cpp` pushes `Qwen3.6 35B A3B` near 110 tok/s on 12GB VRAM

  40radar

  ik_llama.cppllama.cpp fork — optimized CPU offload and quantization

  MTP plus CPU offload can make a local MoE model feel interactive on consumer hardware. Useful for private coding or batch jobs, but still a setup-specific benchmark.

  • —Same IQ4_XS quant averaged 89.76 tok/s on regular llama.cpp; ik_llama.cpp samples reached roughly 105-110 tok/s.
  • —Hardware was RTX 4070 Super 12GB, Ryzen 7 9700X, and 48GB DDR5. CPU offload quality matters as much as VRAM.
  • —Benchmark used --ctx-size 131072, q8 KV cache, and draft-mtp; long-context local workflows remain memory-sensitive.
  • —Treat it as a tuning lead, not a buying guide. Kernel, quant, and fork versions can swing results hard.

  Source: www.reddit.com/r/LocalLLaMA/comments/1tjh7az/110_toks_wiRead original →