METAL for iPhone

Read AI news in the METAL app.

Download METAL and discover fresh AI stories every day.

Download on the App Store

For iPhone · Free download

Search for METAL AI Magazine in the App Store on your iPhone.

METAL

DeepSeek-V4-Flash-0731 reported to stall during long-context tasks

Generation halts past 100K tokens when run locally with OpenCode; resuming with a command restores work

DeepSeek-V4-Flash-0731 reported to stall during long-context tasks

Image: METAL

Summary

  • A Reddit user reported that DeepSeek-V4-Flash-0731 stalls during generation at 100K+ token contexts when run in a local environment
  • The user said typing a 'resume' command in OpenCode causes the model to continue working normally
  • It remains unclear whether the cause lies in the model itself or in the inference engine or OpenCode

Reports of sudden stalls during long tasks

A Reddit user shared an experience running DeepSeek-V4-Flash-0731 locally in r/LocalLLaMA. Using the Q8_K_XL GGUF version distributed by Unsloth Studio in conjunction with OpenCode for long agentic coding sessions, the user said that once the context exceeded roughly 100,000 tokens, the model would stop generating mid-task without any error message.

The poster said the issue doesn't occur every time but has been observed repeatedly. The pattern described was: "context reaches 100K+ tokens → generation halts → type resume → work resumes normally → context grows again → halts again."

Cause still unclear

The poster said, "Since typing the resume command gets it working immediately, it doesn't seem like the model is fully frozen or has crashed." However, they said they could not pinpoint whether the issue originates from the model itself, the inference engine such as llama.cpp, the context handling method, prompt caching, tool calls, or OpenCode itself. They also noted that their setup runs OpenCode directly on a server via a tmux session.

This case remains an individual report at the community level for now, with no official confirmation from DeepSeek or Unsloth. Whether other users have experienced the same symptom requires further verification.

Comments