ovg-project
Output is corrupted after around 2000 tokens
With the provided docker image and Qwen3-30B-AWQ
The generations starts off OK, but some time afterwards, it breaks down (prompt: tell me about the solar system in great detail):
- Magnetic Field: Off-center and tilted (similar to a "tilted top").
- Rings: Faint, dark rings made of icy particles and dust.
- Moons: 27 confirmed; largest: Titania, Oberon, Umbriel, Ariel, Miranda.
- Miranda: Highly fractured surface due to tidal forces.
- Axial Tilt: 98° — Uranus is tilted.
**→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→→ the model/generation works fine with stock vLLM without the kvcached.
This is running on a 3090.
It breaks down around 2000 tokens in. Full output below:
Certainly! The **Solar System** is a vast and intricate collection of celestial bodies bound together by gravity, centered around our Sun. It is a dynamic and evolving system that has fascinated humans for millennia. Below is a comprehensive, detailed exploration of the Solar System—its formation, components, and key characteristics.
---
### 🌞 1. **The Sun: The Heart of the Solar System**
The **Sun** is the central star of the Solar System and accounts for **99.86% of its total mass**. It is a **G-type main-sequence star (G2V)**, meaning it fuses hydrogen into helium in its core via nuclear fusion.
#### Key Characteristics:
- **Mass:** ≈ 1.989 × 10³⁰ kg
- **Diameter:** ≈ 1.39 million km (about 109 Earths across)
- **Surface Temperature:** ~5,500°C (9,932°F)
- **Core Temperature:** ~15 million°C
- **Age:** ~4.6 billion years
- **Lifespan:** Estimated to remain stable for another 5 billion years before evolving into a red giant.
#### Structure of the Sun:
1. **Core:** Where nuclear fusion occurs (4 million tons of mass converted to energy per second).
2. **Radiative Zone:** Energy travels outward via radiation.
3. **Convective Zone:** Heat is carried by convection currents.
4. **Photosphere:** The visible "surface" of the Sun; temperature ~5,500°C.
5. **Chromosphere:** A layer above the photosphere with higher temperatures (~10,000°C).
6. **Corona:** The Sun’s outer atmosphere, reaching temperatures of over 1 million°C—still a mystery to scientists.
7. **Solar Wind:** A stream of charged particles (plasma) that emanates from the corona and fills the heliosphere.
#### Solar Activity:
- **Sunspots:** Cooler, dark regions on the photosphere caused by intense magnetic activity; follow an 11-year cycle.
- **Solar Flares:** Sudden bursts of radiation from the Sun’s surface.
- **Coronal Mass Ejections (CMEs):** Massive eruptions of plasma and magnetic field into space, capable of disrupting satellites and power grids on Earth.
---
### 🌍 2. **The Eight Planets (in order from the Sun)**
The Solar System has **eight officially recognized planets**, divided into two main groups:
#### 🌌 **Terrestrial (Rocky) Planets (Inner Planets):**
Close to the Sun, small, dense, and rocky with solid surfaces.
---
##### **1. Mercury (☿)**
- **Distance from Sun:** 57.9 million km (0.39 AU)
- **Diameter:** 4,880 km (smallest planet)
- **Orbital Period:** 88 Earth days
- **Rotation Period:** 59 Earth days (tidally locked in 3:2 resonance)
- **Atmosphere:** Extremely thin, composed of oxygen, sodium, hydrogen, helium, and potassium—no significant weather.
- **Surface:** Heavily cratered, resembling the Moon. Features **calderas** and **radial grooves**.
- **Temperature Extremes:** -173°C at night to +427°C during day (no atmosphere to retain heat).
- **Key Features:** Has a large iron core (~85% of its radius); no moons.
---
##### **2. Venus (♀)**
- **Distance from Sun:** 108.2 million km (0.72 AU)
- **Diameter:** 12,104 km (similar to Earth)
- **Orbital Period:** 225 Earth days
- **Rotation Period:** 243 Earth days (retrograde rotation—spins backward)
- **Atmosphere:** Thick, toxic atmosphere of CO₂ (96.5%) with clouds of sulfuric acid; surface pressure is 92 times Earth’s.
- **Surface Temperature:** ~464°C (hotter than Mercury due to runaway greenhouse effect).
- **Surface:** Volcanic plains, highlands, and vast lava flows; over 1,000 volcanoes.
- **Key Features:** No moons; seen as the "morning star" or "evening star."
---
##### **3. Earth (🜨)**
- **Distance from Sun:** 149.6 million km (1 AU)
- **Diameter:** 12,756 km
- **Orbital Period:** 365.25 days
- **Rotation Period:** 23h 56m 4s (1 sidereal day)
- **Atmosphere:** 78% N₂, 21% O₂, 1% other gases.
- **Surface:** 71% water; diverse geology (mountains, valleys, oceans).
- **Moon:** One natural satellite, the Moon—critical for tides and stabilizing Earth’s axial tilt.
- **Unique Features:** Only known planet with life, liquid water, plate tectonics, and a strong magnetic field generated by its molten outer core.
---
##### **4. Mars (♂)**
- **Distance from Sun:** 227.9 million km (1.52 AU)
- **Diameter:** 6,779 km
- **Orbital Period:** 687 Earth days
- **Rotation Period:** 24h 37m (similar to Earth)
- **Atmosphere:** Thin, 95% CO₂, with traces of nitrogen and argon; surface pressure ~1% of Earth’s.
- **Surface:** Reddish due to iron oxide (rust); features include Olympus Mons (largest volcano in the solar system), Valles Marineris (gigantic canyon), and polar ice caps (frozen CO₂ and water ice).
- **Temperature:** -125°C to +20°C.
- **Moons:** Two small, irregularly shaped moons—**Phobos** and **Deimos** (likely captured asteroids).
- **Exploration:** Robotic missions (Spirit, Opportunity, Curiosity, Perseverance) have searched for signs of past life and studied climate.
---
#### 🌌 **Jovian (Gas Giant) Planets (Outer Planets):**
Far from the Sun, large, low-density planets composed mostly of hydrogen and helium.
---
##### **5. Jupiter (♃)**
- **Distance from Sun:** 778.5 million km (5.2 AU)
- **Diameter:** 139,820 km (largest planet—11 times Earth's diameter)
- **Mass:** 2.5 × Earth’s mass (more than all other planets combined)
- **Orbital Period:** 11.9 Earth years
- **Rotation Period:** 9h 55m (fastest rotation in the system)
- **Atmosphere:** Hydrogen (90%), helium (10%); storm systems like the **Great Red Spot** (a persistent anticyclonic storm larger than Earth).
- **Moons:** Over 95 known moons (as of 2024), including:
- **Ganymede:** Largest moon in the Solar System (larger than Mercury).
- **Callisto, Io, Europa:** All of interest for astrobiology (especially Europa’s subsurface ocean).
- **Magnetic Field:** Strongest in the Solar System—14 times stronger than Earth’s.
- **Rings:** Faint, dusty ring system (discovered by Voyager 1).
- **Interior:** Likely has a rocky core surrounded by metallic hydrogen.
---
##### **6. Saturn (♄)**
- **Distance from Sun:** 1.43 billion km (9.5 AU)
- **Diameter:** 116,460 km
- **Mass:** 95 times Earth’s mass
- **Orbital Period:** 29.5 Earth years
- **Rotation Period:** 10h 33m
- **Rings:** Most prominent and complex ring system in the Solar System—composed of ice, dust, and rock particles. Rings span 280,000 km but are only ~10 meters thick.
- **Atmosphere:** Hydrogen (96%), helium (3%); storms and hexagonal cloud patterns at the north pole.
- **Moons:** Over 140 known moons; key ones:
- **Titan:** Largest moon of Saturn; has a thick nitrogen-rich atmosphere and lakes of liquid methane and ethane—only other place in the Solar System with stable surface liquids besides Earth.
- **Enceladus:** Geysers of water ice erupt from its south pole—suggesting a subsurface ocean; potential for life.
- **Low Density:** Less dense than water—would float if placed in a bathtub.
---
##### **7. Uranus (⛢)**
- **Distance from Sun:** 2.87 billion km (19.2 AU)
- **Diameter:** 50,724 km
- **Mass:** 14.5 times Earth’s
- **Orbital Period:** 84 Earth years
- **Rotation Period:** 17h 14m
- **Axial Tilt:** 98°—rotates on its axis—**** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** **
(repeats)
Hi @cduk Thanks for reporting this problem. Let us dig in more. Stay tuned!
Hi @cduk ,thanks for using KVCached. I tried to reproduce this issue by running QuixiAI/Qwen3-30B-A3B-AWQ with vLLM, both with and without KVCached. I found that in both cases, the model occasionally generated unexpected results (getting stuck in a loop). This instability appears to be specific to the AWQ model. When I switched to the full-precision version (Qwen/Qwen3-30B-A3B), the output was stable and produced valid results across multiple runs.
Could you please confirm the exact model you're using? Alternatively, could you try again with a similar model to see if the issue persists at your side? Happy to help if you have any questions~
Hi. It was either: cpatonn/Qwen3-30B-A3B-Instruct-2507-AWQ or cognitivecomputations/Qwen3-30B-A3B-AWQ
I will test both and report back.
Hi @cduk , thanks for sharing. I will also try with your models and keep you posted.