Six_Volts

@six-volts.bsky.social

Tech guy into Prototyping Tech (3D-printing, Lasers), Cars/EVs, and Open-source AI https://github.com/sixvolts https://huggingface.co/SixVolts

I'm working on ewaste editions of some other models, where the quants are designed to not need fancy math for things like FP4/8, IQ, etc so that Older CPUs and GPUs can run these newer models at (more) reasonable speeds even at smaller quants.

Apparently one of my models/quants on @hf.co exploded over the last 24 hours. It had maybe ~3k downloads, then popped to 11k! You can run a frontier model on old hardware. My quant of GLM-5.2 "ewaste edition" works well on machines where it runs only on DRAM, no GPUs. huggingface.co/SixVolts/GLM...

SixVolts/GLM-5.2-ewaste-edition-GGUF · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co