SomeOddCodeGuy's Ramblings
  • Home
  • GitHub
  • WilmerAI
Sign in Subscribe

Latest

Redownloading All The Old Models

So the new gguf format looks cool in that it supposedly automatically calculates the rope-freq for you. However, I do actually have data caps on my internet so I really want to try my hand at converting my existing ggmls. It looks like you can do it a llama.

By SomeOddCodeGuy 30 Aug 2023

If You Buy A Mac for LLMs, Don't Skimp on RAM

The Macbook M1 Pro 16GB is an alright machine for using smaller AI models, but I'm really feeling the pressure on the RAM side. This thing can allot 10.7GB of its unified RAM as VRAM, which is fine for the smaller models like gpt4all-j-v1.3-

By SomeOddCodeGuy 08 Jul 2023
See all
SomeOddCodeGuy's Ramblings

SomeOddCodeGuy's Ramblings

The thoughts of some random dev tinkering with AI

SomeOddCodeGuy's Ramblings

The thoughts of some random dev tinkering with AI

SomeOddCodeGuy's Ramblings
  • Sign up
Powered by Ghost