1·
6 months agocontext size default of 4096, replies are like 16 tokens or so.
- 3 Posts
- 3 Comments
Joined 2 years ago
Cake day: June 19th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
My first test was with Starcannon-Unleashed-12B-v1.0-f16, a 23Gbyte model. I did not expect that laptop to be usable at all.
thanks for the tips!