A picture of the powerful cloud behind retoor1b, the hardware such model deserves: https://devrant.molodetz.nl/2024112...

It's blazing fast atm though: https://llm.molodetz.nl. It's just the base model.

Remote uploading of pictures isn't that bad tbh, now it's easy to share multiple and high quality. It won't be down as much as the LLM. This service runs on the VPS itself. Uploading is bit slow, don't know why. Probably buffer size related why using async to write the file to the disk. Disk is SSD, that's not it. LLM's run on different servers.

That stack of notebooks is awesome! 😂

@Lensflare 2*2.4Ghz 8Gb and 1*4.2Ghz 16Gb. It looks funny, but thanks to their wifi internet connection trough a phone and still well performing batteries in the laptop, I kinda have a robuust fail safe for when electricity is down. It will just continue running. I can even work a few hours if electricity is gone! :) Imagine how much such UPS's normally cost.

I'm quite happy with the setup tbh. Sadly, the new laptop doesn't have a good video card and the 4.2Ghz processor doesn't perform much better than the 2.4Ghz processors. It seems that a decent GPU is very important and CPU not that much while they're configured to use the CPU. I thought that the memory would be the main issue because with 8Gb you can barely run any model. But the current one on https://llm.molodetz.net is just a 136MB model! It can answer programming questions in several languages tho! And it knows how to change language on a iPhone! How is it possible to know so much? That reminds me about how much a MB is.

@retoor do you often have power outages where you live?

@Lensflare does a datacenter have? Nope. But it wouldn't have been a surprise. I live in a park with chalets. It wouldn't have surprised me. But this park is top notch. 4.5 stars rating by people who go on vacation here. Some people pay thousand a week to stay in a chalet like mine. Crazy. But still, for me it isn't cheap either. There's just a lack on housing and lost my house during inconvenient period. But i'm very happy here. I live alone and it's perfectly sized and very cozy. The government should build a bunch of these parks. They just don't do anything about the housing crisis. It's a freaking crisis, so everything should be allowed right? If you don't even want to build a few parks to fix it, how hypocrite are you. Back in dem days, we raised a whole province (flevoland) out of the water and build two major cities out of it. We just don't have such hard working people anymore or smth. Our current leaders are lame. Status quo suckers.