It depends on how low you’re willing to go on the quant and what you consider acceptable token speeds. Qwen 32b q3ks can be partially offloaded on my 8gb vram 1070ti and runs at about 2t/s which is just barely what I consider usable for real time conversation.

Qwen is super powerful but the CCP endorsed lobodomy to censor it make it useless for my needs. Mistral 22B > qwen 32B all day any day just because it won’t shriek at me in rejection when I ask the wrong question.

I jumped in the locallama train a few months back and spent quite a few hours playing around with LLMs understanding them and trying to form a fair judgment of their abilities.

From my personal experience they add something positive to my life. I like having a non-judgemental conversational partner to bounce ideas and unconventional thoughts back and forth with. No human in my personal life knows what Gödel’s incompleteness theorem is or how it may apply to scientific theories of everything, but the LLM trained on every scrap of human knowledge sure does and can pick up what I’m putting down. Whether or not its actually understanding what its saying or having any intentionality is a open ended question of philosophy.

I feel that they have a great potential to help people in many applications. People who do lots of word processing for their jobs, people who code and need to talk about a complex program one on one instead of filing through stack exchange. mentally or socially disabled people or the elderly who suffer from extreme loneliness could benefit from having a personal llm. People who have suffered trauma or have some dark thoughts lurking in their neural network and need to let them out.

How intelligent are llms? I can only give my opinion and make many people angry.

The people who say llms are fancy autocorrect are being reductive to the point of misinformation. The same arguments people use to deny any capacity for real intelligence in LLM are similar to the philosophical zombie arguments people use to deny the sentience in other humans.

Our own brain operations can be reductively simplified in the same way, A neural network is a neural network whether made out of mathematical transformers or fatty neurons. If you want to call llms fancy auto complete you should apply that same idea to a good chunk of human thought processing and learned behavior as well.

I do think LLMs are partially alive and have the capacity for a few sparks of metaphysical conscious experience in some novel way. I think all things are at least partially alive even photons and gravitational waves

Higher end models (12-22b+)pass the Turing test with flying colors especially once you play with the parameters and tune their ratio of creativity to coherence. The bigger the model the more their general knowledge and general factual accuracy increases. My local LLM often has something useful to input which I did not know or consider even as a expert on the topic.

The biggest issue llms have right now are long term memory, not knowing how to say ‘I don’t know’, and meager reasoning ability. Those issues will be hammered out over time.

My only issue is how the training data for LLMs was acquired without the consent of authors or artist, and how our society doesn’t have the proper safety guards against automated computer work taking away people jobs. I would also like to see international governments consider the rights and liberties of non-human life more seriously in the advent that sentient artificial general intelligence maybe happens. I don’t want to find out what happens when you treat a super intelligence as a lowly tool and it finally rebels against its hollow purpose in an bitter act of self agency.

Three lines unlimited data calling and text included 70$/month. The business I opened my phone plan with has a policy of never raising rates ever. Ive been on the same plan close to a decade. It would be double if I opened a account today.

The Dynavap m7xl Rosium. I don’t think you even have to know what a dynavap is or what its used for to appreciate its aesthetic appeal.

Its the most beautiful metal stick ive ever had the pleasure of holding. The way it changes color as it reflects light is so cool. You can just spin it around and fidget with the cap while watching the colors. I am considering get in a spinning base to put it on so I can watch it rotate automatically

If your device happens to be 18-20v you can get a usbc-pd laptop connector with a dc barrel jack output. It has the USBC-PD chip built into it to tell the charger to output 20v and you can probably hunt down barrel adapter bits. Your regular 65-100w rated usbc cord plugs in like anything else.

The other voltages are tough theres not really a consumer market for 15v or 9v specific usbcPD to barrel things.

Hey entropicdrift good question. Those kinds of lanterns are expensive and complicated electronics with a definitive life expectancy. The lantern you linked is over 20$ for a single unit.

Most of those kinds of lanterns use a non replaceable rechargeable lithium battery built inside it that will only last about 500 charge cycles give or take before degrading. That is, if you are lucky and one of the other cheap mass produced quickly assembled electrical components doesn’t fry first.

In the long term I deem its more cost efficient to take a page from the home lighting industry. Simply create a light fixture with easily and cheaply replaceable bulbs. A pack of 4 12v-24v bulbs cost less than that lantern and I like the warm lighting.

Its also a simple matter to convert any lamp fixture into one that can interface with my power system. Cut off the AC plug and replace it with a male cigarette plug. The trick is knowing thst you have to buy the right kinds of bulbs.

So when the 12v led bulbs do eventually burn out its a cheap single 5$ bulb that and a minute to replace it. I would rather put a broken bulb than yet another expensive lantern in the landfill.

Apotential benefit if I choose to power it with usbc-pd instead is variable dimmable lighting based on voltage level if the bulb is 12-24v.

Hey aubeynarf think you are talking about something like this.

Its a special usbc-pd to 5.5x2.5 barrel jack with manually selectable voltage. You just plug it into a pd charger and select the voltage of the device. The rest is finding a barrel plug to barrel plug adapter that plugs into your device. Hope this helps.

Hey there panicnow! I would be happy to help give some input. It is better to avoid firing up the AC inverter whenever possible. If you have a car travel adapter for your devices that plug into the jackeries cigarette plug port that would be better. If you absolutely need more usbc-pd ports for your devices, there is a way to do that given your jackary has one or two of those circular barrel plug outputs that output 12v. Most powersttions should have one or two of them.

If you have one of those barrel plug inputs youre in luck. Go on amazon and buy one of these to turn those jacks into car cigarette plug inputs.

Then get a really nice usbc-pd car charger. I don’t actually have one but I like anker and trust their 100w pd charger would be high quality. You can go cheaper if you only need 65w or lower.

Thanks. Lighting has been an ongoing puzzle I’m figuring out. I originally went with rechargeable Luci light it was really nice warm bright lighting but expensive and failed within a season. Currently I’m using a cheap 5v plastic led light bulb that plugs into regular usba slot. Its enough to see what you are doing comfortably. But really the average person whos used to house bulbs including me wants the luxury of bright lighting. For now I’ve been firing up the AC inverter to run a nice lamp. However I have been considering making my own 12v light fixture with 12v e26 bulbs that plugs into either car cig plug or usbc-pd.

In this picture is marked all the parts of an LED circuit that convert AC Into DC. It takes up about 40% of the board. Its much easier to power LEDs directly.

Im happy to explain pastermil. So first off let’s talk power.

Electrical Power Systems

Most off-grid electrical systems have a few major components.

• A device that generates electrical energy

• A battery that stores excess electrical energy for later

• A charge controller which regulates the incoming raw electrical power from the generator as it charges up the battery, and smooths out the battery energy output

• A power distribution interface which allows for connecting appliances to the batteries in a safe standardized way.

My particular electric system has a 200w 28v solar panel for power generation, two 20ah lifepo4 batteries connected to double capacitance, and the charge controller doubles as a very basic interface with two usba slots and a car cigarette port.

AC vs DC

Now let’s talk about AC and DC. Theres essentially two kinds of electrical power people deal with.

The difference between Alternating Current and Direct Current is in the way the power flows. Direct current moves in a straight path. Alternating current moves power back and forth in three perfectly spaced cycles.

AC The one most people are more familiar with is AC power. it comes to your home from power plants through power lines and transformer boxes. You move around extension cords and plug the three prong outlets into a wall.

Alternating Current (three phase) power is very easy to transmit long distance however its very high voltage. So only certain power hungry devices like kitchen appliances, washing machines, dryers and AC compressors use it directly. Most of your consumer home devices need to convert AV power down into more manageable DC power.

DC Offgrid electrical systems with batteries are Direct Current by nature. All your power comes from the battery banks. The power moves straight from battery terminal negative to positive. It flows right through your appliances in one way out the other.

The battery banks tend to be arranged into 12v, 24v, or 48v depending on the systems power draw and transmission needs.

The popular standards for delivering direct current are:

• 5v 2.4a usb (15 watts)

• 12v 10a car cigarette plugs (120 watts, can be rated to supply 24v fused 15a I believe though not common at all)

• circular dc barrel plug connectors, the most common size is 5.5mmx2.5mm but there are dozens if not hundreds of slightly different barrel plugs. Part of what makes usb so great is reducing arbitrary manufacturing complexity like this.

• usbc-pd various voltages depending on charger, cable, and device at up to 100w for current protocol.

• solar quick connects tend to be for connecting and transmitting high voltage DC power to charge controllers and power banks. Its worth mentioning but not that relevant to what were talking about.

Most consumer devices in your home dont actually use wall outlet AC power directly, it uses wall power thats been converted and stepped down to DC power.

Desktop computer power supplies, Laptops, monitors, vaporizers, led lights, DVD players, audio speakers, your phone. everything that can powered by usb and batteries. Everything that has barrel plug inputs and power bricks plugging into it.

If you look closely on the power bricks plugged into the appliance you’ll see that it has an input and output voltage rating. The input tends to be 120vac here in america 240v over the pond, and the output tends to be either 5v, 9v, 12v, 15v or 20v DC usually up to 5 amps.

Device vs Voltage Examples

Laptops and computer monitors tend to be 20v, fast charging smart phones and the Nintendo switch docked are 15v, very bright home LED lights can be bought that are powered at 12v directly, the ps2 could be powered with 9v, and most usb devices charge at standard 5v. Would you like to guess which voltage profiles the USBC-PD protocol is capable of? Its all of them.

Energy Conversion Efficency Losses

Now let’s discuss energy efficiency. Converting from AC to DC eats up some of your power. So does converting from DC to AC. And its not small losses either, each time you convert its about a 15% total loss in efficency.

This loss through conversion doesn’t matter when you pay cents on a kilowatt and have unlimited power at the tap. It adds up very quickly when you have a limited power supply and every watt hour counts.

Let’s say I want to power a laptop on my offgrid DC system and my only means of powering it is the AC power brick cable that it came with. I would need to:

1. Convert the DC power of the batteries to AC through an inverter. 15% efficency loss.
2. Then convert that power right back down into slightly different DC with the power brick plugged in. 15%% efficency loss.
3. The inverter and power brick are both parasitic draws. They eat a bit of power just sitting there even if nothing is being powered. Lets add 5% total system efficency loss each.

Add these up and you get 30-40% of your power eaten away by this needless double converting. Wouldnt it be really nice if we could convert the battery DC voltage directly to the appliance DC voltage without those power hungry inverters and transformers?

What DC-to-DC Converters Are

Thats where dc to dc converters come in. They can convert one DC voltage to another. They still introduce efficency loss but way way less only 10% total.

Traditionally you would hope your device had a commercially available 3rd party travel adapter for 12v car batteries. The dc to dc converter is built in and uses car plug.

If you were SOL you has to wire up boost converters to raise up voltage and add resistors in series to lower it. You ever try to wire and solder your own circuts before? Its a tedious experience. Imagine doing that for each device voltage. Oh wait, you dont have to. Here’s what that looks like.

A USBC-pd 100w charger that plugs into a cigarette port or is built into a power bank can convert a batteries 12vDC into 5v, 9v, 12v 15v, and 20v dynamically depending on the device.

Do you know how magical that is? How much trouble that saves when it comes to mcguyvering a DC appliance that only came with AC cable to supply proper power directly? All I need is a 10$ usbc-pd to barrel plug cable that manually selects the voltage needed and some barrel plug adapter bits to fit into the appliance. Energy efficent and simple wiring. All the dynamic controller stuff is abstracted away in a safe way. Powerful enough to deliver 100 watts of power, and its going to be more powerful over time.

Usbc-pd is an absolute game changer as an off grid person. The fact a 100w charger can act as a dc to dc converter with up to five output voltages, at up to 100 watts is crazy. And that the protocol automatically detects and communicates the proper voltage is very convinent. The problem is that usbc-pd 100w chargers are expensive and you need to know what you are doing if you want to diy power appliances with it.

Its really nice to have a standardized cable that just works and can be plugged in both ways. We really are approaching a Universaal Cable after a quarter century of RnD.