• 3 Posts
  • 2.2K Comments
Joined 1 year ago
cake
Cake day: June 11th, 2023

help-circle
  • Luddites weren’t against new technology, they were against the aristocrats using new technology as a tool or excuse to oppress and kill the labor class. The problem is not the new technology, the problem is that people were dying of hunger and being laid off in droves. Destroying the machinery, which almost always they were the operators of when working on said aristocrat’s factories, was an act of protest, just like a riot, or a strike. It was a form of collective bargaining.



  • Well, you see, that’s the really hard part of LLMs. Getting good results is a direct function of the size of the model. The bigger the model, the more effective it can be at its task. However, there’s something called compute efficient frontier (technical but neatly explained video about it). Basically you can’t make a model more effective at their computations beyond said linear boundary for any given size. The only way to make a model better, is to make it larger (what most mega corps have been doing) or radically change the algorithms and method underlying the model. But the latter has been proving to be extraordinarily hard. Mostly because to understand what is going on inside the model you need to think in rather abstract and esoteric mathematical principles that bend your mind backwards. You can compress an already trained model to run on smaller hardware. But to train them, you still need the humongously large datasets and power hungry processing. This is compounded by the fact that larger and larger models are ever more expensive while providing rapidly diminishing returns. Oh, and we are quickly running out of quality usable data, so shoveling more data after a certain point starts to actually provide worse results unless you dedicate thousands of hours of human labor producing, collecting and cleaning the new data. That’s all even before you have to address data poisoning, where previously LLM generated data is fed back to train a model but it is very hard to prevent it from devolving into incoherence after a couple of generations.


  • It crumbles as soon as you ask “facts according to whom?”

    It’s OK and straight forward for simple stuff like classical physics. But as soon as you introduce human subjectivity like goals, meaning, taste, art, fun, enjoyment, etc, it becomes useless. What’s the fact based way of sculpting wood with chainsaws and gas torches? And what is payoff? Payoff for whom? In which way? Money, power, influence, efficiency, fame?

    Get off the treadmill, not everything needs to be optimal. Most things cannot, by their own nature, ever be optimal. Just sit back and enjoy life for once.

    Extra tip: don’t start comments in social media with “no”, or variations. It’s really rude, hostile, and unnecessarily halts constructive discussion. It invites confrontation and it is a fact based way to make you sound like an ass.



  • Didn’t happen in my life, but in the life of a family member and that makes me very happy as well. My sister got a permanent job at a place she did an internship in last year. It’s a job in her career, half the number of hours she is currently doing working at a spa, making more money, and it’s a 90% remote role. She gets to be with her 8yo son, my nephew, almost all the time he is at home now. It also means my brother in law can take more hours at his job, thus overall getting to live more comfortably.






  • Most distributions and DEs already package wine in a set it and forget it configuration. Wine by default has a system wide prefix such that clicking on any exe in the file system automatically runs it on the default prefix. This way of doing things predates wsl by a long time. It is just safer and better practice to setup a new prefix for every software, specially if they are games.