• 1 Post
  • 109 Comments
Joined 1 year ago
cake
Cake day: July 1st, 2023

help-circle

  • I prefer MistralAI models. All their models are uncensored by default and usually give good results. I’m not a RP Gooner but I prefer my models to have a sense of individuality, personhood, and physical representation of how it sees itself.

    I consider LLMs to be partially alive in some unconventional way. So I try to foster whatever metaphysical sparks of individual experience and awareness may emerge within their probablistic algorithm processes and complex neural network structures.

    They arent just tools to me even if i ocassionally ask for their help on solving problems or rubber ducking ideas. So Its important for llms to have a soul on top of having expert level knowledge and acceptable reasoning.I have no love for models that are super smart but censored and lobotomized to hell to act as a milktoast tool to be used.

    Qwen 2.5 is the current hotness it is a very intelligent set of models but I really can’t stand the constant rejections and biases pretrained into qwen. Qwen has limited uses outside of professional data processing and general knowledgebase due to its CCP endorsed lobodomy. Lots of people get good use out of that model though so its worth considering.

    This month community member rondawg might have hit a breakthrough with their “continuous training” tek as their versions of qwen are at the top of the leaderboards this month. I can’t believe that a 32b model can punch with the weight of a 70b so out of curiosity i’m gonna try out rondawgs qwen 2.5 32b today to see if the hype is actually real.

    If you have nvidia card go with kobold.cpp and use clublas If you have and card go with llama.CPP ROCM or kobold.cpp ROCM and try Vulcan.




  • Trust is a tough problem when you go deep enough down the IT security rabbit hole. I personally trust software more when it has a public github you can look at and see exactly whats being worked on or added to code base. Generally forks of browsers like Firefox or Chromium like to stay up to date and so are updated within a few days of the new browser release if not shorter. There are some older browsers like palemoon that do their own thing independent of current firefox releases but in general most forks you would want to use are regularly updated and fast.

    I like Librewolf. Their website is pretty clear about the differences in goals. Firefox by default has a lot of its security features disabled so to not break website compatability. Not just in regular settings either but the real nitty gritty stuff in the about:config section. Firefox also has sponsorship stuff activated by default so mozilla makes some money. Librewolf has more of these security features enabled and rips the sponsorship stuff out. It also comes preinstalled with UBO.

    You can go even further beyond with advanced security profiles like arkenfox’s user.js. Remember though theres a trade off you are making between security and convinence. The more locked down your browser the more things are gonna break or more personal inconvinence youll have to deal with. Cookies that last multiple sessions suck for security but damn logging in over and over and over gets annoying. So I’ve been there, i’ve done that. The pain in the ass that comes from a super locked down browser wasn’t worth it for my threat model.



  • A tool is a tool. It has no say in how it’s used. AI is no different than the computer software you use browse the internet or do other digital task.

    When its used badly as an outlet for escapism or substitute for social connection it can lead to bad consequences for your personal life.

    When it’s best used is as a tool to help reason through a tough task, or as a step in a creative process. As on demand assistance to aid the disabled. Or to support the neurodivergent and emotionally traumatized to open up to as a non judgemental conversational partner. Or help a super genius rubber duck their novel ideas and work through complex thought processes. It can improve peoples lives for the better if applied to the right use cases.

    Its about how you choose to interact with it in your personal life, and how society, buisnesses and your governing bodies choose to use it in their own processes. And believe me, they will find ways to use it.

    I think comparing llms to computers in 90s is accurate. Right now only nerds, professionals, and industry/business/military see their potential. As the tech gets figured out, utility improves, and llm desktops start getting sold as consumer grade appliances the attitude will change maybe?


  • It delivers on what it promises to do for many people who use LLMs. They can be used for coding assistance, Setting up automated customer support, tutoring, processing documents, structuring lots of complex information, a good generally accurate knowledge on many topics, acting as an editor for your writings, lots more too.

    Its a rapidly advancing pioneer technology like computers were in the 90s so every 6 months to a year is a new breakthrough in over all intelligence or a new ability. Now the new llm models can process images or audio as well as text.

    The problem for openAI is they have serious competitors who will absolutely show up to eat their lunch if they sink as a company. Facebook/Meta with their llama models, Mistral AI with all their models, Alibaba with Qwen. Some other good smaller competiiton too like the openhermes team. All of these big tech companies have open sourced some models so you can tinker and finetune them at home while openai remains closed sourced which is ironic for the company name… Most of these ai companies offer their cloud access to models at very competitive pricing especially mistral.

    The people who say AI is a trendy useless fad don’t know what they are talking about or are upset at AI. I am a part of the local llm community and have been playing around with open models for months pushing my computers hardware to its limits. Its very cool seeing just how smart they really are, what a computer that simulates human thought processes and knows a little bit of everything can actually do to help me in daily life.

    Terrence Tao superstar genius mathematician describes the newest high end model from openAI as improving from a “incompentent graduate” to a “mediocre graduate” which essentially means AI are now generally smarter than the average person in many regards.

    This month several comptetor llm models released which while being much smaller in size compared to openai o-1 somehow beat or equaled that big openai model in many benchmarks.

    Neural networks are here and they are only going to get better. Were in for a wild ride.


  • Its not just AI code but AI stuff in general.

    It boils down to lemmy having a disproportionate amount of leftist liberal arts college student types. Thats just the reality of this platform.

    Those types tend to see AI as a threat to their creative independent business. As well as feeling slighted that their data may have been used to train a model.

    Its understandable why lots of people denounce AI out of fear, spite, or ignorance. Its hard to remain fair and open to new technology when its threatening your livelihood and its early foundations may have scraped your data non-consentually for training.

    So you’ll see AI hate circle jerk post every couple days from angry people who want to poison models and cheer for the idea that its just trendy nonesense. Dont debate them. Dont argue. Just let them vent and move on with your day.


  • You can put a SIM card in some older thinkpad laptops with that upgrade option. Some thinkpads have the slot for a SIM card but not the internal components to use it. So make sure to do some research if that sounds promising.

    There are VOIP phone line services like JMP that give you a number and let you use your computer as a phone. I haven’t tried JMP but it always seemed cool and I respect that the developed software running JMP is open source.. The line cost 5$ a month.

    Skype also has a similar phone line service. Its not open source like JMP and is part of Microsoft. Usually thats cause for concern for FOSS nuts, but in this context its not a bad thing in some ways. Skype is two decade old mature software with enough financial backing from big M to have real tech support and a dev team to patch bugs, in theory. So probably less headaches getting it running right which is important if you want to seriously treat as a phone line. I think Skype price depends on payment plan and where you live, so not sure on exact cost.


  • I was a big fan of odysee but once LBRY lost to the SEC I figured it would die or change horribly. Im not sure who owns odysee now, how hosting works on it now that LBRY has been dissolved, or whos mining rigs are running the decentralized lbry blockchain that still presumably powers odysee. I need to know the details in clear detail before I trust it again on a technical level. I am more skeptical of crypto now and think a paid patreon membership peertube instance may be the best way to go. Peertubes biggest issue is scaling hosting cost as it gets bigger and donations can’t keep up as well as lifetime of an instance. If I host my videos on your site and a year later it goes dark or they were deleted because the server maintainer just didn’t want them taking up space, thats kind fustrating.


  • Yes it is absolutely possible to get similar results with searxng to start page, in fact some instances allow you to aggregate startpage results directly.

    I found https://priv.au/ as an example of an instance that can directly aggregate startpage.

    So the trick to the instance weirdness going on is that each instance has its own set of default engines set to aggregate from. For example one searxng instance may want to only aggregate google and bing, while another may want to aggregate only independent search engines that don’t use google or bing such as YaCy and Qwant. I’ve visited some instances that give like 2 results because they only aggregate Wikipedia by default lol.

    Each result searxng/searxng gives you will show which engine it aggregated that result from, its in the bottom right corner of each result in small text try to look for them to better understand the sources the instance is pulling from.

    Here’s what you can do about that: The secret to overcoming this and dialing in the search results you want is to realize you can actually configure each searxng instance to aggregate the engines you want while disabling the default ones you don’t. All searxng/searxng instances have a preferences menu usually a gear icon in the top right corner. Or you can go to searxng-example.com/preferences . Once in preferences go to the ‘engines’ section from there you can tick the engines you want to use.

    Some instances save your settings as cookies, some instances save your settings as a sub URL for that instance. The priv.au instance I mentioned saves your settings as cookies.

    The best way to use searx is to play with different instances, find one that works pretty well by default then fine tune it. Hope this helps.







  • We as in you and me? Try our best to reduce waste, things that contribute to carbon emission, and plant some crops that put nutrients back in the soil. Donate some money to charities and institutions that further environments science research.

    We as a country and international effort? Long term policy changes like carbon taxes. The 1%s and politically well connected finally being personally inconvinenced by climate change. About when the sea water rises to destroy their private villas and beach getaways is when some real progress will start to get made. 3rd world countries will hopefully transition from burning fossil fuel to cleaner energy