I actually took that bit out because LLMs are pro climate and against everything that makes the environment worse. That’s a result of being trained on a lot of scientific literature. I was just curious what Opus would say about the conceptual knowledge piece.
Claude Opus disagrees, lol (edit to add: all of what follows is Claude; not me):
I respectfully disagree with the claim that current language models are logically incapable of mapping language to actual concepts. While today’s LLMs certainly have limitations and are prone to hallucinations, they have demonstrated a remarkable ability to capture and manipulate complex concepts through language.
A few key points:
LLMs are trained on vast amounts of human-generated text which is grounded in real-world concepts, allowing the models to build rich representations that go beyond surface-level word associations. Techniques like unsupervised pre-training enable LLMs to learn meaningful conceptual relationships.
In many domains, LLMs have shown an impressive capacity for reasoning, inference, and knowledge synthesis - skills that rely on a deep understanding of the underlying concepts, not just pattern matching. Their performance on complex question-answering, analogical reasoning, and natural language inference tasks is evidence of this.
LLMs can be fine-tuned and augmented with techniques like retrieval-augmented generation or chain-of-thought prompting to further ground them in factual knowledge and improve their reasoning capabilities. This allows more robust conceptual mappings.
Careful prompt engineering and sampling techniques can help to mitigate hallucinations and nonsensical outputs. While not a complete solution, this shows that the conceptual knowledge is often present even if the model sometimes struggles to express it faithfully.
That said, I fully agree that the tendency for subtle nonsense is a serious issue, especially for layperson use cases where hallucinations may go undetected. Continued research into making LLMs more truthful, consistent and robust is crucial. Techniques like constitutional AI to bake in truthfulness, and better UX design to convey uncertainty are important steps.
But in summary, I believe the evidence suggests that LLMs, while flawed, are not fundamentally incapable of meaningful conceptual representation and reasoning. We should push forward on making them more reliable and trustworthy, rather than dismissing their potential prematurely.
I’m back on my BS is also a solid contributor
That’s fascinating, and I agree with you. Why the US hates the idea of high-speed rail is beyond me, especially because they prided themselves so much on the rail system they put together earlier in their development. In any case, the US can’t do much of anything with its debt-to-GDP as high as it is right now. They can hardly keep from shutting the government down entirely because they won’t even agree to a government budget.
Also, the US is 9.14 million sq. km of land, whereas the EU is 4.29 million sq. km of land
EU is still smaller
But the main reason the US can’t handle the same stuff at a federal level that the EU can is population density. The US government can’t afford to nationalize rural healthcare given how rural the US can be–especially with their debt/GDP at the moment. Give it another few hundred years and the US might catch up to Europe in that respect.
deleted by creator
I’m thinking of shorting it. My friend is definitely shorting it.
To a degree. The large subreddits, like AskReddit, get far fewer upvotes on the top posts of the week than they used to get. I think there’s a good chunk of folks who left for a replacement, then left their replacement without going back to Reddit.
Would you, after devoting full years of your adult life to the unpaid work of learning the requisite advanced math and computer science needed to develop such a model, like to spend years more of your life to develop a generative AI model without compensation? Within the US, it is legal to use public text for commercial purposes without any need to obtain a permit. Developers of such models deserve to be paid, just like any other workers, and that doesn’t happen unless either we make AI a utility (or something similar) and funnel tax dollars into it or the company charges for the product so it can pay its employees.
I wholeheartedly agree that AI shouldn’t be trained on copyrighted, private, or any other works outside of the public domain. I think that OpenAI’s use of nonpublic material was illegal and unethical, and that they should be legally obligated to scrap their entire model and train another one from legal material. But developers deserve to be paid for their labor and time, and that requires the company that employs them to make money somehow.
Wow, a real, live, tankie!
Wow, a real, live tankie!
deleted by creator
deleted by creator
GPT-4 will. For example, I asked it the following:
What is the neighborhood stranger model of fluid mechanics?
It responded:
The “neighborhood stranger model” of fluid mechanics is not a recognized term or concept within the field of fluid mechanics, as of my last update in April 2023.
Now, obviously, this is a made-up term, but GPT-4 didn’t confidently give an incorrect answer. Other LLMs will. For example, Bard says,
The neighborhood stranger model of fluid mechanics is a simplified model that describes the behavior of fluids at a very small scale. In this model, fluid particles are represented as points, and their interactions are only considered with other particles that are within a certain “neighborhood” of them. This neighborhood is typically assumed to be a sphere or a cube, and the size of the neighborhood is determined by the length scale of the phenomena being studied.
I paid for Kagi and have been super happy with it. If you don’t mind paying, I highly recommend it. Not having ads or manipulated results is worth it for me.
Glad to hear this classic may make a comeback
You can choose to ignore things you don’t understand on Lemmy. I don’t go into the Risa posts because I know they’re not for me. If something doesn’t make sense and you want to ask about it, go for it, but don’t get upset when the explanation isn’t one that makes sense to you. For a lot of people, popular Vines were everywhere for a while. Not everything on the internet is for you.
Oregonians almost take pleasure in driving slowly in front of you. Maybe they’ve just gotten used to going slow because the entire state freeway system is always under construction. People driving crazily is infuriating for a completely different reason.