Nah, I wouldn’t give up on these so easily. They still have applications and advantages over transformers, e.g., efficiency, where the quality might suffice for the reduced time/space conplexity (Vanilla transformer still has O(n^2), and I have yet to find an efficient and qualitatively similar causal transformer.)
But regarding sequence modeling / reasoning about sequences ability, attention models are the hot shit and currently transformers excel on that.
Good that you say “AI with ChatGPT” as this extremely blurs what the public understands. ChatGPT is an LLM (an autoregressive generative transformer model scaled to billions of parameters). LLMs are part of of AI. But they are not the entire field of AI. AI has so incredibly many more methods, models and algorithms than just LLMs. In fact, LLMs represent just a tiny fraction of the entire field. It’s infuriating how many people confuse those. It’s like saying a specific book is all of the literature that exists.
I feel like humanity is stupid. Over and over again we develop new technologies, make breakthroughs, and instead of calmly evaluating them, making sure they’re safe, we just jump blindly on the bandwagon and adopt it for everything, everywhere. Just like with asbestos, plastics and now LLMs.
Fucking idiots.
I’m nitpicky about the word “believe”. So let me rephrase: I do not believe. Either I know, or I don’t know. Everything else are more or less informed speculations, assumptions or hypotheses at best.
They don’t seem to have heard of weather reports.
Nice. Good luck! What’s the project?
Cool! What’s the project?
Despite being suicidally depressed and having a fucked up sleep schedule I’m pretty good on track with my thesis. Have carefully read about 60 papers in the last three weeks and achieved important milestones on time.
It’s never too late to start doing something you love. Even if it means to entirely switch careers. You can be proud of yourself for pursuing this, even if it means leaving a comfort zone. :)
FYI: Alcohol is a class 1 carcinogen, like tobacco and radiation. There is no safe consumption of usual alcoholic beverages.
“top leader of the free world”
Yeah. We are currently hating on foreigners real hard again and want to introduce storage of IP connections for three months for everyone without reason. We are so free, that you can’t even change your name without psychological assessment. Even then it’s up to the arbitrariness of the clerk. And even then you are tightly restricted in how you can change it. We enjoy such freedom, that you have to wait 6 months or longer for specialist medical care (if you are not dying right now). But we are free to pay using private insurance, which instantly levels us up to superior class citizens. Much less of a hassle then, if you can afford it. We are so free that you can easily sacrifice most of your money just to get a somewhat minimal amount of living space for rent. Well, to be fair, this depends on your income class.
This is especially free, if you have difficulties climbing up the income class, because you can’t get the medical attention you need to fix some stuff. Then you are free to revel in your freedom while not getting forward in your free life.
And don’t mind those pesky little migrants again, who are free to stay dumb, because we allow ourselves the freedom to not integrate and support them properly.
You see, freedom in Germany is often just a question of personal wealth. If you’ve got enough money, you’ve got a lot more freedom.
Our freedom is also reflected in the world press freedom index which has worsened in the past years from “good” to “satisfactory”. When we vote for a political party that represents our opinions and interests best, there is a chance that this vote will be canceled out in the final election results, if that party doesn’t get at least 5% of overall votes. Such votes go directly to waste. Isn’t that great freedom of political choice?
Let’s talk about freedom of movement: If you’re not a superior class citizen (somewhat wealthy) good luck getting around without a car. Especially in rural areas. Pack a good book and plenty of water. Oh, and I hope you don’t mind close personal contact to various strangers on a daily basis, because our public transport infrastructure takes it’s time and is overloaded with freedom.
Also our politicians are very free in what they can do and how they can treat us. One guy, a chancellor nonetheless, used his freedom of thought to forget everything about an extremely severe financial scandal he was involved in (Cum-Ex, Scholz), another one enjoys his freedom after generously supporting a mask company using many many tax euros (during the Covid pandemic) based on a personal recommendation from party members (Maskenaffäre, Spahn), and then, politicians are also free to use the police as their personal intimidation tool when they have hurty hurt feelings after being called a dick (Andi ist 1 Pimmel). But I mean, that all makes sense. If we think of further cases like Nestlé-Klöckner, or Amthor-stocks, those people just want to ensure and expand their freedom.
Ah… I could go on and on about it and tell you about the many facets of freedom we enjoy in Germany. But that’s enough for now. I need to get going to enjoy my freedom.
Okay, to be even more fair, compared to the United States of Idiots, Germany is pretty cool. Also compared to a lot of other countries probably. But saying it is a “top leader of the free world” makes me scoff.
There’s a list of Chrome extensions
If you don’t want to have an enshittified internet, it would be reasonable to not use and thereby support software by a company which actively works on enshittifying virtually everything it touches.
In other words: stop using Google / Alphabet products.
I’m in favour of making it mandatory in the context of fucking Trump, fucking Musk and all other fucking facists or fucking fascist-enablers.
While they hurt countless of lifes and get glorified for who they are, they are trying to silence you for speaking up.
I’m so glad I’ve quit Reddirt back when those API pricing changes happened. Fucking facists.
Looks a lot like the moldovian Vertuta. I bet they taste similar.
Good point comma!
Unlike metric, there isn’t an international standard for this.
There is one, ISO 80000‑1. But it specifically allows commas and points. Which doesn’t resolve the confusion. We really should adhere to one single standard for this.
I’ll be more cautious now, when writing such numbers in English. Thanks for pointing commaing that out!
To conform with SI unit prefixes. Which is a good thing imo.
But according to Wiki the IEC defined those binary prefixes in 1999. And I find it problematic that so few still don’t know about this and don’t adhere to that standard. Even fellow engineers don’t use it correctly. No wonder companies like Microsoft also still use it wrong. This keeps things confusing.
“I really hope, I am AI. That would mean I am not part of this stupid species.”
Good enough?
Vibe Coding be like: