Multi threading is parallelism and is poised to scale to a similar factor, the primary issue is simply getting tensors in and out of the ALU. Good enough is the engineering game. Having massive chunks of silicon laying around without use are a mach more serious problem. At the present, the choke point is not the parallelism of the math but actually the L2 to L1 bus width and cycle timing. The ALU can handle the issue. The AVX instruction set is capable of loading 512 bit wide words in a single instruction, the problem is just getting these in and out in larger volume.

I speculate that the only reason this has not been done already is because pretty much because of the marketability of single thread speeds. Present thread speeds are insane and well into the radio realm of black magic bearded nude virgins wizardry. I don’t think it is possible to make these bus widths wider and maintain the thread speeds because it has too many LCR consequences. I mean, at around 5 GHz the concept of wire connections and gaps as insulators is a fallacy when capacitive coupling can make connections across all small gaps.

Personally, I think this is a problem that will take on a whole new architectural solution. It is anyone’s game unlike any other time since the late 1970’s. It will likely be the beginning of the real RISC-V age and the death of x86. We are presently at the age of the 20+ thread CPU. If a redesign can make a 50-500 logical core CPU slower for single thread speeds but capable of all workloads, I think it will dominate easily. Choosing the appropriate CPU model will become much more relevant.

Mainstream is about to collapse. The exploitation nonsense is faltering. Open source is emerging as the only legitimate player.

Nvidia is just playing conservative because it was massively overvalued by the market. The GPU use for AI is a stopover hack until hardware can be developed from scratch. The real life cycle of hardware is 10 years from initial idea to first consumer availability. The issue with the CPU in AI is quite simple. It will be solved in a future iteration, and this means the GPU will get relegated back to graphics or it might even become redundant entirely. Once upon a time the CPU needed a math coprocessor to handle floating point precision. That experiment failed. It proved that a general monolithic solution is far more successful. No data center operator wants two types of processors for dedicated workloads when one type can accomplish nearly the same task. The CPU must be restructured for a wider bandwidth memory cache. This will likely require slower thread speeds overall, but it is the most likely solution in the long term. Solving this issue is likely to accompany more threading parallelism and therefore has the potential to render the GPU redundant in favor of a broader range of CPU scaling.

Human persistence of vision is not capable of matching higher speeds that are ultimately only marketing. The hardware will likely never support this stuff because no billionaire is putting up the funding to back up the marketing with tangible hardware investments. … IMO.

Neo Feudalism is well worth abandoning. Most of us are entirely uninterested in this business model. I have zero faith in the present market. I have AAA capable hardware for AI. I play and mod open source games. I could easily be a customer in this space, but there are no game manufacturers. I do not make compromises in ownership. If I buy a product, my terms of purchase are full ownership with no strings attached whatsoever. I don’t care about what everyone else does. I am not for sale and I will not sell myself for anyone’s legalise nonsense or pay ownership costs to rent from some neo feudal overlord.

Yeah this has been my experience too. LLMs don’t handle project specific code styles too well either. Or when there are several ways of doing things.

Actually, earlier today I was asking a mixtral 8x7b about some bash ideas. I kept getting suggestions to use find and sed commands which I find unreadable and inflexible for my evolving scripts. They are fine for some specific task need, but I’ll move to Python before I want to fuss with either.

Anyways, I changed the starting prompt to something like ‘Common sense questions and answers with Richard Stallman’s AI assistant.’ The results were remarkable and interesting on many levels. From the way the answers always terminated without continuing with another question/answer, to a short footnote about the static nature of LLM learning and capabilities, along with much better quality responses in general, the LLM knew how to respond on a much higher level than normal in this specific context. I think it is the combination of Stallman’s AI background and bash scripting that are powerful momentum builders here. I tried it on a whim, but it paid dividends and is a keeper of a prompting strategy.

Overall, the way my scripts are collecting relationships in the source code would probably result in a productive chunking strategy for a RAG agent. I don’t think an AI would be good at what I’m doing at this stage, but it could use that info. It might even be possible to integrate the scripts as a pseudo database in the LLM model loader code for further prompting.

Sharks regrow their teeth, not their fins.

Why don’t they start by cutting the head off of the monster that got them in this position. That should be the first step. Stupid sharks loose their teeth, not their fins that actually do the work. Like, everyone in corporate should be sued and owe back every bit of their pay from the last few years. This is a steering problem. So replace the wheel and fuck up the old one.

phayl

Pareto principal for psyops, by a think tank organization too. Why is this nonsense tractable here?

Probably a bulk discount with the rocket materials supplier too.

Current is flowing when probing the shunt. It’s getting a little hot

I am an intuitive thinker that functions in abstract thought. I am not autistic. I have had extensive testing related to my physical disability and massive head injury. You lack a nuanced understanding of the context and scope of what I am asking and why. Everyone has a limited amount of information that they can process at any point in time. For most people they can only handle around a thousand lines of code at a time. There is a major metal challenge to overcome for a person to handle a project with hundreds of thousands of lines of code. This is largely an organizational challenge. When such a systemic challenge is encountered, larger groups of people tend to come up with better solutions over time. I am limited in my exposure to other people. However, I am aware that many people here are more experienced than myself in this area. This post was an attempt at exploring different forms of organization. I’m also exploring the curiosity I intuitively pick up on that indicates many of the best programmers likely have perfect recall, or at least have a larger human byte than average. I am far more self aware than the average person, and have made the assumption that most people that are gifted in their ability to handle more information than the average person will also be self aware to a similar extent. Abstracted intuitive thinking is a rarer form of functional thought, but it is not autistic. I can apply this kind of abstraction and mobility across subjects to anything. I do conflict with personalities that lack value for intuitive thinking and abstraction, but it is because they can not see the bigger picture, their own internal conflict, and address it effectively. They also tend to see my thought process as arrogant and assumptive, but it is because they lack a contextual understanding of my real flexibility and mobility across abstracted subjects and ideas. For example, when you hear the stories about Einstein abstracting the light from a train to extrapolate the principals of the speed of light, or a man falling from a roof to abstract the properties of gravity, that is a very familiar way of thinking in my mind. Everything I encounter is like this; where I am fitting the pieces together and noticing connections and coincidence that I find amusing. I’m very aware of the assumptive bases and correcting it constantly. I operate on the statistical probability of my assumptions, but I use all mental spaces to support each hypothesis and remain open to any new information that better fits what I already know.

This is all I see as lead mod of 3d printing. I also checked and desktop is the same both in desktop mobile view and on my laptop.

Human byte was used in a conference awhile back to refer to the amount of information one can process at any given point in time. Someone that has total recall has a much larger human byte. The term makes clear intuitive sense to me, but I’m a highly abstracted person in the first place. My abstraction seems to limit how much complexity I can manage with a project and code. I’m largely exploring the implications and contrasting personalities to better understand how people are able to manage so many details in some projects.

I’m messing around with trying to understand the game Cataclysm DDA at the moment, and reading into everything that is happening as it is scattered all over the project is a struggle. When I see all the pull requests and the daily release cycle of the game, I’m baffled by the way someone is able to manage this kind of project and maintain an overall vision and consistency in the game and code. I feel like I must be missing some critical element of methodology.

I exist in a vacuum, and live under a rock. I was an advanced fabricator, got disabled, and now largely stuck finding myself while exploring the digital world. I’m learning entirely on my own and without any background or mentors. In abstract, I might spend forever trying to invent the wheel if I fail to ask the right questions.

I would rather vote identities being blocked from scraping. I don’t care about other users or admins. I would rather that level of information be unavailable to outside commercial sources, especially any timings based metadata that could be used to derive dwell time and other psychological metrics.

I’m asking to find out if there is a class and if it has a goto book, but leaving it open ended for other techniques like maybe Emacs and the org mode stuff, etc.

Pitcher and catcher

Lefties ruins everythings/s

Funny. No. This is not remotely comparable to CPU’s crashing because of a lack of R&D and half ass quarter earnings profiteering culture’s lack of intelligent long term thinking. It is not remote accessible. This is just corporate psyops in an attempt to coverup their overwhelming neo feudal incompetence. If they had the staff and invested reasonably, the problems wouldn’t happen. Paint the world in shit to continue the claim that yours does not stink. Only idiots buy into that.

Provided reference for a thought for clarity.

I do take offense at the many excuses and terrible behavior of people telling me tough, get over it, etc., by inference or directly. No joke, when my folks die soon, so will I. I did nothing to deserve this horrifically abusive fate. This is the gun pointed at my head with a bullet in the chamber. I’m aware of it constantly, but have no way of changing things. If you want to defend that kind of nonsense or call it equal that is on you. This is lives versus ignorant stupidity that is abusively hurtful to me. If that bothers people’s stupid politics I don’t give a damn. A person’s life and right to exist in peace is far greater than anyone’s right to a shitty opinion. I want nothing to do with anyone that cares to argue against that, as they are arguing for murder and complicit bystanders. MLK said it best, “Bad things happen when good people do nothing.”

Mistranslation of a statement. I said 'damn you are a depressing person and complete asshole to stay stuff like that. I do not make exception for anonymous internet behavior. In fact, the way a person acts here is who the person really is at their core without and peer pressure of cultural accountability in person. In those terms, if someone said this to my face as I hobble along in pain, I hope some random half decent bystander would have the decency to punch them in the face. Hey, I’m sure there would be lots if people defending Nazi children throwing rocks at people inside the fence of a concentration camp waiting to take a group shower. Why should I expect any different here.

They don’t. All these people saying these excuses are doing so to dismiss their conscious because they are the true monsters but unable to openly recognize their own reflections. When tides turn, these are the people that sway in the wind of Nazi like horrors and atrocities. I doubt any of them realize it directly. When I was much younger I was just as naive of an idiot, and just as clueless about what disability is really like. There is no monster as scary or atrocious as ignorant indifference.