GPU World

(gpuworld.org)

178 points | by simonpure 5 hours ago

29 comments

  • maxnevermind 16 minutes ago
    > Someday, such as in 2040, there may be available, for every human being, the performance equivalent of 'a B300 GPU for contemporary LLMs'. What would this world be like?

    If we talk about just LLMs, given how things have been going since ChatGPT, my bet it would not change that much. LLMs are not foundational technology such as Internet or Steam engine or Rail roads were. There are very few products that can build upon them because of reliability issues which are completely unresolvable for LLMs, chatbots is a decent product that came out of it, coding harnesses is another one, this is not even close to the impact Internet or Steam engine had. LLMs gave us nice productivity tools for highly motivated expert knowledge workers, that is all. LLMs are getting better and will get better, but it is impossible to describe the universe and compress it into few terabytes and that is what they are doing atm effectively, so all serious LLMs's issues will still be there in 2040: the lack on continues learning, hallucinations, terrible sample ratio, agent's failures on long horizon tasks, instruction following failures.

  • _joel 0 minutes ago
    Anyone else sing that in there head as, "Where in the world, GPU world".
  • NitpickLawyer 2 hours ago
    I just finished reading Service Model by Adrian Tchaikovsky [1], a really timely novel that deals with lots of open ended questions of AI, robots, humanity, control, self determination, and so on. Really recommend it if you're into these kinds of things.

    > Premise Imagine that AI frontier progress stops as of 1 September 2026: AI becomes faster and cheaper, but it never becomes superhuman or improves considerably across the board.

    I absolutely love this premise. I wrote a comment a few days ago about this very thing. I've had this "revelation" in early 2024, when using a small local model, that even if models never improve, I'd still have a few years of discovering all the things I could do with the models.

    Really cool, hopefully we get some interesting and not overwhelmingly pessimistic stories out of this project. There's enough cynicism and negativity in the world. We could use some funny takes on everyone using openclaw2040 ran by fable. Shenanigans galore.

    [1] - https://www.goodreads.com/en/book/show/195790861-service-mod...

    • jaggederest 28 minutes ago
      The more I use Fable the more impressed I am with it. I am still learning how to use it, same with gpt-5.6-sol. I don't think the model has changed much, but both models have gotten smarter in leaps and bounds as I've improved the documentation, context, how I provide work to them and how I specify success.

      (And generally that consists of keeping only the very most relevant details and deleting a lot of the boilerplate I used to need for other models, it's a great trend.)

      I am excited for the next tier of models, but I could readily work for the rest of my career feeling like I have superpowers with only what we have right now. I'm also very excited for the idea of these same strength models getting faster, and much, much cheaper.

    • mc3301 27 minutes ago
      I finished reading it recently, too. I thought it was quirky, delightful, and obviously exaggerated for entertainment and contemplation purposes. I've recommended it to a bunch of people, too!

      It triggered one of my favorite weird activities: after reading a book that I fully enjoyed and feel was completely "worth it," I give myself a few days to float on that happy feeling. Then, I go look at specifically only one and two star reviews. And laugh. Man, some people hated that book!

      Note that otherwise, as a rule, I basically never read reviews of entertainment, restaurants, hotels and similar before nor after. I'm just not interested.

    • abrookewood 1 hour ago
      Haven't read that one yet, but his Children of Time series is sooo good.
    • yitchelle 1 hour ago
      Yes, that book is a stark reminder (or prediction).
    • ideasman42 1 hour ago
      I couldn't believe it when the "real" news headline was reported - destructively scanning books.

      I thought this was one of the less plausible parts of the book, Sigh! :)

      • jaggederest 27 minutes ago
        Down the pipe, I think it's medium likely we'll start destructively scanning humans. Wild stuff, honestly.
  • sriniwasx 3 minutes ago
    Looking at the trends, local AI is the future, smaller models are getting faster and high demands always leads to oversupply if you've got resources, just look at all the AI data-centers, If small models go mainstream GPU's and data-centers will become dirt-cheap.
  • rixed 2 hours ago
    Since the dawn of industry, people have been amazed by the new possibilities and how that would affect society once it's evenly distributed. Technical progress has been going on, percolating in every places and down to every person. Yet it's never been "evenly distributed".

    What would happen when every one would have access to Internet? How different will the world be when everyone carries a computer in their pocket? Can communicate with anyone regardless of location and language, with no intermediary? Those were questions we used to ask ourselves not so long ago. Turned out: not much have changed.

    For the future to be evenly distributed, much bigger changes will have to happen than large scale manufacture of efficient GPUs. Otherwise, tech will just be used to make sure progress and knowledge stays unevently distributed. That's the whole game of herding humans, after all; It's called "organized scarcity".

    • guax 1 hour ago
      > not much have changed.

      So much have changed. The way we shop, travel, navigate a town, the way we socialize, receive information. My formative memory is during the transition from computers are a furniture piece and internet a thing you do to being on your pocket with constant high speed connection and the difference is incredible.

      I was also part of the people that thought everyone having access would turn out a lot better than it ended up being. I think the issue is not that it did not change much, is that good changes got offset a bit by a lot of very bad outcomes.

      No comment on the distribution and concentration part, that one I agree.

      • camillomiller 1 hour ago
        In the limited pockets of society you experience directly. How much has changed in the relationship between the West and Asia, the economic inequalities globally, or even in the West, etc... if you look at macro, everything moves according to laws that have little to do with the even distribution of technology and a lot to do with the decision makers that get to pick how that distribution takes place.
        • elil17 1 hour ago
          Just because something doesn't impact geopolitics doesn't mean it isn't important
          • camillomiller 1 hour ago
            That's not what I'm saying, and I don't know where you inferred that from. I'm saying that tech has changed the world in the way we experience it, for sure, but it has been driven by political choices, more that drive political choices itself if we look at the bigger picture.
      • tosapple 1 hour ago
        [dead]
    • jazzprogramming 23 minutes ago
      I was thinking of something similar.

      Waxing poetic, it's been a while since the wheel was invented and we've gone through a lot since then, yet the rich are still rich and the poor are still poor and the loved are still loved and the loveless still loveless.

      Would one GPU data center/person make a difference? Probably not, but it could be quite fun to have your own personal genie. And then we get used to it.

      Still, I'm not sure if most people care to make the distinction between technology (a rocket promising to reach for the stars) and the human condition (has it ever changed since the dawn of time?).

    • gwern 2 hours ago
      > Turned out: not much have changed.

      I think the world has changed a lot since the 1980s.

      • rbanffy 1 hour ago
        Most people still go to work every day, inequality still exists, as does famine, disease, wars…

        Our cars are cleaner, our phones are much better, our TVs much lighter and bigger.

        • toyg 17 minutes ago
          Life in Asia and Africa has changed pretty dramatically, and improvements are accelerating. Yeah, we're not in utopia yet, but more people than ever live comfortable, safe lives. "Business at the speed of light" has become a reality, and we're still getting to grips with it. We dealt with a global pandemic with an efficiency never seen before - had it happened in the previous century, we would have probably seen "black death" levels of casualties.

          Issues like inequality and conflict are mostly rooted in the human psyche more than the human condition, so they will continue to be there probably forever; but we're getting better.

        • bawolff 28 minutes ago
          > Most people still go to work every day,

          Ironically, that is one of the things that have changed. In 1980 working from home was borderline unthinkable. Now, while it is far from universal its also not that unusual.

        • cheema33 1 hour ago
          > Most people still go to work every day..

          And trees and mountains and animals still exist...

          Rate of change, it appears, depends entirely on someone's perspective.

    • mshanu 1 hour ago
      > Turned out: not much have changed Changed a lot, I am getting to know what a random person living some where in the world think about what change it has brought
    • mistermann 19 minutes ago
      [dead]
  • not2b 2 hours ago
    Hopefully in this world, someone figures out how to deliver the performance equivalent of a B300 GPU for about 1/100th the power of a current B300 (which can be up to 1400 watts), or the world will bake.
    • avaer 2 hours ago
      Analog AI/approximate computing? There's research into it, worth looking at if you're interested.

      The idea is you tolerate some loss/degradation (which neural networks do) but gain orders of magnitude power efficiency.

    • i5heu 1 hour ago
      8 biillion * 1400 watts = 11.2 terawatts

      current global average electricity production = approximately 3.6 terawatts

      But then again these systems do not use 1400 watts all the time. We would probably have much more then 11.2 terawatts demand if all humans turn on all their electrical consumers at the same time.

      • not2b 56 minutes ago
        So demand quadruples if they are always on, and doubles if they are on 1/3 of the time. Either way, too much.
  • markoutso 59 minutes ago
    > LLM use is permitted, but discouraged; we remind participants that LLM use tends to reduce originality and writing quality, and the flaws are especially obvious when LLM outputs are read as a group---unskillful use of LLMs will reduce the odds of being the best entry. We request disclosure of AI use.
  • divbzero 2 hours ago
    Quite an interesting selection committee:

      Neal Stephenson
      Gwern Branwen
      Matt Huang
  • gizajob 39 minutes ago
    Literally just write “the young lady’s illustrated primer” again. Stephenson already called it.
  • jdub 2 hours ago
    LLM use is permitted, but discouraged; [...] We request disclosure of AI use.

    Heh. In the future I imagine, this would be embarrassingly redundant. "Thou shalt not make a machine in the likeness of a human mind."

    • blkhawk 1 hour ago
      As far as I understand the backstory of the jihad this rule was caused not by machine minds being bad but (some) humans are very shitty.
    • fangspire 1 hour ago
      Nah, someone imagined this before you. Be more original.
    • koolala 2 hours ago
      It's a story writing competition...
      • jdub 2 hours ago
        Yeah, but I'm not going to write a short story about the Butlerian Jihad's inquisitors chasing down everyone who owns a GPU for this competition.
  • newyankee 2 hours ago
    there might be 8 billion GPUs in the world by 2040 but they will be controlled by 8 corporations across the world.
    • charlieyu1 1 hour ago
      So how is it different from now, you can name any industry for example
      • Tepix 16 minutes ago
        OK, here are a few industries: Food. Construction. Power. Logistics.
    • rbanffy 1 hour ago
      “In our story contest, we ask people to imagine the future, evenly distributed.”
      • worldsayshi 1 hour ago
        I think there are scenarios, however (un)likely that will lead us to this point. Imaging them and spreading such ideas can make that more likely.
        • bertylicious 1 hour ago
          But the contest does not ask what needs to happen to achieve even and fair distribution of wealth, it specifically asks what might happen after we reached that point. That kind of blindness towards today's political and socio-economic conditions has always been very typical for this kind of techno optimism. I believe it actually prevents revolutionary thought by assuming some kind of revolution has already occurred somehow in order to then attribute all following societal progress to the technology alone.
  • mkagenius 1 hour ago
    > LLM use is permitted, but discouraged; we remind participants that LLM use tends to reduce originality and writing quality, and the flaws are especially obvious when LLM outputs are read as a group---unskillful use of LLMs will reduce the odds of being the best entry. We request disclosure of AI use.

    Lot of submissions won't disclose it. Wouldn't it better to run your own checker instead of asking to disclose (to be fair to everyone).. I suppose there ought to be some checker which is SOTA.

    If you anyway intend to use the checker then kindly do no ask to disclose it, coz what's the point then.

    • cheema33 1 hour ago
      > Wouldn't it better to run your own checker instead of asking to disclose

      Do you know of a "checker" that can reliably detect AI-assisted writing with 100% accuracy? One does not exist.

      > If you anyway intend to use the checker then kindly do no ask to disclose it, coz what's the point then.

      You appear to think in absolute terms. I am guessing you are very young.

      • mkagenius 1 hour ago
        I said SOTA not 100%. And that's not thinking in absolute terms.
      • prodigycorp 41 minutes ago
        SynthID is designed in a way that makes it virtually impossible to scrub over longer texts. It's harder for text than it is for images.
      • calmoo 1 hour ago
        Pangram is very accurate
        • NitpickLawyer 1 hour ago
          It really isn't and it's sad seeing so many people say it so confidently on this site. It only detects plain / basic prompted stuff. "write me an essay on x", sure. The moment you prompt it differently, it stops working. Add "output should be STE100 compliant" or something to your prompts and detection goes away. Fine-tune any local llm on real human prose, and detection goes away. Edit 2-3 characters (emdashes, lists, etc) and detection goes away.

          And that's for just basic detection. There have been plenty of examples of 100% human written content (either old, or unpublished) that gets falsely flagged as AI.

          And these are just technical aspects. The main issue is that pangram and other solutions are being used to summarily judge students work, and that is orders of magnitude more fucked up. Accusing someone of cheating can have devastating effects on their education/career/etc. and they're doing it with snake-oil closed boxes, at scale. We really really shouldn't support this, especially here on a technical site.

        • jedberg 1 hour ago
          No it isn't. I've put human written material in there (my own unpublished material) and it says 90%+ AI. Then I put some AI material in and it said 30% chance of AI.

          I only tested it with the two pieces, but was not impressed.

          • ekelsen 59 minutes ago
            Can you share your human piece that got flagged? And the AI piece that didn't? (Or snippets?) I've found pangram to be very accurate, so I'm curious.
  • Kalendermann 41 minutes ago
    It seems they run out of content so they award you with prizes for feeding the LLM with fresh content. Nice!
  • sudohalt 11 minutes ago
    Will any of the data submitted be used in training? We are all given the prompt and you will get a few thousand (maybe tens of thousands of submissions). Seems like a great source of training material.
  • orlp 1 hour ago
    If there was a continuous 500 watt GPU per person we'd increase energy consumption by more than double.

    The continuous energy footprint per person globally averages to 356 watt currently.

    • terhechte 1 hour ago
      A Mac Studio m4 max in low power mode consumes ~50-100 watt on 100% gpu consumption. On GPU idle it is ~10 watt. If we imagine improved models (e.g. qwen 3.8 is a 5b moe which is way faster to process) and improved chip performance on 2nm and half a day of usage (the AI will sleep when we sleep then):

      ((75 watt / 2 [faster models]) / 2 [faster chips]) / 2 [half a day of usage]) => ~ 10 watt.

      AI for everyone does not imply pC mAsTeRraCe for everyone.

    • cheema33 1 hour ago
      > If there was a continuous 500 watt GPU per person...

      Would we all be driving the 500 Watt GPU hard 24/7? And the premise that the "AI frontier progress stops as of 1 September 2026" likely does not include semiconductor progress. You are very likely to be able to run Fable class AI model on something that is significantly more efficient in 2040.

    • hhjinks 1 hour ago
      500 watts continuous isn't realistic, unless you foresee a 24/7 digital shadow society where AIs interact continuously without user input.
  • roschdal 2 minutes ago
    Dystopian.
  • Zoo3y 1 hour ago
    Asimov's laws of robotics and Herbert's Dune foreshadowed the troubles we are facing now and have been largely ignored. It appears fiction does nothing to guide us when it comes to technology; no matter how prescient or widely read. Consider this when writing your idealist drivel.
  • thatgloomyguy 1 hour ago
    GPU per person or models working on less computing power
  • XCSme 2 hours ago
    We can't even predict/understand our current world, yet alone the world in 20 years.

    Even if we get to one GPU pe person, it's not like that's the end state, the world constantly changes and will constantly evolve. If it stagnates too long, people get bored and a revolution would happen.

    So, whatever that world would be, it would be temporary too

    • worldsayshi 1 hour ago
      I think the point of stories like these is to accept that the world is too complex to fit into a story but we can try to fit a part of it anyway and we might learn something from it or at least get an interesting experience.
    • XRG 1 hour ago
      Boredom may cause teenagers to commit acts of vandalism; it’s not a typical cause for revolution. (That would be things like famine, gross inequality, severe injustices and so on.)
  • adventured 38 minutes ago
    We already know the answer, it's identical to the answer for: what if everybody had UBI.

    Most of the population wouldn't do anything with it. They got 5g mainframes in the palm of their hands and they watch sports, play Candy Crush or doom scroll TikTok.

    We know what they do with their spare time and we've known for generations. See: decades past + TV viewing time. Swap TV viewing time for TikTok et al.

    They get GPT 5.6 Sol or Gemini and they use it to cheat on their homework. They don't create amazing art. They don't build anything useful. They don't start businesses. They don't drastically increase their productivity or life prospects through self-education. They also largely didn't use the Internet for any of that, even though they could have.

    They're not going to create anything.

    Mimics never do, that's not their role in humanity. 99% of the population are mimics and can never do more than mimic established pathways, it's outside their biology. They'll use AI to make their lives a tiny bit better, based on what everybody else is doing, and that'll be it. Given useful machinery like advanced home robots + AI, they'll use that to reduce their home labor and increase doom scrolling time (or the equivalent).

    If you want to improve the prospects for humanity, you want to shrink the population faster, before it chokes on its own obsolescence and drowns in purposelessness. Pay people to stop having children. Focus on raising the bar for education, per capita output, per capita standards of living, quality of life.

  • padolsey 2 hours ago
    We humans will all be but API conduits for our respective AIs.
    • avaer 2 hours ago
      One interesting formulation is that humans are the sex organs of AI.
  • raincole 1 hour ago
    > What will our world be like when (not if) every human being has access to the equivalent of a Fable or Sol LLM 24/7/365

    One single sentence illustrating why tech bro has become a derogatory term. Do they realize that today many humans don't even have access to clean water?

    • bawolff 34 minutes ago
      Its a sci-fi story prompt. Do non tech bros not understand the concept of fiction?
    • charlieyu1 1 hour ago
      And? Virtually everyone in the world has internet
      • tappio 53 minutes ago
        Good argument going here but here is what internet tells me about 'facts':

        Its about the same amount of population who have access to clean water and who have access to internet, and that's maybe about 75% of global population for both. Don't know how they overlap, but probably there is people who have no access to internet but have access to clean water and the other way around.

        In absolute terms that is still billions of people. Billions.

  • peter_d_sherman 2 hours ago
    >"Someday, such as in 2040, there may be available, for every human being, the performance equivalent of 'a B300 GPU for contemporary LLMs'.

    What would this world be like?

    What will our world be like when (not if) every human being has access to the equivalent of a Fable or Sol LLM 24/7/365? Will this lead to a panopticon of indefatigable AI surveillance? Will education be revolutionized by infinitely patient tutors? Will social media cease to exist as we know it? Will healthcare be revolutionized by world class AI doctors and personalized medicines? What will happen in the oft-ignored developing world?"

    What great questions!

    These would be great questions to pose to a Creative Writing class, any Creative Writing class!

    Or heck, any Creative Writing class, Philosophy class, or Futurist!

    You know, there should be a web page, a time-capsule web page if you will, where people of 2026 ask questions about what specific future years will look like in terms of health, climate, politics, religion, currency, geopolitics, social media, news, education, etc., etc., and then all of these questions could be aggregated statistically into the most asked ones, and that could be preserved going forward in time...

    That's from a looking-forward-into-the-future perspective...

    We could, from a looking-backwards-into-the-past perspective, try to discover what people, in say 1900, thought about the future; what their specific concerns were, what their specific questions were... perhaps some historian or historians or books or (copied to) web pages out there contains some of this information somewhere...

    Which might be interesting to look at for comparison purposes...

    You know, "for good or for evil, in the superlative degree of comparison only...", to quote Charles Dickens' 1859 book, "A Tale Of Two Cities"... :-)

    • left-struck 2 hours ago
      Back in 2023 I sent myself an email with some predictions about the future and my thoughts on LLMs at the time, good and bad. I can’t remember when it’s supposed to arrive though…
  • GalaxyNova 2 hours ago
    What will happen when everyone has access to a hot air balloon?
  • tucnak 3 hours ago
    Neal Stephenson is one of the judges. 40k seems like generous enough first prize. I wonder if they will accept a play.
    • gwern 2 hours ago
      > I wonder if they will accept a play.

      We will accept any words you think have a chance of being the best thing we will read about the premise of 'GPU World'. Because the premise is so specific, we wanted to leave participants a lot of freedom in how they used it.

      (Also a little bemused at the discussion of the grand prize amount here. $40k is a very generous prize for a short piece of writing. For perspective, the Commonwealth Short Story Prize, which you may have heard of recently, offers its global winner 1/6th as much; the last contest I ran offered 1/4th as much, and the contest before that was... 1/40th as much? And I didn't hear anyone complaining about them. For further perspective, $40k is about the median American per capita annual income: https://en.wikipedia.org/wiki/Per_capita_personal_income_in_... )

      • avaer 2 hours ago
        > $40k is a _very_ generous prize for a short piece of writing

        Exactly. Not sure it will stop the inevitable torrent of slop, but it's generous enough that I think enough serious people will take it seriously that something interesting can float to the top. Can't wait to read (maybe write).

    • avaer 2 hours ago
      Also gwern and Matt Huang. Seems a pretty interesting committee.

      And 40K is enough for this to be taken seriously for producing 1000-5000 words.

  • camillomiller 1 hour ago
    I have been in tech for 20 years. i researched, covered, produced analysis, written extensively about innumerable trends. I have always done it with a grain of sane skepticism, but I have been wowed so many times. And yet, for the first time, I see something like this and I can’t utter anything but “oh my effing God”. It’s disturbing to me—to have this incredible technology available, the most incredible I’ve seen ever, and yet feel so empty about it. I just feel a fundamental repulsion. A generation ago the nerds were quirky cool outcasts with enough of a humanistic background, an understanding of the value of culture, or the humility of those who don’t know enough. This enabled them understand that tech is only part of a broader set of values, even though many of them were certainly technological maximalists. With AI another form of tech power has prevailed. It’s tech totalitarism, tech for tech’s sake. The drivers are of course the usual suspects: money and power. Yet there’s more. The resistance, even the most basic skeptical resistance, from the broader public isn’t there. With gen AI the nerd found the gold in the mine: the sudden realization that millions of people just couldn’t wait for the moment a machine could alleviate the curse of thinking. So here they go, merrily and joyously deferring their mind process to a mimicry engine, running back into the warm womb of Plato’s cave.

    That said, interesting competition, big prizes, but the premises are pretty opinionated and quite prescriptive.

  • HyperAI 1 hour ago
    [flagged]