• elucubra@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    3
    ·
    21 days ago

    But I’m also getting really tired of people purposely putting extreme effort into tricking the LLM into saying something harmful if someone were to follow it blindly, just so they can make a clickbait headline out of it.

    That’s called testing, and the companies behind these LLMs should, before launch, put a very important amount of their resources into testing.

    “Product testing is a crucial process in product development where a product’s functionality, performance, safety, and user experience are evaluated to identify potential issues and ensure it meets quality standards before release” (Gemini)

    We are literally using alpha/beta software to deal with life altering issues, and these companies are, for some reason, being able to test their products on the public, without consequences.

    • tarknassus@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      21 days ago

      Can you think of any other industry where the mass adoption of a product is untested? Like image airlines adding a new autopilot system that allows a single crew flight - but it’s been untested. Or an electrical appliance that is sold without being tested for shock hazards?

      Similar with AI - they already tell us they don’t know exactly how it all works (the black box) - yet are content to unleash it on the masses and see what happens. The social and personal effects this will have are being studied already and it’s not looking great.

      It’s not even labelled as a beta test either.

      • Feyd@programming.dev
        link
        fedilink
        English
        arrow-up
        0
        ·
        21 days ago

        That they don’t know how it works is a lie. The mysticism and anthropomorphization is purposeful marketing. Pretending they don’t know how it works also lets them pretend that the fact they constantly lie is something that can be fixed rather than a fundamental aspect of the technology

    • vermaterc@lemmy.ml
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      21 days ago

      It’s like you bought a car and deliberately hit the wall to make a headline “cars make you disabled”. Or bought a hammer, hit your thumb and blame hammers for this.

      Guys, it’s a TOOL. Every tool is both useful and harmful. It’s up to you how you use it.

      • pipi1234@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        21 days ago

        Car makers test exactly that, and for good measure since cars can and do crash!

        What are you suggesting, that we buy cars that didn’t pass crash tests?

        To me it seems like you arguing something similar for AI.

      • elucubra@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        1
        ·
        20 days ago

        Hammers have been perfected over millenia. Cars over a century, with regulations and testing for safety getting stricter by the year.