• HubertManne@moist.catsweat.com
    link
    fedilink
    arrow-up
    130
    ·
    4 months ago

    I never learned peer review as anything more than others in the field reviewing the paper and confirming it meets standards. Its like logic vs truth. Peer review is like proofreading. Is the structure of the experiment proper. Is there controls. Is the statistical analysis proper. so on and so forth. Honestly though science is dependent on replication which used to be a sort of competition so it worked. Oh you think this is this and this is how you proved it. Well I will see for myself and I will lambast you if it does not work. It was kinda personal with the field before modern times. Competition was very direct. Now no lab wants to do anything but something they can say is new and a discovery. I feel at least 50% of public science funding should be for experiment replication

    • GBU_28@lemm.ee
      link
      fedilink
      English
      arrow-up
      38
      arrow-down
      1
      ·
      edit-2
      4 months ago

      Is there controls?

      Rejected.

      Edit this is a petty peer review joke. Please clap

    • kbal@fedia.io
      link
      fedilink
      arrow-up
      26
      ·
      4 months ago

      Sounds like maybe you learned about it from some kind of actual education, not just reading about it on social media. That’s cheating.

  • tetris11@lemmy.ml
    link
    fedilink
    English
    arrow-up
    76
    arrow-down
    7
    ·
    edit-2
    4 months ago

    It’s a numbers game.

    • X submits paper to Journal 1, and peers A,B,C reject it.
    • X submits paper with minor changes to Journal 2, and only peers D and E reject it.
    • X submits paper with minor changes to Journal 3, and only peer G rejects it
    • X submits paper with minor changes to Journal 4, and no one rejects it.

    Journal 4 increments prestige, Scientist X increments prestige, but nothing true or good is actually gained.

    Science.

    • MotoAsh@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      4 months ago

      NOT science. At all. That’s publication and clout. Two things science distinctly is NOT, but needs because information must still disseminate in some way.

      • tetris11@lemmy.ml
        link
        fedilink
        English
        arrow-up
        69
        ·
        edit-2
        4 months ago

        I believe in the scientific method. I believe in peer review.

        I just don’t like that scientific journals have become so commodified that a lesser journal would accept volumes of bad science and bad review in order to boost its rankings whilst boosting the prestige of the scientist who is measured on the quantity of their work and not the quality.

        Entire paper mills exist purely for this reason, and it’s a scourge on the scientific community.

  • atro_city@fedia.io
    link
    fedilink
    arrow-up
    32
    ·
    4 months ago

    Thank the greed. Even bad results should be kept. It’s still knowledge. To get closer to a goal, many mistakes are made and we have to learn from them. Using the scientific method to find out that something does not work is still valuable.

    • Sc00ter@lemm.ee
      link
      fedilink
      English
      arrow-up
      11
      ·
      4 months ago

      This is a lesson I try to teach my kids every day. When they get upset they can’t do something, I ask, “well whatd you learn?” And sometimes it’s as simple as “that didn’t work.” Other times they think for a second they try something new.

      Failure is a learning opportunity. Take advantage if it.

  • Grandwolf319@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    29
    ·
    4 months ago

    Never,

    It’s peer review not peer verified.

    English is my second language so I don’t get this post, it always meant someone else read it.

    • Asafum@feddit.nl
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 months ago

      I think to some of us a review is seen as a verification of veracity.

      I honestly always mistook peer review as OPs post so I guess I was 37 when I learned that…

      • psud@aussie.zone
        link
        fedilink
        English
        arrow-up
        4
        ·
        4 months ago

        When I have reviewed IT system design changes, my favorite comment for correct-looking changes has been “looks good, I look forward to seeing whether it works”

  • MNByChoice@midwest.social
    link
    fedilink
    English
    arrow-up
    29
    ·
    4 months ago

    The ones that fail peer review go from “unexpected result” to “the fuck were you actually doing?!?”

  • xJREB@lemmy.world
    link
    fedilink
    English
    arrow-up
    22
    ·
    4 months ago

    I recently read an interesting article proposing to get rid of the current peer review system: https://www.experimental-history.com/p/the-rise-and-fall-of-peer-review

    The argument was roughly this: for the unfathomable (unpaid) hours spent on peer review, it’s not very effective. Too much bad research still gets published and too much good research gets rejected. Science would also not be a weak-link problem but a strong-link problem, i.e., scientific progress would not depend on the quality of our worst research but of that of our best research (which would push through anyway in time). Pretty interesting read, even though I find it difficult to imagine how we would transition to such a system.

  • Psychodelic@lemmy.world
    link
    fedilink
    English
    arrow-up
    23
    arrow-down
    1
    ·
    4 months ago

    I’m just happy they learned what peer review means. I doubt even a third of Americans know what it means or its impact on their lives

    • TonyTonyChopper@mander.xyz
      link
      fedilink
      English
      arrow-up
      28
      arrow-down
      1
      ·
      4 months ago

      Best part is the reviewers don’t get paid for their work, the publishers pocket all of the money they get from selling journals

      • Tja@programming.dev
        link
        fedilink
        English
        arrow-up
        12
        ·
        4 months ago

        While charging researchers to publish the paper and the reader for accessing it. If they can get away with it. It’s a fucking scam, thus arxiv and others exist.

        • Comment105@lemm.ee
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          4 months ago

          I’ve personally had much less respect for global academia ever since I learned how publishing journals can demand so much from researchers and their audience, while providing so little.

  • arbitrary_sarcasm@lemmy.world
    link
    fedilink
    English
    arrow-up
    18
    ·
    4 months ago

    In my field of research, there seems to be a recent push for artifact evaluation. It’s a separate process which is also optional but you get to brag about the fact that you get badges if your experiment results were replicated.

    There’s also some push back against this since it’s additional work, but I think it’s a step in the right direction.

    • Jtotheb@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      They thought the review process was more arduous than looking at some newly discovered scientific fact that no one had ever known before and saying “yeah that seems self-evident.”

      If you feel like that’s reductive, now you know why I felt like responding

    • Contramuffin@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      2
      ·
      4 months ago

      Scientists can get really petty in peer review. They won’t be able to catch if the data was manipulated or faked, but they’ll be able to catch everything else. Things such as inconclusive or unconvincing data, wrongful assumptions, missing data that would complement and further prove the conclusion, or even trivial things such as a sentence being unclear.

      It generally works as long as you can trust that the author isn’t dishonest

      • MotoAsh@lemmy.world
        link
        fedilink
        English
        arrow-up
        8
        ·
        4 months ago

        A LOT of things work without safety nets if people engage honestly.

        The problem, with FAR more than science, is many, many people are distinctly NOT honest.

  • schloppah@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    4 months ago

    Damn I guess I was today years old. I remember in high school chemistry class we were taught about peer review and had to do it for each other, except the way we did was actually testing and replicating results, so that cemented the misconception.