Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
Inhoud geleverd door Igor Melnyk. Alle podcastinhoud, inclusief afleveringen, afbeeldingen en podcastbeschrijvingen, wordt rechtstreeks geüpload en geleverd door Igor Melnyk of hun podcastplatformpartner. Als u denkt dat iemand uw auteursrechtelijk beschermde werk zonder uw toestemming gebruikt, kunt u het hier beschreven proces https://nl.player.fm/legal volgen.
Overeenkomstig met Arxiv Papers
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
Come dive into one of the curiously delightful conversations overheard at National Geographic’s headquarters, as we follow explorers, photographers, and scientists to the edges of our big, weird, beautiful world. Hosted by Peter Gwin and Amy Briggs.
…
continue reading
When you hear the words Alzheimer's disease, what do you think of? The truth is, the picture most of us have of the disease is incomplete. Alzheimer's disease doesn't start when someone starts to lose their memory. It actually starts years – sometimes decades – earlier. The Rethinking Alzheimer's Disease Podcast is an engaging, narrative-style podcast miniseries for those curious or motivated to learn about Alzheimer’s disease. Perhaps you have a family member with Alzheimer’s disease, or ca ...
…
continue reading
Welcome to Curiosity Weekly from Discovery, hosted by Dr. Samantha Yammine. Once a week, we’ll bring you the latest and greatest in scientific discoveries and break down the details so that you don’t need a PhD to understand it. From neuroscience to climate tech to AI and genetics, no subject is off-limits. Join Sam as she interviews expert guests and investigates the research guiding some of the most exciting scientific breakthroughs affecting our world today. Hosted on Acast. See acast.com ...
…
continue reading
Science Friction's latest season is: Artificial Evolution. In 1996, Dolly the Sheep became the first ever cloned animal. Nearly 30 years later, genetic technology has reshaped the world around us. What exactly has happened, where are we headed, and are we OK about it? In this series, environment reporter Peter de Kruijff tells the surprising stories of genetic engineering. Meet the scientists changing the food we eat and creating animals with organs we can use. Hear about the criminal conspi ...
…
continue reading
I discuss a variety of topics in both the natural and social sciences, exploring the many fascinating insights that the scientific method yields about the world around us.
…
continue reading
This podcast is a channel on the New Books Network. The New Books Network is an academic audio library dedicated to public education. In each episode you will hear scholars discuss their recently published research with another expert in their field. Discover our 150+ channels and browse our 28,000+ episodes on our website: newbooksnetwork.com Subscribe to our free weekly Substack newsletter to get informative, engaging content straight to your inbox: https://newbooksnetwork.substack.com/ ...
…
continue reading
Help me fill in the blanks of the practice of ED Critical Care. In this podcast, we discuss all things related to the crashing, critically ill patient in the Emergency Department. Find the show notes at emcrit.org.
…
continue reading
Whether the topic is popcorn or particle physics, you can count on BrainStuff to explore -- and explain -- the everyday science in the world around us.
…
continue reading
Player FM - Podcast-app
Ga offline met de app Player FM !
Ga offline met de app Player FM !
))
[QA] Using Attention Sinks to Identify and Evaluate Dormant Heads in Pretrained LLMs
Manage episode 475854533 series 3524393
Inhoud geleverd door Igor Melnyk. Alle podcastinhoud, inclusief afleveringen, afbeeldingen en podcastbeschrijvingen, wordt rechtstreeks geüpload en geleverd door Igor Melnyk of hun podcastplatformpartner. Als u denkt dat iemand uw auteursrechtelijk beschermde werk zonder uw toestemming gebruikt, kunt u het hier beschreven proces https://nl.player.fm/legal volgen.
The paper introduces "dormant attention heads" in multi-head attention, analyzing their impact on model performance and revealing their early emergence and dependency on input text characteristics.
https://arxiv.org/abs//2504.03889
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2489 afleveringen
Delen
Manage episode 475854533 series 3524393
Inhoud geleverd door Igor Melnyk. Alle podcastinhoud, inclusief afleveringen, afbeeldingen en podcastbeschrijvingen, wordt rechtstreeks geüpload en geleverd door Igor Melnyk of hun podcastplatformpartner. Als u denkt dat iemand uw auteursrechtelijk beschermde werk zonder uw toestemming gebruikt, kunt u het hier beschreven proces https://nl.player.fm/legal volgen.
The paper introduces "dormant attention heads" in multi-head attention, analyzing their impact on model performance and revealing their early emergence and dependency on input text characteristics.
https://arxiv.org/abs//2504.03889
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2489 afleveringen
All episodes
×
Welkom op Player FM!
Player FM scant het web op podcasts van hoge kwaliteit waarvan u nu kunt genieten. Het is de beste podcast-app en werkt op Android, iPhone en internet. Aanmelden om abonnementen op verschillende apparaten te synchroniseren.
Overeenkomstig met Arxiv Papers
Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
Come dive into one of the curiously delightful conversations overheard at National Geographic’s headquarters, as we follow explorers, photographers, and scientists to the edges of our big, weird, beautiful world. Hosted by Peter Gwin and Amy Briggs.
…
continue reading
When you hear the words Alzheimer's disease, what do you think of? The truth is, the picture most of us have of the disease is incomplete. Alzheimer's disease doesn't start when someone starts to lose their memory. It actually starts years – sometimes decades – earlier. The Rethinking Alzheimer's Disease Podcast is an engaging, narrative-style podcast miniseries for those curious or motivated to learn about Alzheimer’s disease. Perhaps you have a family member with Alzheimer’s disease, or ca ...
…
continue reading
Welcome to Curiosity Weekly from Discovery, hosted by Dr. Samantha Yammine. Once a week, we’ll bring you the latest and greatest in scientific discoveries and break down the details so that you don’t need a PhD to understand it. From neuroscience to climate tech to AI and genetics, no subject is off-limits. Join Sam as she interviews expert guests and investigates the research guiding some of the most exciting scientific breakthroughs affecting our world today. Hosted on Acast. See acast.com ...
…
continue reading
Science Friction's latest season is: Artificial Evolution. In 1996, Dolly the Sheep became the first ever cloned animal. Nearly 30 years later, genetic technology has reshaped the world around us. What exactly has happened, where are we headed, and are we OK about it? In this series, environment reporter Peter de Kruijff tells the surprising stories of genetic engineering. Meet the scientists changing the food we eat and creating animals with organs we can use. Hear about the criminal conspi ...
…
continue reading
I discuss a variety of topics in both the natural and social sciences, exploring the many fascinating insights that the scientific method yields about the world around us.
…
continue reading
This podcast is a channel on the New Books Network. The New Books Network is an academic audio library dedicated to public education. In each episode you will hear scholars discuss their recently published research with another expert in their field. Discover our 150+ channels and browse our 28,000+ episodes on our website: newbooksnetwork.com Subscribe to our free weekly Substack newsletter to get informative, engaging content straight to your inbox: https://newbooksnetwork.substack.com/ ...
…
continue reading
Help me fill in the blanks of the practice of ED Critical Care. In this podcast, we discuss all things related to the crashing, critically ill patient in the Emergency Department. Find the show notes at emcrit.org.
…
continue reading
Whether the topic is popcorn or particle physics, you can count on BrainStuff to explore -- and explain -- the everyday science in the world around us.
…
continue reading
Player FM - Podcast-app
Ga offline met de app Player FM !
Ga offline met de app Player FM !
